2018-01-21T23:49:53.176+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:51264 #33 (3 connections now open) 2018-01-21T23:49:53.196+0800 I ACCESS [conn33] Successfully authenticated as principal admin on admin 2018-01-21T23:49:53.197+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:51265 #34 (4 connections now open) 2018-01-21T23:49:53.216+0800 I ACCESS [conn34] Successfully authenticated as principal admin on admin 2018-01-21T23:49:53.307+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:51266 #35 (5 connections now open) 2018-01-21T23:49:53.318+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:51267 #36 (6 connections now open) 2018-01-21T23:49:53.326+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:51268 #37 (7 connections now open) 2018-01-21T23:49:53.338+0800 I ACCESS [conn35] Successfully authenticated as principal admin on admin 2018-01-21T23:49:53.342+0800 I ACCESS [conn36] Successfully authenticated as principal admin on admin 2018-01-21T23:49:53.357+0800 I ACCESS [conn37] Successfully authenticated as principal admin on admin 2018-01-21T23:49:53.367+0800 I - [conn35] end connection 127.0.0.1:51266 (7 connections now open) 2018-01-21T23:49:53.367+0800 I - [conn37] end connection 127.0.0.1:51268 (7 connections now open) 2018-01-21T23:49:53.367+0800 I - [conn36] end connection 127.0.0.1:51267 (5 connections now open) 2018-01-21T23:49:53.367+0800 I - [conn33] end connection 127.0.0.1:51264 (4 connections now open) 2018-01-21T23:49:53.367+0800 I - [conn34] end connection 127.0.0.1:51265 (4 connections now open) 2018-01-23T18:04:06.644+0800 I - [conn32] end connection 127.0.0.1:45025 (2 connections now open) 2018-01-23T18:04:06.649+0800 I - [conn31] end connection 127.0.0.1:45022 (1 connection now open) 2018-01-23T18:04:27.425+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:56157 #38 (1 connection now open) 2018-01-23T18:04:27.437+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:56160 #39 (2 connections now open) 2018-01-23T18:04:27.441+0800 I NETWORK [conn38] received client metadata from 127.0.0.1:56157 conn38: { driver: { name: "nodejs", version: "2.2.33" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "3.13.0-86-generic" }, platform: "Node.js v8.9.1, LE, mongodb-core: 2.1.17" } 2018-01-23T18:04:27.452+0800 I NETWORK [conn39] received client metadata from 127.0.0.1:56160 conn39: { driver: { name: "nodejs", version: "2.2.33" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "3.13.0-86-generic" }, platform: "Node.js v8.9.1, LE, mongodb-core: 2.1.17" } 2018-01-23T18:04:27.482+0800 I ACCESS [conn38] Successfully authenticated as principal admin on admin 2018-01-23T18:04:27.491+0800 I ACCESS [conn39] Successfully authenticated as principal admin on admin 2018-01-25T14:59:44.854+0800 I - [conn38] end connection 127.0.0.1:56157 (2 connections now open) 2018-01-25T14:59:44.859+0800 I - [conn39] end connection 127.0.0.1:56160 (1 connection now open) 2018-01-25T14:59:46.188+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:34791 #40 (1 connection now open) 2018-01-25T14:59:46.193+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:34793 #41 (2 connections now open) 2018-01-25T14:59:46.205+0800 I NETWORK [conn40] received client metadata from 127.0.0.1:34791 conn40: { driver: { name: "nodejs", version: "2.2.33" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "3.13.0-86-generic" }, platform: "Node.js v8.9.1, LE, mongodb-core: 2.1.17" } 2018-01-25T14:59:46.208+0800 I NETWORK [conn41] received client metadata from 127.0.0.1:34793 conn41: { driver: { name: "nodejs", version: "2.2.33" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "3.13.0-86-generic" }, platform: "Node.js v8.9.1, LE, mongodb-core: 2.1.17" } 2018-01-25T14:59:46.245+0800 I ACCESS [conn40] Successfully authenticated as principal admin on admin 2018-01-25T14:59:46.246+0800 I ACCESS [conn41] Successfully authenticated as principal admin on admin 2018-01-26T08:55:58.148+0800 F JOURNAL [journal writer] exception in journalWriterThread causing immediate shutdown: boost::filesystem::current_path: No such file or directory 2018-01-26T08:55:58.148+0800 I - [journal writer] Invariant failure false src/mongo/db/storage/mmap_v1/dur_journal_writer.cpp 272 2018-01-26T08:55:58.148+0800 I - [journal writer] ***aborting after invariant() failure 2018-01-26T08:55:58.186+0800 F - [journal writer] Got signal: 6 (Aborted). 0x7f40a6c6a581 0x7f40a6c69799 0x7f40a6c69c7d 0x7f40a435c330 0x7f40a3fbdc37 0x7f40a3fc1028 0x7f40a5f0de78 0x7f40a68e49d9 0x7f40a76e1bb0 0x7f40a4354184 0x7f40a408137d ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"7F40A56F2000","o":"1578581","s":"_ZN5mongo15printStackTraceERSo"},{"b":"7F40A56F2000","o":"1577799"},{"b":"7F40A56F2000","o":"1577C7D"},{"b":"7F40A434C000","o":"10330"},{"b":"7F40A3F87000","o":"36C37","s":"gsignal"},{"b":"7F40A3F87000","o":"3A028","s":"abort"},{"b":"7F40A56F2000","o":"81BE78","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"7F40A56F2000","o":"11F29D9","s":"_ZN5mongo3dur13JournalWriter20_journalWriterThreadEv"},{"b":"7F40A56F2000","o":"1FEFBB0"},{"b":"7F40A434C000","o":"8184"},{"b":"7F40A3F87000","o":"FA37D","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.10", "gitVersion" : "078f28920cb24de0dd479b5ea6c66c644f6326e9", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.13.0-86-generic", "version" : "#131-Ubuntu SMP Thu May 12 23:33:13 UTC 2016", "machine" : "x86_64" }, "somap" : [ { "b" : "7F40A56F2000", "elfType" : 3, "buildId" : "D21A02CF9C7297563D25465FBECF02F5CA47FBAD" }, { "b" : "7FFEB3880000", "elfType" : 3, "buildId" : "FB51781B01C799D4B6F6FED07F9862B3B24B375F" }, { "b" : "7F40A526E000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "15A6A69B862FAC0AA589921DB1B0DF8A673FEC81" }, { "b" : "7F40A4E92000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "607C4A6F3428B6F065D55691AFDC4E343786A8A5" }, { "b" : "7F40A4C8A000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "E2A6DD5048A0A051FD61043BDB69D8CC68192AB7" }, { "b" : "7F40A4A86000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "DA9B8C234D0FE9FD8CAAC8970A7EC1B6C8F6623F" }, { "b" : "7F40A4780000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "D144258E614900B255A31F3FD2283A878670D5BC" }, { "b" : "7F40A456A000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "36311B4457710AE5578C4BF00791DED7359DBB92" }, { "b" : "7F40A434C000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "31E9F21AE8C10396171F1E13DA15780986FA696C" }, { "b" : "7F40A3F87000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "CF699A15CAAE64F50311FC4655B86DC39A479789" }, { "b" : "7F40A54CD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "D0F537904076D73F29E4A37341F8A449E2EF6CD0" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x7f40a6c6a581] mongod(+0x1577799) [0x7f40a6c69799] mongod(+0x1577C7D) [0x7f40a6c69c7d] libpthread.so.0(+0x10330) [0x7f40a435c330] libc.so.6(gsignal+0x37) [0x7f40a3fbdc37] libc.so.6(abort+0x148) [0x7f40a3fc1028] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0x0) [0x7f40a5f0de78] mongod(_ZN5mongo3dur13JournalWriter20_journalWriterThreadEv+0x1009) [0x7f40a68e49d9] mongod(+0x1FEFBB0) [0x7f40a76e1bb0] libpthread.so.0(+0x8184) [0x7f40a4354184] libc.so.6(clone+0x6D) [0x7f40a408137d] ----- END BACKTRACE ----- 2018-01-26T10:23:11.354+0800 I CONTROL [main] ***** SERVER RESTARTED ***** 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] MongoDB starting : pid=21041 port=27017 dbpath=/var/lib/mongodb 64-bit host=prod-app-186 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] db version v3.4.10 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] git version: 078f28920cb24de0dd479b5ea6c66c644f6326e9 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] allocator: tcmalloc 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] modules: none 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] build environment: 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] distmod: ubuntu1404 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] distarch: x86_64 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] target_arch: x86_64 2018-01-26T10:23:11.360+0800 I CONTROL [initandlisten] options: { config: "/etc/mongodb.conf", net: { bindIp: "127.0.0.1", port: 27017 }, security: { authorization: "enabled" }, storage: { dbPath: "/var/lib/mongodb", journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb.log" } } 2018-01-26T10:23:11.360+0800 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/mongod.lock is not empty. 2018-01-26T10:23:11.387+0800 I - [initandlisten] Detected data files in /var/lib/mongodb created by the 'mmapv1' storage engine, so setting the active storage engine to 'mmapv1'. 2018-01-26T10:23:11.400+0800 I JOURNAL [initandlisten] journal dir=/var/lib/mongodb/journal 2018-01-26T10:23:11.400+0800 I JOURNAL [initandlisten] recover begin 2018-01-26T10:23:11.400+0800 I JOURNAL [initandlisten] recover lsn: 1359851082 2018-01-26T10:23:11.400+0800 I JOURNAL [initandlisten] recover /var/lib/mongodb/journal/j._0 2018-01-26T10:23:11.430+0800 I JOURNAL [initandlisten] recover skipping application of section seq:121 < lsn:1359851082 2018-01-26T10:23:11.430+0800 I JOURNAL [initandlisten] recover skipping application of section seq:48782126 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section seq:50707290 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section seq:50781774 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section seq:50823922 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section seq:50894933 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section seq:50945488 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section seq:51312824 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section seq:59029023 < lsn:1359851082 2018-01-26T10:23:11.431+0800 I JOURNAL [initandlisten] recover skipping application of section more... 2018-01-26T10:23:11.435+0800 I JOURNAL [initandlisten] recover final skipped journal section had sequence number 1011539562 2018-01-26T10:23:11.435+0800 I JOURNAL [initandlisten] recover applying initial journal section with sequence number 1359851082 2018-01-26T10:23:11.453+0800 I JOURNAL [initandlisten] recover cleaning up 2018-01-26T10:23:11.453+0800 I JOURNAL [initandlisten] removeJournalFiles 2018-01-26T10:23:11.453+0800 I JOURNAL [initandlisten] old journal file will be removed: /var/lib/mongodb/journal/j._0 2018-01-26T10:23:11.583+0800 I JOURNAL [initandlisten] recover done 2018-01-26T10:23:11.583+0800 I JOURNAL [initandlisten] preallocating a journal file /var/lib/mongodb/journal/prealloc.0 2018-01-26T10:23:14.031+0800 I - [initandlisten] File Preallocator Progress: 639631360/1073741824 59% 2018-01-26T10:23:17.018+0800 I - [initandlisten] File Preallocator Progress: 775946240/1073741824 72% 2018-01-26T10:23:20.210+0800 I - [initandlisten] File Preallocator Progress: 901775360/1073741824 83% 2018-01-26T10:23:23.050+0800 I - [initandlisten] File Preallocator Progress: 1017118720/1073741824 94% 2018-01-26T10:23:27.116+0800 I - [initandlisten] File Preallocator Progress: 1027604480/1073741824 95% 2018-01-26T10:23:37.986+0800 I JOURNAL [durability] Durability thread started 2018-01-26T10:23:37.986+0800 I JOURNAL [journal writer] Journal writer thread started 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] ** WARNING: soft rlimits too low. rlimits set to 31446 processes, 65535 files. Number of processes should be at least 32767.5 : 0.5 times number of files. 2018-01-26T10:23:37.992+0800 I CONTROL [initandlisten] 2018-01-26T10:23:38.039+0800 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/diagnostic.data' 2018-01-26T10:23:38.042+0800 I NETWORK [thread1] waiting for connections on port 27017 2018-01-26T10:23:39.003+0800 I FTDC [ftdc] Unclean full-time diagnostic data capture shutdown detected, found interim file, some metrics may have been lost. OK 2018-01-26T10:25:32.831+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:57228 #1 (1 connection now open) 2018-01-26T10:25:32.843+0800 I NETWORK [conn1] received client metadata from 127.0.0.1:57228 conn1: { driver: { name: "nodejs", version: "2.2.33" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "3.13.0-86-generic" }, platform: "Node.js v8.9.1, LE, mongodb-core: 2.1.17" } 2018-01-26T10:25:32.877+0800 I ACCESS [conn1] Successfully authenticated as principal admin on admin 2018-01-26T10:25:40.311+0800 I - [conn1] end connection 127.0.0.1:57228 (1 connection now open) 2018-01-26T10:25:48.816+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:57243 #2 (1 connection now open) 2018-01-26T10:25:48.831+0800 I NETWORK [conn2] received client metadata from 127.0.0.1:57243 conn2: { driver: { name: "nodejs", version: "2.2.33" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "3.13.0-86-generic" }, platform: "Node.js v8.9.1, LE, mongodb-core: 2.1.17" } 2018-01-26T10:25:48.858+0800 I NETWORK [thread1] connection accepted from 127.0.0.1:57246 #3 (2 connections now open) 2018-01-26T10:25:48.868+0800 I ACCESS [conn2] Successfully authenticated as principal admin on admin 2018-01-26T10:25:48.873+0800 I NETWORK [conn3] received client metadata from 127.0.0.1:57246 conn3: { driver: { name: "nodejs", version: "2.2.33" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "3.13.0-86-generic" }, platform: "Node.js v8.9.1, LE, mongodb-core: 2.1.17" } 2018-01-26T10:25:48.906+0800 I ACCESS [conn3] Successfully authenticated as principal admin on admin