2016-09-19T13:07:32.133+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] MongoDB starting : pid=13719 port=27017 dbpath=/var/lib/mongodb/appbuilder 64-bit host=bidb4 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] db version v3.2.9 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e 11 Feb 2013 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] modules: none 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] build environment: 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] distmod: debian71 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] distarch: x86_64 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-09-19T13:07:32.140+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb/mongodb_appbuilder.conf", net: { bindIp: "172.16.4.5", port: 27017 }, processManagement: { fork: false }, replication: { oplogSizeMB: 4096, replSetName: "wix_appbuilder" }, security: { authorization: "disabled", sasl: { hostName: "bidb4-05.aus.wixpress.com" } }, storage: { dbPath: "/var/lib/mongodb/appbuilder", directoryPerDB: true, engine: "wiredTiger", journal: { enabled: true }, wiredTiger: { engineConfig: { cacheSizeGB: 24 } } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb_appbuilder.log", verbosity: 0 } } 2016-09-19T13:07:32.161+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=24G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-09-19T13:07:32.317+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-09-19T13:07:32.318+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 808205 records totaling to 4295038458 bytes 2016-09-19T13:07:32.318+0000 I STORAGE [initandlisten] Sampling from the oplog between Sep 19 08:43:49:49 and Sep 19 11:36:25:8c to determine where to place markers for truncation 2016-09-19T13:07:32.318+0000 I STORAGE [initandlisten] Taking 1000 samples and assuming that each section of oplog contains approximately 8082 records totaling to 42950118 bytes 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:48:57:1b 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:51:14:14 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:52:54:f 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:54:59:6e 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:56:29:4e 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:58:55:29 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:00:14:19 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:02:34:5b 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:04:35:10 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:06:16:3c2 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:08:26:29 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:10:39:4c 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:11:28:ab 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:13:37:19 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:15:17:36c 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:17:19:24 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:19:06:29 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:20:48:56f 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:22:21:41 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:24:15:d8 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:25:55:18c 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:27:43:444 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:28:46:9a 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:30:49:47 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:32:35:30 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:34:22:10 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:36:12:a6 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:38:30:d9 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:40:21:29 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:41:56:27 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:43:33:a 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:45:41:11 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:47:30:d 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:48:37:20 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:49:57:8 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:51:25:9 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:52:44:f 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:54:24:13 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:55:59:19 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:57:13:c 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:58:42:4f 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:00:10:65 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:01:42:42 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:03:08:6 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:04:38:d 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:06:21:251 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:07:59:6 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:09:58:16 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:11:31:2d 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:12:37:40a 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:14:17:12 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:16:46:4 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:18:56:a 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:25:c 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:21:20:d 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:23:31:9d 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:25:01:57 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:27:21:124 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:28:00:5 2016-09-19T13:07:32.390+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:29:48:16 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:31:20:24 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:34:07:4 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:35:47:12 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:37:05:10 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:38:45:8c 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:40:30:8 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:42:15:75 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:44:07:9 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:45:04:32 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:47:19:18 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:48:54:2 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:50:31:1a 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:52:04:ee 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:53:45:d 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:55:07:60 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:57:10:118 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:58:57:11 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:01:14:26 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:02:50:32 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:05:12:3 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:06:49:296 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:08:23:d 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:09:49:25 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:11:43:151 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:13:24:14 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:15:18:1 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:16:34:1b5 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:17:51:27 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:19:19:5 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:21:13:32 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:23:03:b2 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:24:42:5e 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:25:58:65 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:27:52:13 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:29:09:1c 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:30:39:371 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:32:05:7 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:33:40:55 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:34:50:25 2016-09-19T13:07:32.391+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:36:24:33 2016-09-19T13:07:32.427+0000 I CONTROL [initandlisten] 2016-09-19T13:07:32.427+0000 I CONTROL [initandlisten] ** WARNING: You are running on a NUMA machine. 2016-09-19T13:07:32.427+0000 I CONTROL [initandlisten] ** We suggest launching mongod like this to avoid performance problems: 2016-09-19T13:07:32.427+0000 I CONTROL [initandlisten] ** numactl --interleave=all mongod [other options] 2016-09-19T13:07:32.427+0000 I CONTROL [initandlisten] 2016-09-19T13:07:32.435+0000 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-09-19T13:07:32.436+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-09-19T13:07:32.436+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/appbuilder/diagnostic.data' 2016-09-19T13:07:32.436+0000 I NETWORK [initandlisten] waiting for connections on port 27017 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48078 #1 (1 connection now open) 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48079 #2 (2 connections now open) 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48080 #3 (3 connections now open) 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48081 #4 (4 connections now open) 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48082 #5 (5 connections now open) 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48083 #6 (6 connections now open) 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48084 #7 (7 connections now open) 2016-09-19T13:07:32.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48085 #8 (8 connections now open) 2016-09-19T13:07:32.447+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48086 #9 (9 connections now open) 2016-09-19T13:07:32.447+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48087 #10 (10 connections now open) 2016-09-19T13:07:32.447+0000 I NETWORK [conn1] end connection 172.16.210.48:48078 (9 connections now open) 2016-09-19T13:07:32.457+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.153:62678 #11 (10 connections now open) 2016-09-19T13:07:32.496+0000 I NETWORK [initandlisten] connection accepted from 10.14.8.10:63999 #12 (11 connections now open) 2016-09-19T13:07:32.503+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45019 #13 (12 connections now open) 2016-09-19T13:07:32.508+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48089 #14 (13 connections now open) 2016-09-19T13:07:32.508+0000 I NETWORK [conn14] end connection 172.16.210.48:48089 (12 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41101 #15 (13 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41100 #16 (14 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41102 #17 (15 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41103 #18 (16 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41108 #19 (17 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41104 #20 (18 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41107 #21 (19 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41109 #22 (20 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41105 #23 (21 connections now open) 2016-09-19T13:07:32.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:41106 #24 (22 connections now open) 2016-09-19T13:07:32.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40435 #25 (23 connections now open) 2016-09-19T13:07:32.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40436 #26 (24 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40437 #27 (25 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40438 #28 (26 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40439 #29 (27 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40440 #30 (28 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40442 #31 (29 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40443 #32 (30 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40441 #33 (31 connections now open) 2016-09-19T13:07:32.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40444 #34 (32 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35046 #35 (33 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35047 #36 (34 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35048 #37 (35 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35049 #38 (36 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35050 #39 (37 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35052 #40 (38 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35051 #41 (39 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35053 #42 (40 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35054 #43 (41 connections now open) 2016-09-19T13:07:32.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:35055 #44 (42 connections now open) 2016-09-19T13:07:32.927+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "wix_appbuilder", version: 278987, members: [ { _id: 17, host: "172.16.210.105:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "dedb07-05.aus.wixpress.com", use: "delayed", version: "mongo3" }, slaveDelay: 21600, votes: 0 }, { _id: 18, host: "10.14.8.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo8-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 19, host: "172.16.203.1:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "bs3-appbuilder.aus.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 9, host: "10.15.2.19:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vac.aws.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 8, host: "10.14.9.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 10.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo9-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 7, host: "10.15.4.19:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vae.aws.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 }, { _id: 20, host: "172.16.4.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 20.0, tags: { host: "bidb4-05.aus.wixpress.com", dc: "aus", engine: "wiredTiger", use: "bi", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 21, host: "172.16.28.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 50.0, tags: { dc: "aus", engine: "wiredTiger", host: "db28-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 22, host: "172.16.24.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 80.0, tags: { dc: "aus", engine: "wiredTiger", host: "db24-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 23, host: "10.12.103.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "ams", host: "db3-05.ams.wixpress.com", use: "dev_read_only", engine: "wiredTiger", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-09-19T13:07:32.927+0000 I REPL [ReplicationExecutor] This node is 172.16.4.5:27017 in the config 2016-09-19T13:07:32.927+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-09-19T13:07:32.927+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-09-19T13:07:32.927+0000 I COMMAND [conn13] command admin.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 423ms 2016-09-19T13:07:32.927+0000 I COMMAND [conn2] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 466ms 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.210.105:27017 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.8.15:27017 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.203.1:27017 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.2.19:27017 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.9.15:27017 2016-09-19T13:07:32.927+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.4.19:27017 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.28.5:27017 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.24.5:27017 2016-09-19T13:07:32.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.12.103.15:27017 2016-09-19T13:07:32.928+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48091 #45 (43 connections now open) 2016-09-19T13:07:32.928+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.210.105:27017 2016-09-19T13:07:32.928+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.203.1:27017 2016-09-19T13:07:32.928+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-09-19T13:07:32.928+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:07:32.928+0000 I NETWORK [conn45] end connection 172.16.210.48:48091 (42 connections now open) 2016-09-19T13:07:32.928+0000 I REPL [ReplicationExecutor] Member 172.16.24.5:27017 is now in state PRIMARY 2016-09-19T13:07:32.928+0000 I REPL [ReplicationExecutor] Member 172.16.203.1:27017 is now in state SECONDARY 2016-09-19T13:07:32.928+0000 I REPL [ReplicationExecutor] Member 172.16.210.105:27017 is now in state RECOVERING 2016-09-19T13:07:32.929+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:48092 #46 (43 connections now open) 2016-09-19T13:07:32.935+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.28.5:27017 2016-09-19T13:07:32.935+0000 I REPL [ReplicationExecutor] Member 172.16.28.5:27017 is now in state SECONDARY 2016-09-19T13:07:32.989+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.4.19:27017 2016-09-19T13:07:32.989+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.2.19:27017 2016-09-19T13:07:32.996+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.9.15:27017 2016-09-19T13:07:32.997+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.8.15:27017 2016-09-19T13:07:33.019+0000 I REPL [ReplicationExecutor] Member 10.15.4.19:27017 is now in state SECONDARY 2016-09-19T13:07:33.020+0000 I REPL [ReplicationExecutor] Member 10.15.2.19:27017 is now in state SECONDARY 2016-09-19T13:07:33.031+0000 I REPL [ReplicationExecutor] Member 10.14.9.15:27017 is now in state SECONDARY 2016-09-19T13:07:33.032+0000 I REPL [ReplicationExecutor] Member 10.14.8.15:27017 is now in state SECONDARY 2016-09-19T13:07:33.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43583 #47 (44 connections now open) 2016-09-19T13:07:33.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43582 #48 (45 connections now open) 2016-09-19T13:07:33.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43589 #49 (46 connections now open) 2016-09-19T13:07:33.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43584 #50 (47 connections now open) 2016-09-19T13:07:33.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43590 #51 (48 connections now open) 2016-09-19T13:07:33.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43587 #52 (49 connections now open) 2016-09-19T13:07:33.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43591 #53 (50 connections now open) 2016-09-19T13:07:33.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43588 #54 (51 connections now open) 2016-09-19T13:07:33.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43585 #55 (52 connections now open) 2016-09-19T13:07:33.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43586 #56 (53 connections now open) 2016-09-19T13:07:33.085+0000 I NETWORK [initandlisten] connection accepted from 10.15.4.18:54491 #57 (54 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48699 #58 (55 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48700 #59 (56 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48702 #60 (57 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48704 #61 (58 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48701 #62 (59 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48707 #63 (60 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48703 #64 (61 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48705 #65 (62 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48706 #66 (63 connections now open) 2016-09-19T13:07:33.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:48708 #67 (64 connections now open) 2016-09-19T13:07:33.154+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.12.103.15:27017 2016-09-19T13:07:33.181+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.84:64701 #68 (65 connections now open) 2016-09-19T13:07:33.267+0000 I REPL [ReplicationExecutor] Member 10.12.103.15:27017 is now in state STARTUP2 2016-09-19T13:07:33.475+0000 I NETWORK [initandlisten] connection accepted from 10.15.2.18:49299 #69 (66 connections now open) 2016-09-19T13:07:33.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45084 #70 (67 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45085 #71 (68 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45086 #72 (69 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45088 #73 (70 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45087 #74 (71 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45089 #75 (72 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45091 #76 (73 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45090 #77 (74 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45092 #78 (75 connections now open) 2016-09-19T13:07:33.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:45093 #79 (76 connections now open) 2016-09-19T13:07:33.572+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52593 #80 (77 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52594 #81 (78 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52596 #82 (79 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52599 #83 (80 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52595 #84 (81 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52598 #85 (82 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52597 #86 (83 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52602 #87 (84 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52601 #88 (85 connections now open) 2016-09-19T13:07:33.573+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52600 #89 (86 connections now open) 2016-09-19T13:07:33.675+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:50281 #90 (87 connections now open) 2016-09-19T13:07:33.846+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:50282 #91 (88 connections now open) 2016-09-19T13:07:33.846+0000 I NETWORK [conn91] end connection 172.16.210.100:50282 (87 connections now open) 2016-09-19T13:07:33.948+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44510 #92 (88 connections now open) 2016-09-19T13:07:33.948+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44511 #93 (89 connections now open) 2016-09-19T13:07:33.948+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44513 #94 (90 connections now open) 2016-09-19T13:07:33.948+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44517 #95 (91 connections now open) 2016-09-19T13:07:33.948+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44512 #96 (92 connections now open) 2016-09-19T13:07:33.948+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44516 #97 (93 connections now open) 2016-09-19T13:07:33.948+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44515 #98 (94 connections now open) 2016-09-19T13:07:33.949+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44519 #99 (95 connections now open) 2016-09-19T13:07:33.949+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44514 #100 (96 connections now open) 2016-09-19T13:07:33.949+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:44518 #101 (97 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55806 #102 (98 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55807 #103 (99 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55808 #104 (100 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55812 #105 (101 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55811 #106 (102 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55815 #107 (103 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55810 #108 (104 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55814 #109 (105 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55809 #110 (106 connections now open) 2016-09-19T13:07:33.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:55813 #111 (107 connections now open) 2016-09-19T13:07:34.001+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.164:46682 #112 (108 connections now open) 2016-09-19T13:07:34.017+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:52605 #113 (109 connections now open) 2016-09-19T13:07:34.150+0000 I NETWORK [initandlisten] connection accepted from 10.14.9.10:48508 #114 (110 connections now open) 2016-09-19T13:07:34.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57583 #115 (111 connections now open) 2016-09-19T13:07:34.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57580 #116 (112 connections now open) 2016-09-19T13:07:34.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57582 #117 (113 connections now open) 2016-09-19T13:07:34.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57585 #118 (114 connections now open) 2016-09-19T13:07:34.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57586 #119 (115 connections now open) 2016-09-19T13:07:34.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57588 #120 (116 connections now open) 2016-09-19T13:07:34.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57581 #121 (117 connections now open) 2016-09-19T13:07:34.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57579 #122 (118 connections now open) 2016-09-19T13:07:34.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57584 #123 (119 connections now open) 2016-09-19T13:07:34.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57587 #124 (120 connections now open) 2016-09-19T13:07:34.295+0000 I NETWORK [initandlisten] connection accepted from 10.12.103.1:51290 #125 (121 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45375 #126 (122 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45372 #127 (123 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45368 #128 (124 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45376 #129 (125 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45370 #130 (126 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45369 #131 (127 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45373 #132 (128 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45377 #133 (129 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45374 #134 (130 connections now open) 2016-09-19T13:07:34.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45371 #135 (131 connections now open) 2016-09-19T13:07:35.039+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:43609 #136 (132 connections now open) 2016-09-19T13:07:35.753+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:57590 #137 (133 connections now open) 2016-09-19T13:07:35.815+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40451 #138 (134 connections now open) 2016-09-19T13:07:35.855+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:40452 #139 (135 connections now open) 2016-09-19T13:07:35.927+0000 I REPL [ReplicationExecutor] syncing from: 172.16.24.5:27017 2016-09-19T13:07:35.928+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to 172.16.24.5:27017 2016-09-19T13:07:35.928+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to 172.16.24.5:27017 2016-09-19T13:07:35.929+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:07:35.929+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update, response: { ok: 0.0, errmsg: "Unexpected field durableOpTime in UpdateInfoArgs", code: 2 } 2016-09-19T13:07:35.929+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback falling back to old style UpdatePosition command 2016-09-19T13:07:35.977+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:45381 #140 (136 connections now open) 2016-09-19T13:07:36.142+0000 I - [NetworkInterfaceASIO-BGSync-0] Assertion: 10334:BSONObj size: 17130437 (0x10563C5) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 99445122894 2016-09-19T13:07:36.154+0000 I CONTROL [NetworkInterfaceASIO-BGSync-0] 0x130c4a2 0x12a7248 0x128efe8 0x128f09c 0x973949 0xda2484 0x10abf65 0x10b75fb 0x10b929c 0x10b98a8 0x10b7040 0x108a750 0x10994ac 0x1099968 0x1329e71 0x132a091 0x132e22f 0x10aeda5 0x1b431c0 0x7f881c697b50 0x7f881c3e1fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EA7248","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"E8EFE8","s":"_ZN5mongo11msgassertedEiPKc"},{"b":"400000","o":"E8F09C"},{"b":"400000","o":"573949","s":"_ZNK5mongo7BSONObj14_assertInvalidEv"},{"b":"400000","o":"9A2484","s":"_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE"},{"b":"400000","o":"CABF65","s":"_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE"},{"b":"400000","o":"CB75FB","s":"_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE"},{"b":"400000","o":"CB929C","s":"_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE"},{"b":"400000","o":"CB98A8"},{"b":"400000","o":"CB7040"},{"b":"400000","o":"C8A750","s":"_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C994AC","s":"_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C99968","s":"_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m"},{"b":"400000","o":"F29E71","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"400000","o":"F2A091","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"400000","o":"F2E22F","s":"_ZN4asio10io_service3runEv"},{"b":"400000","o":"CAEDA5"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7F881C691000","o":"6B50"},{"b":"7F881C304000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFCBB8BF000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7F881D54A000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7F881D151000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7F881CF49000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7F881CD45000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7F881CAC3000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7F881C8AD000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7F881C691000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7F881C304000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7F881D7A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7F881C0ED000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12a7248] mongod(_ZN5mongo11msgassertedEiPKc+0x88) [0x128efe8] mongod(+0xE8F09C) [0x128f09c] mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x3B9) [0x973949] mongod(_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE+0x514) [0xda2484] mongod(_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE+0x145) [0x10abf65] mongod(_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE+0x18B) [0x10b75fb] mongod(_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE+0x5C) [0x10b929c] mongod(+0xCB98A8) [0x10b98a8] mongod(+0xCB7040) [0x10b7040] mongod(_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_+0x70) [0x108a750] mongod(_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_+0x89C) [0x10994ac] mongod(_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m+0x228) [0x1099968] mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x2F1) [0x1329e71] mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xC1) [0x132a091] mongod(_ZN4asio10io_service3runEv+0x2F) [0x132e22f] mongod(+0xCAEDA5) [0x10aeda5] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7f881c697b50] libc.so.6(clone+0x6D) [0x7f881c3e1fbd] ----- END BACKTRACE ----- 2016-09-19T13:07:36.154+0000 F ASIO [NetworkInterfaceASIO-BGSync-0] Uncaught exception in NetworkInterfaceASIO IO worker thread of type: Location10334: BSONObj size: 17130437 (0x10563C5) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 99445122894 2016-09-19T13:07:36.154+0000 I - [NetworkInterfaceASIO-BGSync-0] Fatal Assertion 28820 2016-09-19T13:07:36.154+0000 I - [NetworkInterfaceASIO-BGSync-0] ***aborting after fassert() failure 2016-09-19T13:07:36.158+0000 F - [NetworkInterfaceASIO-BGSync-0] Got signal: 6 (Aborted). 0x130c4a2 0x130b3c9 0x130bbd2 0x7f881c6a00a0 0x7f881c336125 0x7f881c3393a0 0x128e902 0x10aef93 0x1b431c0 0x7f881c697b50 0x7f881c3e1fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F0B3C9"},{"b":"400000","o":"F0BBD2"},{"b":"7F881C691000","o":"F0A0"},{"b":"7F881C304000","o":"32125","s":"gsignal"},{"b":"7F881C304000","o":"353A0","s":"abort"},{"b":"400000","o":"E8E902","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAEF93"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7F881C691000","o":"6B50"},{"b":"7F881C304000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFCBB8BF000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7F881D54A000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7F881D151000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7F881CF49000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7F881CD45000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7F881CAC3000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7F881C8AD000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7F881C691000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7F881C304000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7F881D7A9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7F881C0ED000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(+0xF0B3C9) [0x130b3c9] mongod(+0xF0BBD2) [0x130bbd2] libpthread.so.0(+0xF0A0) [0x7f881c6a00a0] libc.so.6(gsignal+0x35) [0x7f881c336125] libc.so.6(abort+0x180) [0x7f881c3393a0] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x128e902] mongod(+0xCAEF93) [0x10aef93] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7f881c697b50] libc.so.6(clone+0x6D) [0x7f881c3e1fbd] ----- END BACKTRACE ----- 2016-09-19T13:09:48.741+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] MongoDB starting : pid=16513 port=27017 dbpath=/var/lib/mongodb/appbuilder 64-bit host=bidb4 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] db version v3.2.9 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e 11 Feb 2013 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] modules: none 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] build environment: 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] distmod: debian71 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] distarch: x86_64 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-09-19T13:09:48.748+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb/mongodb_appbuilder.conf", net: { bindIp: "172.16.4.5", port: 27017 }, processManagement: { fork: false }, replication: { oplogSizeMB: 4096, replSetName: "wix_appbuilder" }, security: { authorization: "disabled", sasl: { hostName: "bidb4-05.aus.wixpress.com" } }, storage: { dbPath: "/var/lib/mongodb/appbuilder", directoryPerDB: true, engine: "wiredTiger", journal: { enabled: true }, wiredTiger: { engineConfig: { cacheSizeGB: 24 } } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb_appbuilder.log", verbosity: 0 } } 2016-09-19T13:09:48.769+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/appbuilder/mongod.lock is not empty. 2016-09-19T13:09:48.769+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-09-19T13:09:48.769+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=24G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-09-19T13:09:48.953+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-09-19T13:09:48.953+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 808205 records totaling to 4295038458 bytes 2016-09-19T13:09:48.953+0000 I STORAGE [initandlisten] Sampling from the oplog between Sep 19 08:43:49:49 and Sep 19 11:36:30:3 to determine where to place markers for truncation 2016-09-19T13:09:48.953+0000 I STORAGE [initandlisten] Taking 1000 samples and assuming that each section of oplog contains approximately 8082 records totaling to 42950118 bytes 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:49:02:1df 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:50:58:1e 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:53:00:12b 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:54:44:26 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:56:33:49 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 08:58:37:2e 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:00:22:2e 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:02:10:70 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:04:43:18a 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:06:04:b 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:08:36:1a 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:10:18:3 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:11:32:4 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:13:17:99 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:15:21:1 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:16:50:25 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:19:13:6 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:20:43:d 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:22:25:2 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:24:02:40 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:25:57:2 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:27:36:13 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:28:51:5f 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:30:32:1 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:32:41:1a 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:34:05:32 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:36:22:52 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:38:10:53 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:40:35:12 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:41:44:37 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:43:39:60 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:45:29:114 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:47:45:7e 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:48:45:19 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:50:58:5 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:52:19:12 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:54:36:10 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:56:18:304 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:58:02:8 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:59:53:6 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:01:51:52 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:03:21:12 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:05:22:39 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:06:35:6 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:08:45:64 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:10:22:1 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:12:03:6 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:12:49:4a 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:15:08:22 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:17:18:1 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:19:37:8d 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:35:1b 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:22:04:17 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:23:50:e 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:25:06:c 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:27:02:8 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:27:53:4 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:28:53:198 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:30:05:210 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:31:27:12 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:33:27:13 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:35:21:6 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:36:11:d0 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:37:24:3 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:38:48:1bf 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:40:14:b 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:42:24:1a 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:43:52:8 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:45:13:b 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:46:59:42 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:48:57:15 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:50:14:4 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:52:05:23 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:53:27:273 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:55:12:15d 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:56:52:49 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:59:02:1 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:01:02:4 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:02:53:5f 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:04:49:1d 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:06:49:41c 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:08:07:277 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:09:54:10 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:11:31:2 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:13:28:d 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:14:59:54 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:16:36:17 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:17:41:16f 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:19:25:3c 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:20:49:16d 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:23:09:c6 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:24:30:20 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:26:04:4 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:27:33:78 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:29:14:17 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:30:21:74 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:32:08:77 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:33:31:57 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:34:56:1c 2016-09-19T13:09:49.032+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:36:12:156 2016-09-19T13:09:49.069+0000 I CONTROL [initandlisten] 2016-09-19T13:09:49.069+0000 I CONTROL [initandlisten] ** WARNING: You are running on a NUMA machine. 2016-09-19T13:09:49.069+0000 I CONTROL [initandlisten] ** We suggest launching mongod like this to avoid performance problems: 2016-09-19T13:09:49.069+0000 I CONTROL [initandlisten] ** numactl --interleave=all mongod [other options] 2016-09-19T13:09:49.069+0000 I CONTROL [initandlisten] 2016-09-19T13:09:49.077+0000 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-09-19T13:09:49.077+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-09-19T13:09:49.077+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/appbuilder/diagnostic.data' 2016-09-19T13:09:49.077+0000 I NETWORK [initandlisten] waiting for connections on port 27017 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57124 #1 (1 connection now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57126 #2 (2 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57125 #3 (3 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57127 #4 (4 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57130 #5 (5 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57128 #6 (6 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57132 #7 (7 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57131 #8 (8 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57129 #9 (9 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57133 #10 (10 connections now open) 2016-09-19T13:09:49.137+0000 I NETWORK [initandlisten] connection accepted from 10.15.4.18:54787 #11 (11 connections now open) 2016-09-19T13:09:49.244+0000 I NETWORK [initandlisten] connection accepted from 10.14.8.10:64374 #12 (12 connections now open) 2016-09-19T13:09:49.261+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.84:64955 #13 (13 connections now open) 2016-09-19T13:09:49.472+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49616 #14 (14 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51878 #15 (15 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51879 #16 (16 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51880 #17 (17 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51882 #18 (18 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51884 #19 (19 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51881 #20 (20 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51883 #21 (21 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51885 #22 (22 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51886 #23 (23 connections now open) 2016-09-19T13:09:49.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:51887 #24 (24 connections now open) 2016-09-19T13:09:49.513+0000 I NETWORK [initandlisten] connection accepted from 10.15.2.18:49598 #25 (25 connections now open) 2016-09-19T13:09:49.573+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "wix_appbuilder", version: 278987, members: [ { _id: 17, host: "172.16.210.105:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "dedb07-05.aus.wixpress.com", use: "delayed", version: "mongo3" }, slaveDelay: 21600, votes: 0 }, { _id: 18, host: "10.14.8.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo8-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 19, host: "172.16.203.1:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "bs3-appbuilder.aus.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 9, host: "10.15.2.19:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vac.aws.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 8, host: "10.14.9.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 10.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo9-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 7, host: "10.15.4.19:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vae.aws.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 }, { _id: 20, host: "172.16.4.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 20.0, tags: { host: "bidb4-05.aus.wixpress.com", dc: "aus", engine: "wiredTiger", use: "bi", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 21, host: "172.16.28.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 50.0, tags: { dc: "aus", engine: "wiredTiger", host: "db28-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 22, host: "172.16.24.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 80.0, tags: { dc: "aus", engine: "wiredTiger", host: "db24-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 23, host: "10.12.103.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "ams", host: "db3-05.ams.wixpress.com", use: "dev_read_only", engine: "wiredTiger", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-09-19T13:09:49.573+0000 I REPL [ReplicationExecutor] This node is 172.16.4.5:27017 in the config 2016-09-19T13:09:49.573+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-09-19T13:09:49.573+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-09-19T13:09:49.573+0000 I COMMAND [conn1] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 435ms 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.210.105:27017 2016-09-19T13:09:49.573+0000 I COMMAND [conn6] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 435ms 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.8.15:27017 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.2.19:27017 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.9.15:27017 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.4.19:27017 2016-09-19T13:09:49.573+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.203.1:27017 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.28.5:27017 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.24.5:27017 2016-09-19T13:09:49.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.12.103.15:27017 2016-09-19T13:09:49.574+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:09:49.574+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.28.5:27017 2016-09-19T13:09:49.574+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-09-19T13:09:49.574+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.210.105:27017 2016-09-19T13:09:49.574+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.203.1:27017 2016-09-19T13:09:49.574+0000 I REPL [ReplicationExecutor] Member 172.16.24.5:27017 is now in state PRIMARY 2016-09-19T13:09:49.574+0000 I REPL [ReplicationExecutor] Member 172.16.28.5:27017 is now in state SECONDARY 2016-09-19T13:09:49.574+0000 I REPL [ReplicationExecutor] Member 172.16.203.1:27017 is now in state SECONDARY 2016-09-19T13:09:49.574+0000 I REPL [ReplicationExecutor] Member 172.16.210.105:27017 is now in state RECOVERING 2016-09-19T13:09:49.634+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.4.19:27017 2016-09-19T13:09:49.636+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53840 #26 (26 connections now open) 2016-09-19T13:09:49.637+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.2.19:27017 2016-09-19T13:09:49.642+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.8.15:27017 2016-09-19T13:09:49.643+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.9.15:27017 2016-09-19T13:09:49.665+0000 I REPL [ReplicationExecutor] Member 10.15.4.19:27017 is now in state SECONDARY 2016-09-19T13:09:49.668+0000 I REPL [ReplicationExecutor] Member 10.15.2.19:27017 is now in state SECONDARY 2016-09-19T13:09:49.676+0000 I REPL [ReplicationExecutor] Member 10.14.8.15:27017 is now in state SECONDARY 2016-09-19T13:09:49.678+0000 I REPL [ReplicationExecutor] Member 10.14.9.15:27017 is now in state SECONDARY 2016-09-19T13:09:49.706+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53847 #27 (27 connections now open) 2016-09-19T13:09:49.706+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53849 #28 (28 connections now open) 2016-09-19T13:09:49.706+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53844 #29 (29 connections now open) 2016-09-19T13:09:49.706+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53846 #30 (30 connections now open) 2016-09-19T13:09:49.706+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53848 #31 (31 connections now open) 2016-09-19T13:09:49.707+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53842 #32 (32 connections now open) 2016-09-19T13:09:49.707+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53841 #33 (33 connections now open) 2016-09-19T13:09:49.707+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53845 #34 (34 connections now open) 2016-09-19T13:09:49.707+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53843 #35 (35 connections now open) 2016-09-19T13:09:49.800+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.12.103.15:27017 2016-09-19T13:09:49.801+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:50636 #36 (36 connections now open) 2016-09-19T13:09:49.911+0000 I NETWORK [initandlisten] connection accepted from 10.14.9.10:48864 #37 (37 connections now open) 2016-09-19T13:09:49.914+0000 I REPL [ReplicationExecutor] Member 10.12.103.15:27017 is now in state STARTUP2 2016-09-19T13:09:49.944+0000 I NETWORK [initandlisten] connection accepted from 10.12.103.1:51626 #38 (38 connections now open) 2016-09-19T13:09:49.950+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49936 #39 (39 connections now open) 2016-09-19T13:09:49.950+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49940 #40 (40 connections now open) 2016-09-19T13:09:49.950+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49938 #41 (41 connections now open) 2016-09-19T13:09:49.950+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49942 #42 (42 connections now open) 2016-09-19T13:09:49.950+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49937 #43 (43 connections now open) 2016-09-19T13:09:49.950+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49941 #44 (44 connections now open) 2016-09-19T13:09:49.951+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49945 #45 (45 connections now open) 2016-09-19T13:09:49.951+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49939 #46 (46 connections now open) 2016-09-19T13:09:49.951+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49943 #47 (47 connections now open) 2016-09-19T13:09:49.951+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:49944 #48 (48 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57593 #49 (49 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57595 #50 (50 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57597 #51 (51 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57592 #52 (52 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57594 #53 (53 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57596 #54 (54 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57598 #55 (55 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57600 #56 (56 connections now open) 2016-09-19T13:09:49.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57599 #57 (57 connections now open) 2016-09-19T13:09:49.979+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57601 #58 (58 connections now open) 2016-09-19T13:09:50.104+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.164:47096 #59 (59 connections now open) 2016-09-19T13:09:50.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58745 #60 (60 connections now open) 2016-09-19T13:09:50.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58746 #61 (61 connections now open) 2016-09-19T13:09:50.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58743 #62 (62 connections now open) 2016-09-19T13:09:50.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58744 #63 (63 connections now open) 2016-09-19T13:09:50.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58747 #64 (64 connections now open) 2016-09-19T13:09:50.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58741 #65 (65 connections now open) 2016-09-19T13:09:50.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58748 #66 (66 connections now open) 2016-09-19T13:09:50.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58742 #67 (67 connections now open) 2016-09-19T13:09:50.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58749 #68 (68 connections now open) 2016-09-19T13:09:50.157+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58750 #69 (69 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47607 #70 (70 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47604 #71 (71 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47610 #72 (72 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47605 #73 (73 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47606 #74 (74 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47609 #75 (75 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47612 #76 (76 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47611 #77 (77 connections now open) 2016-09-19T13:09:50.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47608 #78 (78 connections now open) 2016-09-19T13:09:50.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47613 #79 (79 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49620 #80 (80 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49621 #81 (81 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49622 #82 (82 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49623 #83 (83 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49624 #84 (84 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49625 #85 (85 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49626 #86 (86 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49627 #87 (87 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49629 #88 (88 connections now open) 2016-09-19T13:09:50.448+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49628 #89 (89 connections now open) 2016-09-19T13:09:50.573+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.153:62938 #90 (90 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43019 #91 (91 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43020 #92 (92 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43022 #93 (93 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43021 #94 (94 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43024 #95 (95 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43023 #96 (96 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43027 #97 (97 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43026 #98 (98 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43028 #99 (99 connections now open) 2016-09-19T13:09:50.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43025 #100 (100 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42133 #101 (101 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42134 #102 (102 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42135 #103 (103 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42136 #104 (104 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42138 #105 (105 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42137 #106 (106 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42141 #107 (107 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42139 #108 (108 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42140 #109 (109 connections now open) 2016-09-19T13:09:50.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42142 #110 (110 connections now open) 2016-09-19T13:09:50.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37159 #111 (111 connections now open) 2016-09-19T13:09:50.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37161 #112 (112 connections now open) 2016-09-19T13:09:50.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37167 #113 (113 connections now open) 2016-09-19T13:09:50.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37163 #114 (114 connections now open) 2016-09-19T13:09:50.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37165 #115 (115 connections now open) 2016-09-19T13:09:50.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37168 #116 (116 connections now open) 2016-09-19T13:09:50.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37160 #117 (117 connections now open) 2016-09-19T13:09:50.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37162 #118 (118 connections now open) 2016-09-19T13:09:50.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37164 #119 (119 connections now open) 2016-09-19T13:09:50.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37166 #120 (120 connections now open) 2016-09-19T13:09:50.988+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.148:47661 #121 (121 connections now open) 2016-09-19T13:09:50.988+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.148:47662 #122 (122 connections now open) 2016-09-19T13:09:50.988+0000 I NETWORK [conn121] end connection 172.16.210.148:47661 (121 connections now open) 2016-09-19T13:09:50.990+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.148:47663 #123 (122 connections now open) 2016-09-19T13:09:50.992+0000 I NETWORK [conn123] end connection 172.16.210.148:47663 (121 connections now open) 2016-09-19T13:09:50.992+0000 I NETWORK [conn122] end connection 172.16.210.148:47662 (121 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44773 #124 (121 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44779 #125 (122 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44775 #126 (123 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44774 #127 (124 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44776 #128 (125 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44782 #129 (126 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44777 #130 (127 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44778 #131 (128 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44780 #132 (129 connections now open) 2016-09-19T13:09:51.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44781 #133 (130 connections now open) 2016-09-19T13:09:51.818+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43035 #134 (131 connections now open) 2016-09-19T13:09:51.862+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43036 #135 (132 connections now open) 2016-09-19T13:09:51.864+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43037 #136 (133 connections now open) 2016-09-19T13:09:51.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:43038 #137 (134 connections now open) 2016-09-19T13:09:52.267+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57367 #138 (135 connections now open) 2016-09-19T13:09:52.573+0000 I REPL [ReplicationExecutor] syncing from: 172.16.24.5:27017 2016-09-19T13:09:52.574+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to 172.16.24.5:27017 2016-09-19T13:09:52.574+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to 172.16.24.5:27017 2016-09-19T13:09:52.575+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:09:52.575+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update, response: { ok: 0.0, errmsg: "Unexpected field durableOpTime in UpdateInfoArgs", code: 2 } 2016-09-19T13:09:52.575+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback falling back to old style UpdatePosition command 2016-09-19T13:09:52.762+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57409 #139 (136 connections now open) 2016-09-19T13:09:52.934+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:52043 #140 (137 connections now open) 2016-09-19T13:09:52.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:52044 #141 (138 connections now open) 2016-09-19T13:09:54.655+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:53851 #142 (139 connections now open) 2016-09-19T13:09:55.673+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:44791 #143 (140 connections now open) 2016-09-19T13:09:56.117+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:57630 #144 (141 connections now open) 2016-09-19T13:09:56.323+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42171 #145 (142 connections now open) 2016-09-19T13:09:56.374+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42172 #146 (143 connections now open) 2016-09-19T13:09:56.387+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:58779 #147 (144 connections now open) 2016-09-19T13:09:56.614+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47681 #148 (145 connections now open) 2016-09-19T13:09:56.735+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:50116 #149 (146 connections now open) 2016-09-19T13:09:56.890+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:50121 #150 (147 connections now open) 2016-09-19T13:09:57.965+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:42179 #151 (148 connections now open) 2016-09-19T13:09:58.066+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:37222 #152 (149 connections now open) 2016-09-19T13:09:58.303+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57654 #153 (150 connections now open) 2016-09-19T13:09:58.404+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57658 #154 (151 connections now open) 2016-09-19T13:09:58.411+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:57659 #155 (152 connections now open) 2016-09-19T13:09:59.716+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49662 #156 (153 connections now open) 2016-09-19T13:09:59.925+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49664 #157 (154 connections now open) 2016-09-19T13:10:01.526+0000 I - [NetworkInterfaceASIO-BGSync-0] Assertion: 10334:BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 100088838512 2016-09-19T13:10:01.537+0000 I CONTROL [NetworkInterfaceASIO-BGSync-0] 0x130c4a2 0x12a7248 0x128efe8 0x128f09c 0x973949 0xda2484 0x10abf65 0x10b75fb 0x10b929c 0x10b98a8 0x10b7040 0x108a750 0x10994ac 0x1099968 0x1329e71 0x132a091 0x132e22f 0x10aeda5 0x1b431c0 0x7eff500c3b50 0x7eff4fe0dfbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EA7248","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"E8EFE8","s":"_ZN5mongo11msgassertedEiPKc"},{"b":"400000","o":"E8F09C"},{"b":"400000","o":"573949","s":"_ZNK5mongo7BSONObj14_assertInvalidEv"},{"b":"400000","o":"9A2484","s":"_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE"},{"b":"400000","o":"CABF65","s":"_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE"},{"b":"400000","o":"CB75FB","s":"_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE"},{"b":"400000","o":"CB929C","s":"_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE"},{"b":"400000","o":"CB98A8"},{"b":"400000","o":"CB7040"},{"b":"400000","o":"C8A750","s":"_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C994AC","s":"_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C99968","s":"_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m"},{"b":"400000","o":"F29E71","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"400000","o":"F2A091","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"400000","o":"F2E22F","s":"_ZN4asio10io_service3runEv"},{"b":"400000","o":"CAEDA5"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7EFF500BD000","o":"6B50"},{"b":"7EFF4FD30000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFE58A74000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7EFF50F76000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7EFF50B7D000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7EFF50975000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7EFF50771000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7EFF504EF000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7EFF502D9000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7EFF500BD000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7EFF4FD30000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7EFF511D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7EFF4FB19000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12a7248] mongod(_ZN5mongo11msgassertedEiPKc+0x88) [0x128efe8] mongod(+0xE8F09C) [0x128f09c] mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x3B9) [0x973949] mongod(_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE+0x514) [0xda2484] mongod(_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE+0x145) [0x10abf65] mongod(_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE+0x18B) [0x10b75fb] mongod(_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE+0x5C) [0x10b929c] mongod(+0xCB98A8) [0x10b98a8] mongod(+0xCB7040) [0x10b7040] mongod(_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_+0x70) [0x108a750] mongod(_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_+0x89C) [0x10994ac] mongod(_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m+0x228) [0x1099968] mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x2F1) [0x1329e71] mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xC1) [0x132a091] mongod(_ZN4asio10io_service3runEv+0x2F) [0x132e22f] mongod(+0xCAEDA5) [0x10aeda5] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7eff500c3b50] libc.so.6(clone+0x6D) [0x7eff4fe0dfbd] ----- END BACKTRACE ----- 2016-09-19T13:10:01.537+0000 F ASIO [NetworkInterfaceASIO-BGSync-0] Uncaught exception in NetworkInterfaceASIO IO worker thread of type: Location10334: BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 100088838512 2016-09-19T13:10:01.537+0000 I - [NetworkInterfaceASIO-BGSync-0] Fatal Assertion 28820 2016-09-19T13:10:01.537+0000 I - [NetworkInterfaceASIO-BGSync-0] ***aborting after fassert() failure 2016-09-19T13:10:01.541+0000 F - [NetworkInterfaceASIO-BGSync-0] Got signal: 6 (Aborted). 0x130c4a2 0x130b3c9 0x130bbd2 0x7eff500cc0a0 0x7eff4fd62125 0x7eff4fd653a0 0x128e902 0x10aef93 0x1b431c0 0x7eff500c3b50 0x7eff4fe0dfbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F0B3C9"},{"b":"400000","o":"F0BBD2"},{"b":"7EFF500BD000","o":"F0A0"},{"b":"7EFF4FD30000","o":"32125","s":"gsignal"},{"b":"7EFF4FD30000","o":"353A0","s":"abort"},{"b":"400000","o":"E8E902","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAEF93"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7EFF500BD000","o":"6B50"},{"b":"7EFF4FD30000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFE58A74000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7EFF50F76000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7EFF50B7D000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7EFF50975000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7EFF50771000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7EFF504EF000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7EFF502D9000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7EFF500BD000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7EFF4FD30000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7EFF511D5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7EFF4FB19000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(+0xF0B3C9) [0x130b3c9] mongod(+0xF0BBD2) [0x130bbd2] libpthread.so.0(+0xF0A0) [0x7eff500cc0a0] libc.so.6(gsignal+0x35) [0x7eff4fd62125] libc.so.6(abort+0x180) [0x7eff4fd653a0] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x128e902] mongod(+0xCAEF93) [0x10aef93] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7eff500c3b50] libc.so.6(clone+0x6D) [0x7eff4fe0dfbd] ----- END BACKTRACE ----- 2016-09-19T13:25:34.824+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] MongoDB starting : pid=23877 port=27017 dbpath=/var/lib/mongodb/appbuilder 64-bit host=bidb4 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] db version v3.2.9 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e 11 Feb 2013 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] modules: none 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] build environment: 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] distmod: debian71 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] distarch: x86_64 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-09-19T13:25:34.831+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb/mongodb_appbuilder.conf", net: { bindIp: "172.16.4.5", port: 27017 }, processManagement: { fork: false }, replication: { oplogSizeMB: 4096, replSetName: "wix_appbuilder" }, security: { authorization: "disabled", sasl: { hostName: "bidb4-05.aus.wixpress.com" } }, storage: { dbPath: "/var/lib/mongodb/appbuilder", directoryPerDB: true, engine: "wiredTiger", journal: { enabled: true }, wiredTiger: { engineConfig: { cacheSizeGB: 24 } } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb_appbuilder.log", verbosity: 0 } } 2016-09-19T13:25:34.853+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/appbuilder/mongod.lock is not empty. 2016-09-19T13:25:34.853+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-09-19T13:25:34.853+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=24G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-09-19T13:25:40.682+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-09-19T13:25:40.682+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 808205 records totaling to 4295038458 bytes 2016-09-19T13:25:40.683+0000 I STORAGE [initandlisten] Sampling from the oplog between Sep 19 09:15:21:2 and Sep 19 12:06:28:1 to determine where to place markers for truncation 2016-09-19T13:25:40.683+0000 I STORAGE [initandlisten] Taking 1000 samples and assuming that each section of oplog contains approximately 8082 records totaling to 42950118 bytes 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:16:42:2b 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:18:37:4 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:20:13:29 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:21:12:18 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:22:46:6e 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:24:15:96 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:25:44:5f 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:27:17:5 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:28:05:13f 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:29:27:119 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:31:03:c 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:32:52:10 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:34:08:21 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:35:47:26f 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:37:41:9 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:39:05:10 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:40:42:19 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:41:59:24 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:43:31:38 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:45:12:1c 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:47:01:17 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:48:29:fb 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:49:31:21 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:51:13:249 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:52:26:81 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:54:13:19 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:55:55:b 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:57:09:1c 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:58:44:59 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:00:15:2f 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:01:50:62 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:03:18:86 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:04:44:1 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:06:10:45 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:07:30:89 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:09:07:56 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:10:35:47 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:11:51:d7 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:12:37:392 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:14:03:63 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:15:58:e9 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:17:57:9 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:19:41:9 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:34:e 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:21:39:2f 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:23:19:16 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:24:40:9e 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:26:28:8 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:27:41:49 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:28:35:e 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:29:53:b 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:31:18:14 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:33:23:3 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:35:22:11 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:36:12:83 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:37:33:15 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:38:55:1f3 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:40:24:77 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:41:59:1e 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:43:27:5c 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:44:32:2e 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:45:53:13 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:47:31:2b 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:48:56:8c 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:50:05:54 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:51:54:10 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:52:48:17 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:54:15:43 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:55:29:11 2016-09-19T13:25:40.741+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:57:09:134 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:58:40:41 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:00:34:8 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:01:55:185 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:03:44:6 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:05:22:23 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:06:53:12 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:08:07:1ce 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:09:26:d 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:10:48:2d 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:12:20:6 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:13:51:4 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:15:18:f 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:16:31:ce 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:17:30:65 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:18:42:2f 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:19:59:1 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:21:33:1e 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:23:21:32 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:24:32:59 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:25:43:3b 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:27:11:20 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:28:11:f 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:29:27:147 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:30:43:30 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:32:03:84 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:33:23:9 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:34:11:47 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:35:31:26 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:37:20:46 2016-09-19T13:25:40.742+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:06:27:a 2016-09-19T13:25:40.795+0000 I CONTROL [initandlisten] 2016-09-19T13:25:40.795+0000 I CONTROL [initandlisten] ** WARNING: You are running on a NUMA machine. 2016-09-19T13:25:40.795+0000 I CONTROL [initandlisten] ** We suggest launching mongod like this to avoid performance problems: 2016-09-19T13:25:40.795+0000 I CONTROL [initandlisten] ** numactl --interleave=all mongod [other options] 2016-09-19T13:25:40.795+0000 I CONTROL [initandlisten] 2016-09-19T13:25:40.803+0000 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-09-19T13:25:40.804+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/appbuilder/diagnostic.data' 2016-09-19T13:25:40.804+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-09-19T13:25:40.804+0000 I NETWORK [initandlisten] waiting for connections on port 27017 2016-09-19T13:25:40.805+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:52772 #1 (1 connection now open) 2016-09-19T13:25:40.844+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34528 #2 (2 connections now open) 2016-09-19T13:25:40.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55282 #3 (3 connections now open) 2016-09-19T13:25:40.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55283 #4 (4 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55284 #5 (5 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55285 #6 (6 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55286 #7 (7 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55288 #8 (8 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55287 #9 (9 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55289 #10 (10 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55290 #11 (11 connections now open) 2016-09-19T13:25:40.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55291 #12 (12 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54209 #13 (13 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54210 #14 (14 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54211 #15 (15 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54212 #16 (16 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54214 #17 (17 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54213 #18 (18 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54215 #19 (19 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54216 #20 (20 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54217 #21 (21 connections now open) 2016-09-19T13:25:40.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54218 #22 (22 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51852 #23 (23 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51855 #24 (24 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51854 #25 (25 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51858 #26 (26 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51860 #27 (27 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51853 #28 (28 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51856 #29 (29 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51857 #30 (30 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51859 #31 (31 connections now open) 2016-09-19T13:25:40.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:51861 #32 (32 connections now open) 2016-09-19T13:25:40.899+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.164:50074 #33 (33 connections now open) 2016-09-19T13:25:41.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53280 #34 (34 connections now open) 2016-09-19T13:25:41.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53283 #35 (35 connections now open) 2016-09-19T13:25:41.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53282 #36 (36 connections now open) 2016-09-19T13:25:41.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53281 #37 (37 connections now open) 2016-09-19T13:25:41.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53285 #38 (38 connections now open) 2016-09-19T13:25:41.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53286 #39 (39 connections now open) 2016-09-19T13:25:41.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53288 #40 (40 connections now open) 2016-09-19T13:25:41.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53279 #41 (41 connections now open) 2016-09-19T13:25:41.067+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53287 #42 (42 connections now open) 2016-09-19T13:25:41.067+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:53284 #43 (43 connections now open) 2016-09-19T13:25:41.137+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49013 #44 (44 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49011 #45 (45 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49009 #46 (46 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49008 #47 (47 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49010 #48 (48 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49012 #49 (49 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49014 #50 (50 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49016 #51 (51 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49017 #52 (52 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49015 #53 (53 connections now open) 2016-09-19T13:25:41.138+0000 I NETWORK [conn46] end connection 172.16.144.88:49009 (52 connections now open) 2016-09-19T13:25:41.172+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49018 #54 (53 connections now open) 2016-09-19T13:25:41.172+0000 I NETWORK [conn54] end connection 172.16.144.88:49018 (52 connections now open) 2016-09-19T13:25:41.303+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "wix_appbuilder", version: 278987, members: [ { _id: 17, host: "172.16.210.105:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "dedb07-05.aus.wixpress.com", use: "delayed", version: "mongo3" }, slaveDelay: 21600, votes: 0 }, { _id: 18, host: "10.14.8.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo8-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 19, host: "172.16.203.1:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "bs3-appbuilder.aus.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 9, host: "10.15.2.19:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vac.aws.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 8, host: "10.14.9.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 10.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo9-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 7, host: "10.15.4.19:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vae.aws.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 }, { _id: 20, host: "172.16.4.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 20.0, tags: { host: "bidb4-05.aus.wixpress.com", dc: "aus", engine: "wiredTiger", use: "bi", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 21, host: "172.16.28.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 50.0, tags: { dc: "aus", engine: "wiredTiger", host: "db28-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 22, host: "172.16.24.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 80.0, tags: { dc: "aus", engine: "wiredTiger", host: "db24-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 23, host: "10.12.103.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "ams", host: "db3-05.ams.wixpress.com", use: "dev_read_only", engine: "wiredTiger", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-09-19T13:25:41.303+0000 I REPL [ReplicationExecutor] This node is 172.16.4.5:27017 in the config 2016-09-19T13:25:41.303+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-09-19T13:25:41.303+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-09-19T13:25:41.303+0000 I COMMAND [conn2] command admin.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 459ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn3] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 454ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn14] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 425ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn16] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 425ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn6] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 455ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn31] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 414ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn4] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 455ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn13] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 425ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn23] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 414ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn34] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 237ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn29] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 414ms 2016-09-19T13:25:41.303+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-09-19T13:25:41.303+0000 I COMMAND [conn48] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 162ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn24] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 414ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn41] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 236ms 2016-09-19T13:25:41.303+0000 I COMMAND [conn47] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 162ms 2016-09-19T13:25:41.303+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.210.105:27017 2016-09-19T13:25:41.303+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.8.15:27017 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.203.1:27017 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.2.19:27017 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.9.15:27017 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.4.19:27017 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.28.5:27017 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.24.5:27017 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.12.103.15:27017 2016-09-19T13:25:41.304+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49038 #55 (53 connections now open) 2016-09-19T13:25:41.304+0000 I NETWORK [conn55] end connection 172.16.144.88:49038 (52 connections now open) 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:25:41.304+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-09-19T13:25:41.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.28.5:27017 2016-09-19T13:25:41.305+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.203.1:27017 2016-09-19T13:25:41.305+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.210.105:27017 2016-09-19T13:25:41.305+0000 I REPL [ReplicationExecutor] Member 172.16.24.5:27017 is now in state PRIMARY 2016-09-19T13:25:41.305+0000 I REPL [ReplicationExecutor] Member 172.16.28.5:27017 is now in state SECONDARY 2016-09-19T13:25:41.305+0000 I REPL [ReplicationExecutor] Member 172.16.203.1:27017 is now in state SECONDARY 2016-09-19T13:25:41.305+0000 I REPL [ReplicationExecutor] Member 172.16.210.105:27017 is now in state RECOVERING 2016-09-19T13:25:41.308+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49039 #56 (53 connections now open) 2016-09-19T13:25:41.340+0000 I NETWORK [initandlisten] connection accepted from 10.15.2.18:51383 #57 (54 connections now open) 2016-09-19T13:25:41.365+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.2.19:27017 2016-09-19T13:25:41.367+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.4.19:27017 2016-09-19T13:25:41.373+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.8.15:27017 2016-09-19T13:25:41.374+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.9.15:27017 2016-09-19T13:25:41.375+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.153:64784 #58 (55 connections now open) 2016-09-19T13:25:41.396+0000 I REPL [ReplicationExecutor] Member 10.15.2.19:27017 is now in state SECONDARY 2016-09-19T13:25:41.399+0000 I REPL [ReplicationExecutor] Member 10.15.4.19:27017 is now in state SECONDARY 2016-09-19T13:25:41.399+0000 I NETWORK [initandlisten] connection accepted from 10.14.8.10:33735 #59 (56 connections now open) 2016-09-19T13:25:41.408+0000 I REPL [ReplicationExecutor] Member 10.14.8.15:27017 is now in state SECONDARY 2016-09-19T13:25:41.409+0000 I REPL [ReplicationExecutor] Member 10.14.9.15:27017 is now in state SECONDARY 2016-09-19T13:25:41.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33508 #60 (57 connections now open) 2016-09-19T13:25:41.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33509 #61 (58 connections now open) 2016-09-19T13:25:41.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33510 #62 (59 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33511 #63 (60 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33515 #64 (61 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33512 #65 (62 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33516 #66 (63 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33513 #67 (64 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33517 #68 (65 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33514 #69 (66 connections now open) 2016-09-19T13:25:41.477+0000 I NETWORK [conn67] end connection 172.16.209.164:33513 (64 connections now open) 2016-09-19T13:25:41.484+0000 I NETWORK [initandlisten] connection accepted from 10.12.103.1:54057 #70 (66 connections now open) 2016-09-19T13:25:41.495+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33519 #71 (67 connections now open) 2016-09-19T13:25:41.495+0000 I NETWORK [conn71] end connection 172.16.209.164:33519 (66 connections now open) 2016-09-19T13:25:41.501+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33520 #72 (67 connections now open) 2016-09-19T13:25:41.524+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.12.103.15:27017 2016-09-19T13:25:41.551+0000 I NETWORK [initandlisten] connection accepted from 10.14.9.10:50977 #73 (68 connections now open) 2016-09-19T13:25:41.567+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62676 #74 (69 connections now open) 2016-09-19T13:25:41.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62680 #75 (70 connections now open) 2016-09-19T13:25:41.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62679 #76 (71 connections now open) 2016-09-19T13:25:41.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62671 #77 (72 connections now open) 2016-09-19T13:25:41.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62678 #78 (73 connections now open) 2016-09-19T13:25:41.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62673 #79 (74 connections now open) 2016-09-19T13:25:41.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62677 #80 (75 connections now open) 2016-09-19T13:25:41.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62674 #81 (76 connections now open) 2016-09-19T13:25:41.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62675 #82 (77 connections now open) 2016-09-19T13:25:41.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:62672 #83 (78 connections now open) 2016-09-19T13:25:41.633+0000 I REPL [ReplicationExecutor] Member 10.12.103.15:27017 is now in state STARTUP2 2016-09-19T13:25:41.750+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37619 #84 (79 connections now open) 2016-09-19T13:25:41.777+0000 I NETWORK [initandlisten] connection accepted from 10.15.4.18:56574 #85 (80 connections now open) 2016-09-19T13:25:41.785+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49049 #86 (81 connections now open) 2016-09-19T13:25:41.803+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53586 #87 (82 connections now open) 2016-09-19T13:25:41.843+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49051 #88 (83 connections now open) 2016-09-19T13:25:41.886+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54220 #89 (84 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53589 #90 (85 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53590 #91 (86 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53594 #92 (87 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53598 #93 (88 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53591 #94 (89 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53595 #95 (90 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53592 #96 (91 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53596 #97 (92 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53593 #98 (93 connections now open) 2016-09-19T13:25:41.940+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53597 #99 (94 connections now open) 2016-09-19T13:25:41.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37620 #100 (95 connections now open) 2016-09-19T13:25:41.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37622 #101 (96 connections now open) 2016-09-19T13:25:41.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37621 #102 (97 connections now open) 2016-09-19T13:25:41.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37623 #103 (98 connections now open) 2016-09-19T13:25:41.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37626 #104 (99 connections now open) 2016-09-19T13:25:41.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37625 #105 (100 connections now open) 2016-09-19T13:25:41.981+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37627 #106 (101 connections now open) 2016-09-19T13:25:41.982+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37624 #107 (102 connections now open) 2016-09-19T13:25:41.982+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37628 #108 (103 connections now open) 2016-09-19T13:25:41.982+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37629 #109 (104 connections now open) 2016-09-19T13:25:41.982+0000 I NETWORK [conn101] end connection 172.16.209.121:37622 (103 connections now open) 2016-09-19T13:25:42.021+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60434 #110 (104 connections now open) 2016-09-19T13:25:42.030+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.84:34028 #111 (105 connections now open) 2016-09-19T13:25:42.064+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:54221 #112 (106 connections now open) 2016-09-19T13:25:42.067+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60435 #113 (107 connections now open) 2016-09-19T13:25:42.133+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37631 #114 (108 connections now open) 2016-09-19T13:25:42.154+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37632 #115 (109 connections now open) 2016-09-19T13:25:42.234+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55298 #116 (110 connections now open) 2016-09-19T13:25:42.311+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:55300 #117 (111 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63831 #118 (112 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63830 #119 (113 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63833 #120 (114 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63834 #121 (115 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63832 #122 (116 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63836 #123 (117 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63839 #124 (118 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63835 #125 (119 connections now open) 2016-09-19T13:25:42.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63837 #126 (120 connections now open) 2016-09-19T13:25:42.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63838 #127 (121 connections now open) 2016-09-19T13:25:42.436+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60436 #128 (122 connections now open) 2016-09-19T13:25:42.436+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60438 #129 (123 connections now open) 2016-09-19T13:25:42.436+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60437 #130 (124 connections now open) 2016-09-19T13:25:42.436+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60439 #131 (125 connections now open) 2016-09-19T13:25:42.437+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60440 #132 (126 connections now open) 2016-09-19T13:25:42.437+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60441 #133 (127 connections now open) 2016-09-19T13:25:42.437+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60442 #134 (128 connections now open) 2016-09-19T13:25:42.437+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60443 #135 (129 connections now open) 2016-09-19T13:25:42.437+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60444 #136 (130 connections now open) 2016-09-19T13:25:42.437+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60445 #137 (131 connections now open) 2016-09-19T13:25:42.480+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:60446 #138 (132 connections now open) 2016-09-19T13:25:42.509+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:53612 #139 (133 connections now open) 2016-09-19T13:25:43.727+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:52776 #140 (134 connections now open) 2016-09-19T13:25:43.727+0000 I NETWORK [conn140] end connection 172.16.210.100:52776 (133 connections now open) 2016-09-19T13:25:43.881+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:49143 #141 (134 connections now open) 2016-09-19T13:25:43.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33607 #142 (135 connections now open) 2016-09-19T13:25:43.979+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:37638 #143 (136 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34560 #144 (137 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34559 #145 (138 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34563 #146 (139 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34566 #147 (140 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34567 #148 (141 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34565 #149 (142 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34564 #150 (143 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34558 #151 (144 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34562 #152 (145 connections now open) 2016-09-19T13:25:44.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:34561 #153 (146 connections now open) 2016-09-19T13:25:44.186+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:33621 #154 (147 connections now open) 2016-09-19T13:25:44.304+0000 I REPL [ReplicationExecutor] syncing from: 172.16.24.5:27017 2016-09-19T13:25:44.305+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to 172.16.24.5:27017 2016-09-19T13:25:44.305+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to 172.16.24.5:27017 2016-09-19T13:25:44.306+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:25:44.306+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update, response: { ok: 0.0, errmsg: "Unexpected field durableOpTime in UpdateInfoArgs", code: 2 } 2016-09-19T13:25:44.306+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback falling back to old style UpdatePosition command 2016-09-19T13:25:44.540+0000 I - [NetworkInterfaceASIO-BGSync-0] Assertion: 10334:BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 102427081415 2016-09-19T13:25:44.551+0000 I CONTROL [NetworkInterfaceASIO-BGSync-0] 0x130c4a2 0x12a7248 0x128efe8 0x128f09c 0x973949 0xda2484 0x10abf65 0x10b75fb 0x10b929c 0x10b98a8 0x10b7040 0x108a750 0x10994ac 0x1099968 0x1329e71 0x132a091 0x132e22f 0x10aeda5 0x1b431c0 0x7fb029960b50 0x7fb0296aafbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EA7248","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"E8EFE8","s":"_ZN5mongo11msgassertedEiPKc"},{"b":"400000","o":"E8F09C"},{"b":"400000","o":"573949","s":"_ZNK5mongo7BSONObj14_assertInvalidEv"},{"b":"400000","o":"9A2484","s":"_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE"},{"b":"400000","o":"CABF65","s":"_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE"},{"b":"400000","o":"CB75FB","s":"_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE"},{"b":"400000","o":"CB929C","s":"_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE"},{"b":"400000","o":"CB98A8"},{"b":"400000","o":"CB7040"},{"b":"400000","o":"C8A750","s":"_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C994AC","s":"_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C99968","s":"_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m"},{"b":"400000","o":"F29E71","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"400000","o":"F2A091","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"400000","o":"F2E22F","s":"_ZN4asio10io_service3runEv"},{"b":"400000","o":"CAEDA5"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7FB02995A000","o":"6B50"},{"b":"7FB0295CD000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFC893A8000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7FB02A813000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7FB02A41A000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7FB02A212000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7FB02A00E000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7FB029D8C000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7FB029B76000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7FB02995A000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7FB0295CD000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7FB02AA72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7FB0293B6000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12a7248] mongod(_ZN5mongo11msgassertedEiPKc+0x88) [0x128efe8] mongod(+0xE8F09C) [0x128f09c] mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x3B9) [0x973949] mongod(_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE+0x514) [0xda2484] mongod(_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE+0x145) [0x10abf65] mongod(_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE+0x18B) [0x10b75fb] mongod(_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE+0x5C) [0x10b929c] mongod(+0xCB98A8) [0x10b98a8] mongod(+0xCB7040) [0x10b7040] mongod(_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_+0x70) [0x108a750] mongod(_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_+0x89C) [0x10994ac] mongod(_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m+0x228) [0x1099968] mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x2F1) [0x1329e71] mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xC1) [0x132a091] mongod(_ZN4asio10io_service3runEv+0x2F) [0x132e22f] mongod(+0xCAEDA5) [0x10aeda5] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7fb029960b50] libc.so.6(clone+0x6D) [0x7fb0296aafbd] ----- END BACKTRACE ----- 2016-09-19T13:25:44.551+0000 F ASIO [NetworkInterfaceASIO-BGSync-0] Uncaught exception in NetworkInterfaceASIO IO worker thread of type: Location10334: BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 102427081415 2016-09-19T13:25:44.551+0000 I - [NetworkInterfaceASIO-BGSync-0] Fatal Assertion 28820 2016-09-19T13:25:44.551+0000 I - [NetworkInterfaceASIO-BGSync-0] ***aborting after fassert() failure 2016-09-19T13:25:44.555+0000 F - [NetworkInterfaceASIO-BGSync-0] Got signal: 6 (Aborted). 0x130c4a2 0x130b3c9 0x130bbd2 0x7fb0299690a0 0x7fb0295ff125 0x7fb0296023a0 0x128e902 0x10aef93 0x1b431c0 0x7fb029960b50 0x7fb0296aafbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F0B3C9"},{"b":"400000","o":"F0BBD2"},{"b":"7FB02995A000","o":"F0A0"},{"b":"7FB0295CD000","o":"32125","s":"gsignal"},{"b":"7FB0295CD000","o":"353A0","s":"abort"},{"b":"400000","o":"E8E902","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAEF93"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7FB02995A000","o":"6B50"},{"b":"7FB0295CD000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFC893A8000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7FB02A813000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7FB02A41A000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7FB02A212000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7FB02A00E000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7FB029D8C000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7FB029B76000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7FB02995A000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7FB0295CD000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7FB02AA72000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7FB0293B6000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(+0xF0B3C9) [0x130b3c9] mongod(+0xF0BBD2) [0x130bbd2] libpthread.so.0(+0xF0A0) [0x7fb0299690a0] libc.so.6(gsignal+0x35) [0x7fb0295ff125] libc.so.6(abort+0x180) [0x7fb0296023a0] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x128e902] mongod(+0xCAEF93) [0x10aef93] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7fb029960b50] libc.so.6(clone+0x6D) [0x7fb0296aafbd] ----- END BACKTRACE ----- 2016-09-19T13:41:25.005+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] MongoDB starting : pid=31606 port=27017 dbpath=/var/lib/mongodb/appbuilder 64-bit host=bidb4 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] db version v3.2.9 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e 11 Feb 2013 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] modules: none 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] build environment: 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] distmod: debian71 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] distarch: x86_64 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-09-19T13:41:25.012+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb/mongodb_appbuilder.conf", net: { bindIp: "172.16.4.5", port: 27017 }, processManagement: { fork: false }, replication: { oplogSizeMB: 4096, replSetName: "wix_appbuilder" }, security: { authorization: "disabled", sasl: { hostName: "bidb4-05.aus.wixpress.com" } }, storage: { dbPath: "/var/lib/mongodb/appbuilder", directoryPerDB: true, engine: "wiredTiger", journal: { enabled: true }, wiredTiger: { engineConfig: { cacheSizeGB: 24 } } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb_appbuilder.log", verbosity: 0 } } 2016-09-19T13:41:25.033+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/appbuilder/mongod.lock is not empty. 2016-09-19T13:41:25.033+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-09-19T13:41:25.033+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=24G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-09-19T13:41:25.198+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-09-19T13:41:25.199+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 808205 records totaling to 4295038458 bytes 2016-09-19T13:41:25.199+0000 I STORAGE [initandlisten] Sampling from the oplog between Sep 19 09:15:21:2 and Sep 19 12:06:28:1 to determine where to place markers for truncation 2016-09-19T13:41:25.199+0000 I STORAGE [initandlisten] Taking 1000 samples and assuming that each section of oplog contains approximately 8082 records totaling to 42950118 bytes 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:17:17:76 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:19:16:5e 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:20:53:33 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:22:38:3 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:24:33:2fb 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:26:19:50 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:27:56:ef 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:29:20:41 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:31:27:a 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:33:25:26 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:35:17:e 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:37:30:19 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:39:15:b6 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:41:00:5 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:43:03:1 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:45:00:1 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:47:24:23 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:48:41:11 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:50:29:4 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:51:52:2b 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:53:33:4 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:55:17:2c 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:56:46:33 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:57:58:4d 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:59:44:5 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:01:08:5a 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:02:42:13 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:04:01:c 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:05:38:1d 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:06:49:15 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:08:30:30 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:09:54:d8 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:11:21:188 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:12:17:56 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:13:25:28 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:15:11:3 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:17:10:59 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:19:10:6 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:16:406 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:51:7 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:22:35:20 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:24:12:1d 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:25:40:2a 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:27:22:37 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:28:26:3 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:30:03:78 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:32:05:18 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:34:26:24b 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:36:11:54 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:37:39:51 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:39:26:13 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:41:13:3c 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:43:16:c 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:44:33:58 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:46:26:4 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:48:34:1 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:49:54:19 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:51:58:2a 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:53:17:14 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:54:55:3 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:56:55:91 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:58:50:18 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:01:12:1c7 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:02:55:17 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:05:15:5 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:06:58:168 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:08:41:1e 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:10:15:4e 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:12:06:27 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:13:58:24 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:15:52:25 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:16:59:5f 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:18:37:25 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:20:07:8 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:22:25:39 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:24:09:6a 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:25:39:252 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:27:14:26 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:28:55:1c 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:30:05:a4 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:31:53:38 2016-09-19T13:41:25.274+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:33:28:4b 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:34:52:5 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:36:12:334 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:37:53:6a 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:39:46:82 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:41:51:14 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:43:20:2 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:45:14:21 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:47:10:18 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:49:23:43 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:51:30:10 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:53:35:2e 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:55:36:c 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:57:18:168 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:58:55:9f 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:01:05:16 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:02:32:54 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:03:52:aa 2016-09-19T13:41:25.275+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:06:18:13 2016-09-19T13:41:25.310+0000 I CONTROL [initandlisten] 2016-09-19T13:41:25.310+0000 I CONTROL [initandlisten] ** WARNING: You are running on a NUMA machine. 2016-09-19T13:41:25.310+0000 I CONTROL [initandlisten] ** We suggest launching mongod like this to avoid performance problems: 2016-09-19T13:41:25.310+0000 I CONTROL [initandlisten] ** numactl --interleave=all mongod [other options] 2016-09-19T13:41:25.310+0000 I CONTROL [initandlisten] 2016-09-19T13:41:25.318+0000 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-09-19T13:41:25.319+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/appbuilder/diagnostic.data' 2016-09-19T13:41:25.319+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-09-19T13:41:25.319+0000 I NETWORK [initandlisten] waiting for connections on port 27017 2016-09-19T13:41:25.383+0000 I NETWORK [initandlisten] connection accepted from 10.15.4.18:58366 #1 (1 connection now open) 2016-09-19T13:41:25.474+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48664 #2 (2 connections now open) 2016-09-19T13:41:25.474+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48665 #3 (3 connections now open) 2016-09-19T13:41:25.474+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48667 #4 (4 connections now open) 2016-09-19T13:41:25.474+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48666 #5 (5 connections now open) 2016-09-19T13:41:25.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48668 #6 (6 connections now open) 2016-09-19T13:41:25.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48669 #7 (7 connections now open) 2016-09-19T13:41:25.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48670 #8 (8 connections now open) 2016-09-19T13:41:25.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48671 #9 (9 connections now open) 2016-09-19T13:41:25.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48672 #10 (10 connections now open) 2016-09-19T13:41:25.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48673 #11 (11 connections now open) 2016-09-19T13:41:25.556+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38393 #12 (12 connections now open) 2016-09-19T13:41:25.567+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38929 #13 (13 connections now open) 2016-09-19T13:41:25.567+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38930 #14 (14 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38932 #15 (15 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38935 #16 (16 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38931 #17 (17 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38937 #18 (18 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38938 #19 (19 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38934 #20 (20 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38933 #21 (21 connections now open) 2016-09-19T13:41:25.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:38936 #22 (22 connections now open) 2016-09-19T13:41:25.644+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33538 #23 (23 connections now open) 2016-09-19T13:41:25.665+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:54911 #24 (24 connections now open) 2016-09-19T13:41:25.705+0000 I NETWORK [initandlisten] connection accepted from 10.14.8.10:35871 #25 (25 connections now open) 2016-09-19T13:41:25.826+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "wix_appbuilder", version: 278987, members: [ { _id: 17, host: "172.16.210.105:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "dedb07-05.aus.wixpress.com", use: "delayed", version: "mongo3" }, slaveDelay: 21600, votes: 0 }, { _id: 18, host: "10.14.8.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo8-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 19, host: "172.16.203.1:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "bs3-appbuilder.aus.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 9, host: "10.15.2.19:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vac.aws.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 8, host: "10.14.9.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 10.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo9-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 7, host: "10.15.4.19:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vae.aws.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 }, { _id: 20, host: "172.16.4.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 20.0, tags: { host: "bidb4-05.aus.wixpress.com", dc: "aus", engine: "wiredTiger", use: "bi", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 21, host: "172.16.28.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 50.0, tags: { dc: "aus", engine: "wiredTiger", host: "db28-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 22, host: "172.16.24.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 80.0, tags: { dc: "aus", engine: "wiredTiger", host: "db24-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 23, host: "10.12.103.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "ams", host: "db3-05.ams.wixpress.com", use: "dev_read_only", engine: "wiredTiger", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-09-19T13:41:25.826+0000 I REPL [ReplicationExecutor] This node is 172.16.4.5:27017 in the config 2016-09-19T13:41:25.826+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-09-19T13:41:25.826+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-09-19T13:41:25.826+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-09-19T13:41:25.826+0000 I COMMAND [conn12] command admin.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 270ms 2016-09-19T13:41:25.826+0000 I COMMAND [conn2] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 351ms 2016-09-19T13:41:25.826+0000 I COMMAND [conn5] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 351ms 2016-09-19T13:41:25.826+0000 I COMMAND [conn13] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 258ms 2016-09-19T13:41:25.826+0000 I COMMAND [conn23] command admin.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 182ms 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.210.105:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.8.15:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.203.1:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.2.19:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.9.15:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.4.19:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.28.5:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.24.5:27017 2016-09-19T13:41:25.826+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.12.103.15:27017 2016-09-19T13:41:25.827+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:41:25.827+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.28.5:27017 2016-09-19T13:41:25.827+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-09-19T13:41:25.827+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.203.1:27017 2016-09-19T13:41:25.827+0000 I REPL [ReplicationExecutor] Member 172.16.24.5:27017 is now in state PRIMARY 2016-09-19T13:41:25.827+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.210.105:27017 2016-09-19T13:41:25.827+0000 I REPL [ReplicationExecutor] Member 172.16.28.5:27017 is now in state SECONDARY 2016-09-19T13:41:25.828+0000 I REPL [ReplicationExecutor] Member 172.16.203.1:27017 is now in state SECONDARY 2016-09-19T13:41:25.828+0000 I REPL [ReplicationExecutor] Member 172.16.210.105:27017 is now in state RECOVERING 2016-09-19T13:41:25.888+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.2.19:27017 2016-09-19T13:41:25.889+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.4.19:27017 2016-09-19T13:41:25.896+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.8.15:27017 2016-09-19T13:41:25.897+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.9.15:27017 2016-09-19T13:41:25.919+0000 I REPL [ReplicationExecutor] Member 10.15.2.19:27017 is now in state SECONDARY 2016-09-19T13:41:25.920+0000 I REPL [ReplicationExecutor] Member 10.15.4.19:27017 is now in state SECONDARY 2016-09-19T13:41:25.931+0000 I REPL [ReplicationExecutor] Member 10.14.8.15:27017 is now in state SECONDARY 2016-09-19T13:41:25.932+0000 I REPL [ReplicationExecutor] Member 10.14.9.15:27017 is now in state SECONDARY 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58279 #26 (26 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58281 #27 (27 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58285 #28 (28 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58283 #29 (29 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58287 #30 (30 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58288 #31 (31 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58280 #32 (32 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58284 #33 (33 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58282 #34 (34 connections now open) 2016-09-19T13:41:25.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:58286 #35 (35 connections now open) 2016-09-19T13:41:25.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50467 #36 (36 connections now open) 2016-09-19T13:41:25.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50468 #37 (37 connections now open) 2016-09-19T13:41:25.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50469 #38 (38 connections now open) 2016-09-19T13:41:25.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50470 #39 (39 connections now open) 2016-09-19T13:41:25.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50471 #40 (40 connections now open) 2016-09-19T13:41:25.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50472 #41 (41 connections now open) 2016-09-19T13:41:25.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50473 #42 (42 connections now open) 2016-09-19T13:41:25.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50474 #43 (43 connections now open) 2016-09-19T13:41:25.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50475 #44 (44 connections now open) 2016-09-19T13:41:25.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:50476 #45 (45 connections now open) 2016-09-19T13:41:26.047+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.12.103.15:27017 2016-09-19T13:41:26.152+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.153:33864 #46 (46 connections now open) 2016-09-19T13:41:26.155+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43365 #47 (47 connections now open) 2016-09-19T13:41:26.155+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43371 #48 (48 connections now open) 2016-09-19T13:41:26.155+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43370 #49 (49 connections now open) 2016-09-19T13:41:26.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43368 #50 (50 connections now open) 2016-09-19T13:41:26.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43366 #51 (51 connections now open) 2016-09-19T13:41:26.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43364 #52 (52 connections now open) 2016-09-19T13:41:26.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43363 #53 (53 connections now open) 2016-09-19T13:41:26.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43369 #54 (54 connections now open) 2016-09-19T13:41:26.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43367 #55 (55 connections now open) 2016-09-19T13:41:26.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:43372 #56 (56 connections now open) 2016-09-19T13:41:26.157+0000 I REPL [ReplicationExecutor] Member 10.12.103.15:27017 is now in state STARTUP2 2016-09-19T13:41:26.248+0000 I NETWORK [initandlisten] connection accepted from 10.12.103.1:56477 #57 (57 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38400 #58 (58 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38401 #59 (59 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38402 #60 (60 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38403 #61 (61 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38404 #62 (62 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38405 #63 (63 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38406 #64 (64 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38407 #65 (65 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38408 #66 (66 connections now open) 2016-09-19T13:41:26.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:38409 #67 (67 connections now open) 2016-09-19T13:41:26.471+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48730 #68 (68 connections now open) 2016-09-19T13:41:26.578+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.84:35870 #69 (69 connections now open) 2016-09-19T13:41:26.612+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.164:53039 #70 (70 connections now open) 2016-09-19T13:41:26.642+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:48754 #71 (71 connections now open) 2016-09-19T13:41:26.846+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34632 #72 (72 connections now open) 2016-09-19T13:41:26.846+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34633 #73 (73 connections now open) 2016-09-19T13:41:26.846+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34634 #74 (74 connections now open) 2016-09-19T13:41:26.846+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34635 #75 (75 connections now open) 2016-09-19T13:41:26.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34636 #76 (76 connections now open) 2016-09-19T13:41:26.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34637 #77 (77 connections now open) 2016-09-19T13:41:26.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34638 #78 (78 connections now open) 2016-09-19T13:41:26.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34639 #79 (79 connections now open) 2016-09-19T13:41:26.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34640 #80 (80 connections now open) 2016-09-19T13:41:26.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:34641 #81 (81 connections now open) 2016-09-19T13:41:26.876+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33546 #82 (82 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33547 #83 (83 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33548 #84 (84 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33550 #85 (85 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33551 #86 (86 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33552 #87 (87 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33549 #88 (88 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33553 #89 (89 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33554 #90 (90 connections now open) 2016-09-19T13:41:26.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:33555 #91 (91 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34115 #92 (92 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34116 #93 (93 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34117 #94 (94 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34118 #95 (95 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34119 #96 (96 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34120 #97 (97 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34122 #98 (98 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34121 #99 (99 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34123 #100 (100 connections now open) 2016-09-19T13:41:26.887+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34124 #101 (101 connections now open) 2016-09-19T13:41:26.919+0000 I NETWORK [initandlisten] connection accepted from 10.14.9.10:53095 #102 (102 connections now open) 2016-09-19T13:41:27.016+0000 I NETWORK [initandlisten] connection accepted from 10.15.2.18:53180 #103 (103 connections now open) 2016-09-19T13:41:27.064+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61889 #104 (104 connections now open) 2016-09-19T13:41:27.064+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61890 #105 (105 connections now open) 2016-09-19T13:41:27.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61891 #106 (106 connections now open) 2016-09-19T13:41:27.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61888 #107 (107 connections now open) 2016-09-19T13:41:27.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61892 #108 (108 connections now open) 2016-09-19T13:41:27.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61894 #109 (109 connections now open) 2016-09-19T13:41:27.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61895 #110 (110 connections now open) 2016-09-19T13:41:27.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61897 #111 (111 connections now open) 2016-09-19T13:41:27.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61893 #112 (112 connections now open) 2016-09-19T13:41:27.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:61896 #113 (113 connections now open) 2016-09-19T13:41:27.135+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40888 #114 (114 connections now open) 2016-09-19T13:41:27.135+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40889 #115 (115 connections now open) 2016-09-19T13:41:27.135+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40893 #116 (116 connections now open) 2016-09-19T13:41:27.135+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40891 #117 (117 connections now open) 2016-09-19T13:41:27.135+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40895 #118 (118 connections now open) 2016-09-19T13:41:27.135+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40897 #119 (119 connections now open) 2016-09-19T13:41:27.135+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40892 #120 (120 connections now open) 2016-09-19T13:41:27.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40890 #121 (121 connections now open) 2016-09-19T13:41:27.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40894 #122 (122 connections now open) 2016-09-19T13:41:27.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:40896 #123 (123 connections now open) 2016-09-19T13:41:27.710+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:54912 #124 (124 connections now open) 2016-09-19T13:41:27.710+0000 I NETWORK [conn124] end connection 172.16.210.100:54912 (123 connections now open) 2016-09-19T13:41:28.179+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:34125 #125 (124 connections now open) 2016-09-19T13:41:28.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47216 #126 (125 connections now open) 2016-09-19T13:41:28.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47217 #127 (126 connections now open) 2016-09-19T13:41:28.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47219 #128 (127 connections now open) 2016-09-19T13:41:28.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47222 #129 (128 connections now open) 2016-09-19T13:41:28.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47218 #130 (129 connections now open) 2016-09-19T13:41:28.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47225 #131 (130 connections now open) 2016-09-19T13:41:28.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47220 #132 (131 connections now open) 2016-09-19T13:41:28.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47221 #133 (132 connections now open) 2016-09-19T13:41:28.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47224 #134 (133 connections now open) 2016-09-19T13:41:28.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:47223 #135 (134 connections now open) 2016-09-19T13:41:28.827+0000 I REPL [ReplicationExecutor] syncing from: 172.16.24.5:27017 2016-09-19T13:41:28.828+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to 172.16.24.5:27017 2016-09-19T13:41:28.828+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to 172.16.24.5:27017 2016-09-19T13:41:28.829+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:41:28.829+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update, response: { ok: 0.0, errmsg: "Unexpected field durableOpTime in UpdateInfoArgs", code: 2 } 2016-09-19T13:41:28.829+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback falling back to old style UpdatePosition command 2016-09-19T13:41:29.075+0000 I - [NetworkInterfaceASIO-BGSync-0] Assertion: 10334:BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 101738043057 2016-09-19T13:41:29.087+0000 I CONTROL [NetworkInterfaceASIO-BGSync-0] 0x130c4a2 0x12a7248 0x128efe8 0x128f09c 0x973949 0xda2484 0x10abf65 0x10b75fb 0x10b929c 0x10b98a8 0x10b7040 0x108a750 0x10994ac 0x1099968 0x1329e71 0x132a091 0x132e22f 0x10aeda5 0x1b431c0 0x7fbe67d89b50 0x7fbe67ad3fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EA7248","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"E8EFE8","s":"_ZN5mongo11msgassertedEiPKc"},{"b":"400000","o":"E8F09C"},{"b":"400000","o":"573949","s":"_ZNK5mongo7BSONObj14_assertInvalidEv"},{"b":"400000","o":"9A2484","s":"_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE"},{"b":"400000","o":"CABF65","s":"_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE"},{"b":"400000","o":"CB75FB","s":"_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE"},{"b":"400000","o":"CB929C","s":"_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE"},{"b":"400000","o":"CB98A8"},{"b":"400000","o":"CB7040"},{"b":"400000","o":"C8A750","s":"_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C994AC","s":"_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C99968","s":"_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m"},{"b":"400000","o":"F29E71","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"400000","o":"F2A091","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"400000","o":"F2E22F","s":"_ZN4asio10io_service3runEv"},{"b":"400000","o":"CAEDA5"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7FBE67D83000","o":"6B50"},{"b":"7FBE679F6000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFC84BDB000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7FBE68C3C000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7FBE68843000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7FBE6863B000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7FBE68437000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7FBE681B5000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7FBE67F9F000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7FBE67D83000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7FBE679F6000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7FBE68E9B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7FBE677DF000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12a7248] mongod(_ZN5mongo11msgassertedEiPKc+0x88) [0x128efe8] mongod(+0xE8F09C) [0x128f09c] mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x3B9) [0x973949] mongod(_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE+0x514) [0xda2484] mongod(_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE+0x145) [0x10abf65] mongod(_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE+0x18B) [0x10b75fb] mongod(_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE+0x5C) [0x10b929c] mongod(+0xCB98A8) [0x10b98a8] mongod(+0xCB7040) [0x10b7040] mongod(_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_+0x70) [0x108a750] mongod(_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_+0x89C) [0x10994ac] mongod(_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m+0x228) [0x1099968] mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x2F1) [0x1329e71] mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xC1) [0x132a091] mongod(_ZN4asio10io_service3runEv+0x2F) [0x132e22f] mongod(+0xCAEDA5) [0x10aeda5] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7fbe67d89b50] libc.so.6(clone+0x6D) [0x7fbe67ad3fbd] ----- END BACKTRACE ----- 2016-09-19T13:41:29.087+0000 F ASIO [NetworkInterfaceASIO-BGSync-0] Uncaught exception in NetworkInterfaceASIO IO worker thread of type: Location10334: BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 101738043057 2016-09-19T13:41:29.087+0000 I - [NetworkInterfaceASIO-BGSync-0] Fatal Assertion 28820 2016-09-19T13:41:29.087+0000 I - [NetworkInterfaceASIO-BGSync-0] ***aborting after fassert() failure 2016-09-19T13:41:29.091+0000 F - [NetworkInterfaceASIO-BGSync-0] Got signal: 6 (Aborted). 0x130c4a2 0x130b3c9 0x130bbd2 0x7fbe67d920a0 0x7fbe67a28125 0x7fbe67a2b3a0 0x128e902 0x10aef93 0x1b431c0 0x7fbe67d89b50 0x7fbe67ad3fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F0B3C9"},{"b":"400000","o":"F0BBD2"},{"b":"7FBE67D83000","o":"F0A0"},{"b":"7FBE679F6000","o":"32125","s":"gsignal"},{"b":"7FBE679F6000","o":"353A0","s":"abort"},{"b":"400000","o":"E8E902","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAEF93"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7FBE67D83000","o":"6B50"},{"b":"7FBE679F6000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFC84BDB000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7FBE68C3C000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7FBE68843000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7FBE6863B000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7FBE68437000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7FBE681B5000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7FBE67F9F000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7FBE67D83000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7FBE679F6000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7FBE68E9B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7FBE677DF000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(+0xF0B3C9) [0x130b3c9] mongod(+0xF0BBD2) [0x130bbd2] libpthread.so.0(+0xF0A0) [0x7fbe67d920a0] libc.so.6(gsignal+0x35) [0x7fbe67a28125] libc.so.6(abort+0x180) [0x7fbe67a2b3a0] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x128e902] mongod(+0xCAEF93) [0x10aef93] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7fbe67d89b50] libc.so.6(clone+0x6D) [0x7fbe67ad3fbd] ----- END BACKTRACE ----- 2016-09-19T13:57:10.175+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] MongoDB starting : pid=39020 port=27017 dbpath=/var/lib/mongodb/appbuilder 64-bit host=bidb4 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] db version v3.2.9 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e 11 Feb 2013 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] modules: none 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] build environment: 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] distmod: debian71 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] distarch: x86_64 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-09-19T13:57:10.182+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb/mongodb_appbuilder.conf", net: { bindIp: "172.16.4.5", port: 27017 }, processManagement: { fork: false }, replication: { oplogSizeMB: 4096, replSetName: "wix_appbuilder" }, security: { authorization: "disabled", sasl: { hostName: "bidb4-05.aus.wixpress.com" } }, storage: { dbPath: "/var/lib/mongodb/appbuilder", directoryPerDB: true, engine: "wiredTiger", journal: { enabled: true }, wiredTiger: { engineConfig: { cacheSizeGB: 24 } } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb_appbuilder.log", verbosity: 0 } } 2016-09-19T13:57:10.203+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/appbuilder/mongod.lock is not empty. 2016-09-19T13:57:10.203+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-09-19T13:57:10.203+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=24G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-09-19T13:57:10.364+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-09-19T13:57:10.364+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 808205 records totaling to 4295038458 bytes 2016-09-19T13:57:10.364+0000 I STORAGE [initandlisten] Sampling from the oplog between Sep 19 09:15:21:2 and Sep 19 12:06:28:1 to determine where to place markers for truncation 2016-09-19T13:57:10.364+0000 I STORAGE [initandlisten] Taking 1000 samples and assuming that each section of oplog contains approximately 8082 records totaling to 42950118 bytes 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:17:17:76 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:19:16:5e 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:20:53:33 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:22:38:3 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:24:33:2fb 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:26:19:50 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:27:56:ef 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:29:20:41 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:31:27:a 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:33:25:26 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:35:17:e 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:37:30:19 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:39:15:b6 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:41:00:5 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:43:03:1 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:45:00:1 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:47:24:23 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:48:41:11 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:50:29:4 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:51:52:2b 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:53:33:4 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:55:17:2c 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:56:46:33 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:57:58:4d 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:59:44:5 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:01:08:5a 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:02:42:13 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:04:01:c 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:05:38:1d 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:06:49:15 2016-09-19T13:57:10.445+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:08:30:30 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:09:54:d8 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:11:21:188 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:12:17:56 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:13:25:28 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:15:11:3 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:17:10:59 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:19:10:6 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:16:406 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:51:7 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:22:35:20 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:24:12:1d 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:25:40:2a 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:27:22:37 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:28:26:3 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:30:03:78 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:32:05:18 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:34:26:24b 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:36:11:54 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:37:39:51 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:39:26:13 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:41:13:3c 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:43:16:c 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:44:33:58 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:46:26:4 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:48:34:1 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:49:54:19 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:51:58:2a 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:53:17:14 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:54:55:3 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:56:55:91 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:58:50:18 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:01:12:1c7 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:02:55:17 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:05:15:5 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:06:58:168 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:08:41:1e 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:10:15:4e 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:12:06:27 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:13:58:24 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:15:52:25 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:16:59:5f 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:18:37:25 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:20:07:8 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:22:25:39 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:24:09:6a 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:25:39:252 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:27:14:26 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:28:55:1c 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:30:05:a4 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:31:53:38 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:33:28:4b 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:34:52:5 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:36:12:334 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:37:53:6a 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:39:46:82 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:41:51:14 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:43:20:2 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:45:14:21 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:47:10:18 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:49:23:43 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:51:30:10 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:53:35:2e 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:55:36:c 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:57:18:168 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:58:55:9f 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:01:05:16 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:02:32:54 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:03:52:aa 2016-09-19T13:57:10.446+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:06:18:13 2016-09-19T13:57:10.481+0000 I CONTROL [initandlisten] 2016-09-19T13:57:10.481+0000 I CONTROL [initandlisten] ** WARNING: You are running on a NUMA machine. 2016-09-19T13:57:10.481+0000 I CONTROL [initandlisten] ** We suggest launching mongod like this to avoid performance problems: 2016-09-19T13:57:10.481+0000 I CONTROL [initandlisten] ** numactl --interleave=all mongod [other options] 2016-09-19T13:57:10.482+0000 I CONTROL [initandlisten] 2016-09-19T13:57:10.490+0000 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-09-19T13:57:10.491+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/appbuilder/diagnostic.data' 2016-09-19T13:57:10.491+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-09-19T13:57:10.491+0000 I NETWORK [initandlisten] waiting for connections on port 27017 2016-09-19T13:57:10.649+0000 I NETWORK [initandlisten] connection accepted from 10.14.9.10:55206 #1 (1 connection now open) 2016-09-19T13:57:10.673+0000 I NETWORK [initandlisten] connection accepted from 10.15.2.18:54964 #2 (2 connections now open) 2016-09-19T13:57:10.798+0000 I NETWORK [initandlisten] connection accepted from 10.14.8.10:38003 #3 (3 connections now open) 2016-09-19T13:57:10.837+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46698 #4 (4 connections now open) 2016-09-19T13:57:10.837+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46697 #5 (5 connections now open) 2016-09-19T13:57:10.837+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46699 #6 (6 connections now open) 2016-09-19T13:57:10.837+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46700 #7 (7 connections now open) 2016-09-19T13:57:10.838+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46705 #8 (8 connections now open) 2016-09-19T13:57:10.838+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46704 #9 (9 connections now open) 2016-09-19T13:57:10.838+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46703 #10 (10 connections now open) 2016-09-19T13:57:10.838+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46702 #11 (11 connections now open) 2016-09-19T13:57:10.838+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46701 #12 (12 connections now open) 2016-09-19T13:57:10.838+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:46706 #13 (13 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45782 #14 (14 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45783 #15 (15 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45784 #16 (16 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45785 #17 (17 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45786 #18 (18 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45788 #19 (19 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45787 #20 (20 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45791 #21 (21 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45789 #22 (22 connections now open) 2016-09-19T13:57:10.877+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:45790 #23 (23 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48782 #24 (24 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48783 #25 (25 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48784 #26 (26 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48786 #27 (27 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48788 #28 (28 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48785 #29 (29 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48787 #30 (30 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48789 #31 (31 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48790 #32 (32 connections now open) 2016-09-19T13:57:10.888+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:48791 #33 (33 connections now open) 2016-09-19T13:57:10.981+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "wix_appbuilder", version: 278987, members: [ { _id: 17, host: "172.16.210.105:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "dedb07-05.aus.wixpress.com", use: "delayed", version: "mongo3" }, slaveDelay: 21600, votes: 0 }, { _id: 18, host: "10.14.8.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo8-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 19, host: "172.16.203.1:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "bs3-appbuilder.aus.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 9, host: "10.15.2.19:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vac.aws.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 8, host: "10.14.9.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 10.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo9-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 7, host: "10.15.4.19:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vae.aws.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 }, { _id: 20, host: "172.16.4.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 20.0, tags: { host: "bidb4-05.aus.wixpress.com", dc: "aus", engine: "wiredTiger", use: "bi", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 21, host: "172.16.28.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 50.0, tags: { dc: "aus", engine: "wiredTiger", host: "db28-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 22, host: "172.16.24.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 80.0, tags: { dc: "aus", engine: "wiredTiger", host: "db24-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 23, host: "10.12.103.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "ams", host: "db3-05.ams.wixpress.com", use: "dev_read_only", engine: "wiredTiger", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-09-19T13:57:10.981+0000 I REPL [ReplicationExecutor] This node is 172.16.4.5:27017 in the config 2016-09-19T13:57:10.981+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-09-19T13:57:10.981+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-09-19T13:57:10.981+0000 I COMMAND [conn14] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 103ms 2016-09-19T13:57:10.981+0000 I COMMAND [conn5] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 143ms 2016-09-19T13:57:10.981+0000 I COMMAND [conn4] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 143ms 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.210.105:27017 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.8.15:27017 2016-09-19T13:57:10.981+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.203.1:27017 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.2.19:27017 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.9.15:27017 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.4.19:27017 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.28.5:27017 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.24.5:27017 2016-09-19T13:57:10.981+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.12.103.15:27017 2016-09-19T13:57:10.982+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:57:10.982+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-09-19T13:57:10.982+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.28.5:27017 2016-09-19T13:57:10.982+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.210.105:27017 2016-09-19T13:57:10.982+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.203.1:27017 2016-09-19T13:57:10.982+0000 I REPL [ReplicationExecutor] Member 172.16.24.5:27017 is now in state PRIMARY 2016-09-19T13:57:10.982+0000 I REPL [ReplicationExecutor] Member 172.16.28.5:27017 is now in state SECONDARY 2016-09-19T13:57:10.982+0000 I REPL [ReplicationExecutor] Member 172.16.210.105:27017 is now in state RECOVERING 2016-09-19T13:57:10.982+0000 I REPL [ReplicationExecutor] Member 172.16.203.1:27017 is now in state SECONDARY 2016-09-19T13:57:10.995+0000 I NETWORK [initandlisten] connection accepted from 10.15.4.18:60151 #34 (34 connections now open) 2016-09-19T13:57:11.045+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.2.19:27017 2016-09-19T13:57:11.045+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.4.19:27017 2016-09-19T13:57:11.052+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.8.15:27017 2016-09-19T13:57:11.052+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.9.15:27017 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37608 #35 (35 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37606 #36 (36 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37614 #37 (37 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37613 #38 (38 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37615 #39 (39 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37609 #40 (40 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37610 #41 (41 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37611 #42 (42 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37612 #43 (43 connections now open) 2016-09-19T13:57:11.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:37607 #44 (44 connections now open) 2016-09-19T13:57:11.079+0000 I REPL [ReplicationExecutor] Member 10.15.2.19:27017 is now in state SECONDARY 2016-09-19T13:57:11.079+0000 I REPL [ReplicationExecutor] Member 10.15.4.19:27017 is now in state SECONDARY 2016-09-19T13:57:11.089+0000 I REPL [ReplicationExecutor] Member 10.14.8.15:27017 is now in state SECONDARY 2016-09-19T13:57:11.089+0000 I REPL [ReplicationExecutor] Member 10.14.9.15:27017 is now in state SECONDARY 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34710 #45 (45 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34708 #46 (46 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34709 #47 (47 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34713 #48 (48 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34707 #49 (49 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34711 #50 (50 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34715 #51 (51 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34714 #52 (52 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34712 #53 (53 connections now open) 2016-09-19T13:57:11.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:34716 #54 (54 connections now open) 2016-09-19T13:57:11.140+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.153:35708 #55 (55 connections now open) 2016-09-19T13:57:11.210+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.12.103.15:27017 2016-09-19T13:57:11.252+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.84:37715 #56 (56 connections now open) 2016-09-19T13:57:11.323+0000 I REPL [ReplicationExecutor] Member 10.12.103.15:27017 is now in state STARTUP2 2016-09-19T13:57:11.342+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.164:56015 #57 (57 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63206 #58 (58 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63205 #59 (59 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63207 #60 (60 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63209 #61 (61 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63211 #62 (62 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [conn59] end connection 172.16.209.164:63205 (60 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63208 #63 (63 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63213 #64 (63 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63212 #65 (64 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63210 #66 (65 connections now open) 2016-09-19T13:57:11.476+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63214 #67 (66 connections now open) 2016-09-19T13:57:11.481+0000 I NETWORK [conn67] end connection 172.16.209.164:63214 (65 connections now open) 2016-09-19T13:57:11.524+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63220 #68 (66 connections now open) 2016-09-19T13:57:11.524+0000 I NETWORK [conn68] end connection 172.16.209.164:63220 (65 connections now open) 2016-09-19T13:57:11.525+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63221 #69 (66 connections now open) 2016-09-19T13:57:11.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47873 #70 (67 connections now open) 2016-09-19T13:57:11.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47870 #71 (68 connections now open) 2016-09-19T13:57:11.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47874 #72 (69 connections now open) 2016-09-19T13:57:11.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47879 #73 (70 connections now open) 2016-09-19T13:57:11.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47871 #74 (71 connections now open) 2016-09-19T13:57:11.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47876 #75 (72 connections now open) 2016-09-19T13:57:11.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47875 #76 (73 connections now open) 2016-09-19T13:57:11.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47878 #77 (74 connections now open) 2016-09-19T13:57:11.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47872 #78 (75 connections now open) 2016-09-19T13:57:11.570+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:47877 #79 (76 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33863 #80 (77 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33865 #81 (78 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33869 #82 (79 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33867 #83 (80 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33871 #84 (81 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33872 #85 (82 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33864 #86 (83 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33868 #87 (84 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33866 #88 (85 connections now open) 2016-09-19T13:57:11.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:33870 #89 (86 connections now open) 2016-09-19T13:57:11.955+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:57044 #90 (87 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63204 #91 (88 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63206 #92 (89 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63205 #93 (90 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63207 #94 (91 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63209 #95 (92 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63208 #96 (93 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63210 #97 (94 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63211 #98 (95 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63212 #99 (96 connections now open) 2016-09-19T13:57:11.977+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:63213 #100 (97 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63337 #101 (98 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63335 #102 (99 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63338 #103 (100 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63336 #104 (101 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63343 #105 (102 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63340 #106 (103 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63344 #107 (104 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63339 #108 (105 connections now open) 2016-09-19T13:57:12.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63341 #109 (106 connections now open) 2016-09-19T13:57:12.380+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:63342 #110 (107 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49135 #111 (108 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49136 #112 (109 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49137 #113 (110 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49138 #114 (111 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49139 #115 (112 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49140 #116 (113 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49141 #117 (114 connections now open) 2016-09-19T13:57:12.445+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49142 #118 (115 connections now open) 2016-09-19T13:57:12.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49143 #119 (116 connections now open) 2016-09-19T13:57:12.446+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:49144 #120 (117 connections now open) 2016-09-19T13:57:12.504+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:57045 #121 (118 connections now open) 2016-09-19T13:57:12.505+0000 I NETWORK [conn121] end connection 172.16.210.100:57045 (117 connections now open) 2016-09-19T13:57:12.591+0000 I NETWORK [initandlisten] connection accepted from 10.12.103.1:58912 #122 (118 connections now open) 2016-09-19T13:57:13.474+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:63294 #123 (119 connections now open) 2016-09-19T13:57:13.982+0000 I REPL [ReplicationExecutor] syncing from: 172.16.24.5:27017 2016-09-19T13:57:13.983+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to 172.16.24.5:27017 2016-09-19T13:57:13.983+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to 172.16.24.5:27017 2016-09-19T13:57:13.983+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to 172.16.24.5:27017 2016-09-19T13:57:13.984+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update, response: { ok: 0.0, errmsg: "Unexpected field durableOpTime in UpdateInfoArgs", code: 2 } 2016-09-19T13:57:13.984+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback falling back to old style UpdatePosition command 2016-09-19T13:57:14.155+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51722 #124 (120 connections now open) 2016-09-19T13:57:14.155+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51721 #125 (121 connections now open) 2016-09-19T13:57:14.155+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51723 #126 (122 connections now open) 2016-09-19T13:57:14.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51720 #127 (123 connections now open) 2016-09-19T13:57:14.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51719 #128 (124 connections now open) 2016-09-19T13:57:14.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51727 #129 (125 connections now open) 2016-09-19T13:57:14.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51718 #130 (126 connections now open) 2016-09-19T13:57:14.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51724 #131 (127 connections now open) 2016-09-19T13:57:14.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51726 #132 (128 connections now open) 2016-09-19T13:57:14.156+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:51725 #133 (129 connections now open) 2016-09-19T13:57:14.238+0000 I - [NetworkInterfaceASIO-BGSync-0] Assertion: 10334:BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 101843421609 2016-09-19T13:57:14.250+0000 I CONTROL [NetworkInterfaceASIO-BGSync-0] 0x130c4a2 0x12a7248 0x128efe8 0x128f09c 0x973949 0xda2484 0x10abf65 0x10b75fb 0x10b929c 0x10b98a8 0x10b7040 0x108a750 0x10994ac 0x1099968 0x1329e71 0x132a091 0x132e22f 0x10aeda5 0x1b431c0 0x7f4c3ad9db50 0x7f4c3aae7fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EA7248","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"E8EFE8","s":"_ZN5mongo11msgassertedEiPKc"},{"b":"400000","o":"E8F09C"},{"b":"400000","o":"573949","s":"_ZNK5mongo7BSONObj14_assertInvalidEv"},{"b":"400000","o":"9A2484","s":"_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE"},{"b":"400000","o":"CABF65","s":"_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE"},{"b":"400000","o":"CB75FB","s":"_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE"},{"b":"400000","o":"CB929C","s":"_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE"},{"b":"400000","o":"CB98A8"},{"b":"400000","o":"CB7040"},{"b":"400000","o":"C8A750","s":"_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C994AC","s":"_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C99968","s":"_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m"},{"b":"400000","o":"F29E71","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"400000","o":"F2A091","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"400000","o":"F2E22F","s":"_ZN4asio10io_service3runEv"},{"b":"400000","o":"CAEDA5"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7F4C3AD97000","o":"6B50"},{"b":"7F4C3AA0A000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFCA2AFC000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7F4C3BC50000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7F4C3B857000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7F4C3B64F000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7F4C3B44B000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7F4C3B1C9000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7F4C3AFB3000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7F4C3AD97000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7F4C3AA0A000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7F4C3BEAF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7F4C3A7F3000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12a7248] mongod(_ZN5mongo11msgassertedEiPKc+0x88) [0x128efe8] mongod(+0xE8F09C) [0x128f09c] mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x3B9) [0x973949] mongod(_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE+0x514) [0xda2484] mongod(_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE+0x145) [0x10abf65] mongod(_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE+0x18B) [0x10b75fb] mongod(_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE+0x5C) [0x10b929c] mongod(+0xCB98A8) [0x10b98a8] mongod(+0xCB7040) [0x10b7040] mongod(_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_+0x70) [0x108a750] mongod(_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_+0x89C) [0x10994ac] mongod(_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m+0x228) [0x1099968] mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x2F1) [0x1329e71] mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xC1) [0x132a091] mongod(_ZN4asio10io_service3runEv+0x2F) [0x132e22f] mongod(+0xCAEDA5) [0x10aeda5] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7f4c3ad9db50] libc.so.6(clone+0x6D) [0x7f4c3aae7fbd] ----- END BACKTRACE ----- 2016-09-19T13:57:14.250+0000 F ASIO [NetworkInterfaceASIO-BGSync-0] Uncaught exception in NetworkInterfaceASIO IO worker thread of type: Location10334: BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 101843421609 2016-09-19T13:57:14.250+0000 I - [NetworkInterfaceASIO-BGSync-0] Fatal Assertion 28820 2016-09-19T13:57:14.250+0000 I - [NetworkInterfaceASIO-BGSync-0] ***aborting after fassert() failure 2016-09-19T13:57:14.254+0000 F - [NetworkInterfaceASIO-BGSync-0] Got signal: 6 (Aborted). 0x130c4a2 0x130b3c9 0x130bbd2 0x7f4c3ada60a0 0x7f4c3aa3c125 0x7f4c3aa3f3a0 0x128e902 0x10aef93 0x1b431c0 0x7f4c3ad9db50 0x7f4c3aae7fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F0B3C9"},{"b":"400000","o":"F0BBD2"},{"b":"7F4C3AD97000","o":"F0A0"},{"b":"7F4C3AA0A000","o":"32125","s":"gsignal"},{"b":"7F4C3AA0A000","o":"353A0","s":"abort"},{"b":"400000","o":"E8E902","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAEF93"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7F4C3AD97000","o":"6B50"},{"b":"7F4C3AA0A000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFCA2AFC000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7F4C3BC50000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7F4C3B857000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7F4C3B64F000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7F4C3B44B000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7F4C3B1C9000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7F4C3AFB3000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7F4C3AD97000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7F4C3AA0A000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7F4C3BEAF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7F4C3A7F3000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(+0xF0B3C9) [0x130b3c9] mongod(+0xF0BBD2) [0x130bbd2] libpthread.so.0(+0xF0A0) [0x7f4c3ada60a0] libc.so.6(gsignal+0x35) [0x7f4c3aa3c125] libc.so.6(abort+0x180) [0x7f4c3aa3f3a0] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x128e902] mongod(+0xCAEF93) [0x10aef93] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7f4c3ad9db50] libc.so.6(clone+0x6D) [0x7f4c3aae7fbd] ----- END BACKTRACE ----- 2016-09-19T14:12:55.186+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-09-19T14:12:55.192+0000 I CONTROL [initandlisten] MongoDB starting : pid=46381 port=27017 dbpath=/var/lib/mongodb/appbuilder 64-bit host=bidb4 2016-09-19T14:12:55.192+0000 I CONTROL [initandlisten] db version v3.2.9 2016-09-19T14:12:55.192+0000 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c 2016-09-19T14:12:55.192+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1e 11 Feb 2013 2016-09-19T14:12:55.192+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-09-19T14:12:55.192+0000 I CONTROL [initandlisten] modules: none 2016-09-19T14:12:55.193+0000 I CONTROL [initandlisten] build environment: 2016-09-19T14:12:55.193+0000 I CONTROL [initandlisten] distmod: debian71 2016-09-19T14:12:55.193+0000 I CONTROL [initandlisten] distarch: x86_64 2016-09-19T14:12:55.193+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-09-19T14:12:55.193+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb/mongodb_appbuilder.conf", net: { bindIp: "172.16.4.5", port: 27017 }, processManagement: { fork: false }, replication: { oplogSizeMB: 4096, replSetName: "wix_appbuilder" }, security: { authorization: "disabled", sasl: { hostName: "bidb4-05.aus.wixpress.com" } }, storage: { dbPath: "/var/lib/mongodb/appbuilder", directoryPerDB: true, engine: "wiredTiger", journal: { enabled: true }, wiredTiger: { engineConfig: { cacheSizeGB: 24 } } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongodb_appbuilder.log", verbosity: 0 } } 2016-09-19T14:12:55.214+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb/appbuilder/mongod.lock is not empty. 2016-09-19T14:12:55.214+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-09-19T14:12:55.214+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=24G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-09-19T14:12:55.376+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-09-19T14:12:55.376+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 808205 records totaling to 4295038458 bytes 2016-09-19T14:12:55.376+0000 I STORAGE [initandlisten] Sampling from the oplog between Sep 19 09:15:21:2 and Sep 19 12:06:28:1 to determine where to place markers for truncation 2016-09-19T14:12:55.376+0000 I STORAGE [initandlisten] Taking 1000 samples and assuming that each section of oplog contains approximately 8082 records totaling to 42950118 bytes 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:17:17:76 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:19:16:5e 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:20:53:33 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:22:38:3 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:24:33:2fb 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:26:19:50 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:27:56:ef 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:29:20:41 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:31:27:a 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:33:25:26 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:35:17:e 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:37:30:19 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:39:15:b6 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:41:00:5 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:43:03:1 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:45:00:1 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:47:24:23 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:48:41:11 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:50:29:4 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:51:52:2b 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:53:33:4 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:55:17:2c 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:56:46:33 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:57:58:4d 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 09:59:44:5 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:01:08:5a 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:02:42:13 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:04:01:c 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:05:38:1d 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:06:49:15 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:08:30:30 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:09:54:d8 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:11:21:188 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:12:17:56 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:13:25:28 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:15:11:3 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:17:10:59 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:19:10:6 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:16:406 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:20:51:7 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:22:35:20 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:24:12:1d 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:25:40:2a 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:27:22:37 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:28:26:3 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:30:03:78 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:32:05:18 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:34:26:24b 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:36:11:54 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:37:39:51 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:39:26:13 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:41:13:3c 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:43:16:c 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:44:33:58 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:46:26:4 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:48:34:1 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:49:54:19 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:51:58:2a 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:53:17:14 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:54:55:3 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:56:55:91 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 10:58:50:18 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:01:12:1c7 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:02:55:17 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:05:15:5 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:06:58:168 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:08:41:1e 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:10:15:4e 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:12:06:27 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:13:58:24 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:15:52:25 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:16:59:5f 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:18:37:25 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:20:07:8 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:22:25:39 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:24:09:6a 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:25:39:252 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:27:14:26 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:28:55:1c 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:30:05:a4 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:31:53:38 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:33:28:4b 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:34:52:5 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:36:12:334 2016-09-19T14:12:55.453+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:37:53:6a 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:39:46:82 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:41:51:14 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:43:20:2 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:45:14:21 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:47:10:18 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:49:23:43 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:51:30:10 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:53:35:2e 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:55:36:c 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:57:18:168 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 11:58:55:9f 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:01:05:16 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:02:32:54 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:03:52:aa 2016-09-19T14:12:55.454+0000 I STORAGE [initandlisten] Placing a marker at optime Sep 19 12:06:18:13 2016-09-19T14:12:55.489+0000 I CONTROL [initandlisten] 2016-09-19T14:12:55.489+0000 I CONTROL [initandlisten] ** WARNING: You are running on a NUMA machine. 2016-09-19T14:12:55.489+0000 I CONTROL [initandlisten] ** We suggest launching mongod like this to avoid performance problems: 2016-09-19T14:12:55.489+0000 I CONTROL [initandlisten] ** numactl --interleave=all mongod [other options] 2016-09-19T14:12:55.489+0000 I CONTROL [initandlisten] 2016-09-19T14:12:55.497+0000 I REPL [initandlisten] Did not find local voted for document at startup; NoMatchingDocument: Did not find replica set lastVote document in local.replset.election 2016-09-19T14:12:55.499+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-09-19T14:12:55.499+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb/appbuilder/diagnostic.data' 2016-09-19T14:12:55.500+0000 I NETWORK [initandlisten] waiting for connections on port 27017 2016-09-19T14:12:55.541+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.148:53044 #1 (1 connection now open) 2016-09-19T14:12:55.541+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.148:53045 #2 (2 connections now open) 2016-09-19T14:12:55.541+0000 I NETWORK [conn1] end connection 172.16.210.148:53044 (0 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56536 #3 (2 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56534 #4 (3 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56533 #5 (4 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56535 #6 (5 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56537 #7 (6 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56531 #8 (7 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56532 #9 (8 connections now open) 2016-09-19T14:12:55.568+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56538 #10 (9 connections now open) 2016-09-19T14:12:55.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56530 #11 (10 connections now open) 2016-09-19T14:12:55.569+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56529 #12 (11 connections now open) 2016-09-19T14:12:55.763+0000 I NETWORK [initandlisten] connection accepted from 10.14.8.10:40134 #13 (12 connections now open) 2016-09-19T14:12:55.937+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41981 #14 (13 connections now open) 2016-09-19T14:12:55.937+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41982 #15 (14 connections now open) 2016-09-19T14:12:55.937+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41983 #16 (15 connections now open) 2016-09-19T14:12:55.937+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41987 #17 (16 connections now open) 2016-09-19T14:12:55.937+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41985 #18 (17 connections now open) 2016-09-19T14:12:55.937+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41989 #19 (18 connections now open) 2016-09-19T14:12:55.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41984 #20 (19 connections now open) 2016-09-19T14:12:55.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41988 #21 (20 connections now open) 2016-09-19T14:12:55.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41986 #22 (21 connections now open) 2016-09-19T14:12:55.938+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.19:41990 #23 (22 connections now open) 2016-09-19T14:12:55.939+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.153:37555 #24 (23 connections now open) 2016-09-19T14:12:55.946+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:59183 #25 (24 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43217 #26 (25 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43219 #27 (26 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43218 #28 (27 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43220 #29 (28 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43222 #30 (29 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43221 #31 (30 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43223 #32 (31 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43225 #33 (32 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43224 #34 (33 connections now open) 2016-09-19T14:12:55.978+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43226 #35 (34 connections now open) 2016-09-19T14:12:55.979+0000 I NETWORK [conn26] end connection 172.16.209.121:43217 (33 connections now open) 2016-09-19T14:12:55.979+0000 I NETWORK [conn28] end connection 172.16.209.121:43218 (32 connections now open) 2016-09-19T14:12:55.979+0000 I NETWORK [conn31] end connection 172.16.209.121:43221 (31 connections now open) 2016-09-19T14:12:55.979+0000 I NETWORK [conn34] end connection 172.16.209.121:43224 (30 connections now open) 2016-09-19T14:12:55.982+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57837 #36 (31 connections now open) 2016-09-19T14:12:55.982+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43227 #37 (32 connections now open) 2016-09-19T14:12:55.982+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43229 #38 (33 connections now open) 2016-09-19T14:12:55.982+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43228 #39 (34 connections now open) 2016-09-19T14:12:55.982+0000 I NETWORK [conn37] end connection 172.16.209.121:43227 (33 connections now open) 2016-09-19T14:12:55.983+0000 I NETWORK [conn39] end connection 172.16.209.121:43228 (32 connections now open) 2016-09-19T14:12:55.983+0000 I NETWORK [conn38] end connection 172.16.209.121:43229 (31 connections now open) 2016-09-19T14:12:55.986+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59756 #40 (32 connections now open) 2016-09-19T14:12:55.989+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43231 #41 (33 connections now open) 2016-09-19T14:12:55.992+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43233 #42 (34 connections now open) 2016-09-19T14:12:55.992+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43232 #43 (35 connections now open) 2016-09-19T14:12:55.992+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43234 #44 (36 connections now open) 2016-09-19T14:12:55.992+0000 I NETWORK [conn43] end connection 172.16.209.121:43232 (35 connections now open) 2016-09-19T14:12:55.992+0000 I NETWORK [conn42] end connection 172.16.209.121:43233 (34 connections now open) 2016-09-19T14:12:55.992+0000 I NETWORK [conn44] end connection 172.16.209.121:43234 (33 connections now open) 2016-09-19T14:12:55.998+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "wix_appbuilder", version: 278987, members: [ { _id: 17, host: "172.16.210.105:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "dedb07-05.aus.wixpress.com", use: "delayed", version: "mongo3" }, slaveDelay: 21600, votes: 0 }, { _id: 18, host: "10.14.8.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo8-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 19, host: "172.16.203.1:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "bs3-appbuilder.aus.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 9, host: "10.15.2.19:27017", arbiterOnly: false, buildIndexes: true, hidden: true, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vac.aws.wixpress.com", use: "backup", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 8, host: "10.14.9.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 10.0, tags: { dc: "tam", engine: "wiredTiger", host: "neo9-05.tam.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 7, host: "10.15.4.19:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "aus", engine: "wiredTiger", host: "neo8-05.vae.aws.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 }, { _id: 20, host: "172.16.4.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 20.0, tags: { host: "bidb4-05.aus.wixpress.com", dc: "aus", engine: "wiredTiger", use: "bi", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 21, host: "172.16.28.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 50.0, tags: { dc: "aus", engine: "wiredTiger", host: "db28-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 22, host: "172.16.24.5:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 80.0, tags: { dc: "aus", engine: "wiredTiger", host: "db24-05.aus.wixpress.com", use: "prod", version: "mongo3.0.12" }, slaveDelay: 0, votes: 1 }, { _id: 23, host: "10.12.103.15:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: { dc: "ams", host: "db3-05.ams.wixpress.com", use: "dev_read_only", engine: "wiredTiger", version: "mongo3.0.12" }, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-09-19T14:12:55.998+0000 I REPL [ReplicationExecutor] This node is 172.16.4.5:27017 in the config 2016-09-19T14:12:55.998+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-09-19T14:12:55.998+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-09-19T14:12:55.998+0000 I COMMAND [conn2] command admin.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 457ms 2016-09-19T14:12:55.998+0000 I COMMAND [conn12] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 429ms 2016-09-19T14:12:55.998+0000 I COMMAND [conn5] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 430ms 2016-09-19T14:12:55.998+0000 I COMMAND [conn9] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 429ms 2016-09-19T14:12:55.998+0000 I COMMAND [conn6] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 430ms 2016-09-19T14:12:55.998+0000 I COMMAND [conn3] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:578 locks:{} protocol:op_query 430ms 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.210.105:27017 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.8.15:27017 2016-09-19T14:12:55.999+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.203.1:27017 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.2.19:27017 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.14.9.15:27017 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.15.4.19:27017 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.28.5:27017 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 172.16.24.5:27017 2016-09-19T14:12:55.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to 10.12.103.15:27017 2016-09-19T14:12:56.000+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.24.5:27017 2016-09-19T14:12:56.000+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.28.5:27017 2016-09-19T14:12:56.000+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.203.1:27017 2016-09-19T14:12:56.000+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-09-19T14:12:56.000+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.148:53062 #45 (34 connections now open) 2016-09-19T14:12:56.000+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 172.16.210.105:27017 2016-09-19T14:12:56.000+0000 I REPL [ReplicationExecutor] Member 172.16.24.5:27017 is now in state PRIMARY 2016-09-19T14:12:56.000+0000 I REPL [ReplicationExecutor] Member 172.16.28.5:27017 is now in state SECONDARY 2016-09-19T14:12:56.000+0000 I REPL [ReplicationExecutor] Member 172.16.203.1:27017 is now in state SECONDARY 2016-09-19T14:12:56.000+0000 I REPL [ReplicationExecutor] Member 172.16.210.105:27017 is now in state RECOVERING 2016-09-19T14:12:56.002+0000 I NETWORK [conn45] end connection 172.16.210.148:53062 (33 connections now open) 2016-09-19T14:12:56.002+0000 I NETWORK [conn2] end connection 172.16.210.148:53045 (33 connections now open) 2016-09-19T14:12:56.002+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43235 #46 (35 connections now open) 2016-09-19T14:12:56.002+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43236 #47 (34 connections now open) 2016-09-19T14:12:56.002+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.121:43237 #48 (35 connections now open) 2016-09-19T14:12:56.061+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.4.19:27017 2016-09-19T14:12:56.063+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.15.2.19:27017 2016-09-19T14:12:56.068+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.9.15:27017 2016-09-19T14:12:56.069+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.14.8.15:27017 2016-09-19T14:12:56.093+0000 I REPL [ReplicationExecutor] Member 10.15.4.19:27017 is now in state SECONDARY 2016-09-19T14:12:56.094+0000 I REPL [ReplicationExecutor] Member 10.15.2.19:27017 is now in state SECONDARY 2016-09-19T14:12:56.103+0000 I REPL [ReplicationExecutor] Member 10.14.9.15:27017 is now in state SECONDARY 2016-09-19T14:12:56.103+0000 I REPL [ReplicationExecutor] Member 10.14.8.15:27017 is now in state SECONDARY 2016-09-19T14:12:56.159+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60204 #49 (36 connections now open) 2016-09-19T14:12:56.160+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60209 #50 (37 connections now open) 2016-09-19T14:12:56.160+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60205 #51 (38 connections now open) 2016-09-19T14:12:56.160+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60207 #52 (39 connections now open) 2016-09-19T14:12:56.161+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60206 #53 (40 connections now open) 2016-09-19T14:12:56.161+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60203 #54 (41 connections now open) 2016-09-19T14:12:56.161+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60208 #55 (42 connections now open) 2016-09-19T14:12:56.161+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60210 #56 (43 connections now open) 2016-09-19T14:12:56.161+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60211 #57 (44 connections now open) 2016-09-19T14:12:56.161+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.84:60212 #58 (45 connections now open) 2016-09-19T14:12:56.218+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.84:39561 #59 (46 connections now open) 2016-09-19T14:12:56.228+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to 10.12.103.15:27017 2016-09-19T14:12:56.310+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.164:58985 #60 (47 connections now open) 2016-09-19T14:12:56.342+0000 I REPL [ReplicationExecutor] Member 10.12.103.15:27017 is now in state STARTUP2 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59758 #61 (48 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59759 #62 (49 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59760 #63 (50 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59761 #64 (51 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59762 #65 (52 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59763 #66 (53 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59764 #67 (54 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59765 #68 (55 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59767 #69 (56 connections now open) 2016-09-19T14:12:56.444+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.48:59766 #70 (57 connections now open) 2016-09-19T14:12:56.671+0000 I NETWORK [initandlisten] connection accepted from 10.15.4.18:61944 #71 (58 connections now open) 2016-09-19T14:12:56.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58676 #72 (59 connections now open) 2016-09-19T14:12:56.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58677 #73 (60 connections now open) 2016-09-19T14:12:56.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58678 #74 (61 connections now open) 2016-09-19T14:12:56.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58679 #75 (62 connections now open) 2016-09-19T14:12:56.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58680 #76 (63 connections now open) 2016-09-19T14:12:56.847+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58681 #77 (64 connections now open) 2016-09-19T14:12:56.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58682 #78 (65 connections now open) 2016-09-19T14:12:56.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58683 #79 (66 connections now open) 2016-09-19T14:12:56.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58684 #80 (67 connections now open) 2016-09-19T14:12:56.848+0000 I NETWORK [initandlisten] connection accepted from 172.16.213.139:58685 #81 (68 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57843 #82 (69 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57844 #83 (70 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57845 #84 (71 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57846 #85 (72 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57847 #86 (73 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57848 #87 (74 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57849 #88 (75 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57850 #89 (76 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57851 #90 (77 connections now open) 2016-09-19T14:12:56.878+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.49:57852 #91 (78 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63443 #92 (79 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63445 #93 (80 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63444 #94 (81 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63446 #95 (82 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63447 #96 (83 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63448 #97 (84 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63449 #98 (85 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63450 #99 (86 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63452 #100 (87 connections now open) 2016-09-19T14:12:56.889+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63451 #101 (88 connections now open) 2016-09-19T14:12:57.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46063 #102 (89 connections now open) 2016-09-19T14:12:57.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46064 #103 (90 connections now open) 2016-09-19T14:12:57.065+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46066 #104 (91 connections now open) 2016-09-19T14:12:57.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46067 #105 (92 connections now open) 2016-09-19T14:12:57.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46072 #106 (93 connections now open) 2016-09-19T14:12:57.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46070 #107 (94 connections now open) 2016-09-19T14:12:57.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46065 #108 (95 connections now open) 2016-09-19T14:12:57.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46068 #109 (96 connections now open) 2016-09-19T14:12:57.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46069 #110 (97 connections now open) 2016-09-19T14:12:57.066+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46071 #111 (98 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62967 #112 (99 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62969 #113 (100 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62971 #114 (101 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62975 #115 (102 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62973 #116 (103 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62977 #117 (104 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62970 #118 (105 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62974 #119 (106 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62972 #120 (107 connections now open) 2016-09-19T14:12:57.136+0000 I NETWORK [initandlisten] connection accepted from 172.16.144.88:62976 #121 (108 connections now open) 2016-09-19T14:12:57.265+0000 I NETWORK [initandlisten] connection accepted from 10.14.9.10:57322 #122 (109 connections now open) 2016-09-19T14:12:57.407+0000 I NETWORK [initandlisten] connection accepted from 10.15.2.18:56756 #123 (110 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42748 #124 (111 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42750 #125 (112 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42747 #126 (113 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42749 #127 (114 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42752 #128 (115 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42751 #129 (116 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42755 #130 (117 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42753 #131 (118 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42754 #132 (119 connections now open) 2016-09-19T14:12:57.475+0000 I NETWORK [initandlisten] connection accepted from 172.16.209.164:42756 #133 (120 connections now open) 2016-09-19T14:12:57.533+0000 I NETWORK [initandlisten] connection accepted from 10.12.103.1:61334 #134 (121 connections now open) 2016-09-19T14:12:58.144+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.89:56577 #135 (122 connections now open) 2016-09-19T14:12:58.291+0000 I NETWORK [initandlisten] connection accepted from 172.16.222.226:63463 #136 (123 connections now open) 2016-09-19T14:12:58.327+0000 I NETWORK [initandlisten] connection accepted from 172.16.210.100:59186 #137 (124 connections now open) 2016-09-19T14:12:58.328+0000 I NETWORK [conn137] end connection 172.16.210.100:59186 (123 connections now open) 2016-09-19T14:12:58.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46651 #138 (124 connections now open) 2016-09-19T14:12:58.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46648 #139 (125 connections now open) 2016-09-19T14:12:58.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46649 #140 (126 connections now open) 2016-09-19T14:12:58.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46645 #141 (127 connections now open) 2016-09-19T14:12:58.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46650 #142 (128 connections now open) 2016-09-19T14:12:58.378+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46646 #143 (129 connections now open) 2016-09-19T14:12:58.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46647 #144 (130 connections now open) 2016-09-19T14:12:58.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46644 #145 (131 connections now open) 2016-09-19T14:12:58.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46653 #146 (132 connections now open) 2016-09-19T14:12:58.379+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.51:46652 #147 (133 connections now open) 2016-09-19T14:12:58.999+0000 I REPL [ReplicationExecutor] syncing from: 172.16.24.5:27017 2016-09-19T14:12:59.000+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to 172.16.24.5:27017 2016-09-19T14:12:59.000+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to 172.16.24.5:27017 2016-09-19T14:12:59.001+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to 172.16.24.5:27017 2016-09-19T14:12:59.001+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update, response: { ok: 0.0, errmsg: "Unexpected field durableOpTime in UpdateInfoArgs", code: 2 } 2016-09-19T14:12:59.001+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback falling back to old style UpdatePosition command 2016-09-19T14:12:59.187+0000 I NETWORK [initandlisten] connection accepted from 10.14.0.88:46099 #148 (134 connections now open) 2016-09-19T14:12:59.255+0000 I - [NetworkInterfaceASIO-BGSync-0] Assertion: 10334:BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 102676606954 2016-09-19T14:12:59.266+0000 I CONTROL [NetworkInterfaceASIO-BGSync-0] 0x130c4a2 0x12a7248 0x128efe8 0x128f09c 0x973949 0xda2484 0x10abf65 0x10b75fb 0x10b929c 0x10b98a8 0x10b7040 0x108a750 0x10994ac 0x1099968 0x1329e71 0x132a091 0x132e22f 0x10aeda5 0x1b431c0 0x7fd92c3b7b50 0x7fd92c101fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EA7248","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"E8EFE8","s":"_ZN5mongo11msgassertedEiPKc"},{"b":"400000","o":"E8F09C"},{"b":"400000","o":"573949","s":"_ZNK5mongo7BSONObj14_assertInvalidEv"},{"b":"400000","o":"9A2484","s":"_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE"},{"b":"400000","o":"CABF65","s":"_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE"},{"b":"400000","o":"CB75FB","s":"_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE"},{"b":"400000","o":"CB929C","s":"_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE"},{"b":"400000","o":"CB98A8"},{"b":"400000","o":"CB7040"},{"b":"400000","o":"C8A750","s":"_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C994AC","s":"_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_"},{"b":"400000","o":"C99968","s":"_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m"},{"b":"400000","o":"F29E71","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"400000","o":"F2A091","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"400000","o":"F2E22F","s":"_ZN4asio10io_service3runEv"},{"b":"400000","o":"CAEDA5"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7FD92C3B1000","o":"6B50"},{"b":"7FD92C024000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFC2FCFE000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7FD92D26A000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7FD92CE71000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7FD92CC69000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7FD92CA65000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7FD92C7E3000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7FD92C5CD000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7FD92C3B1000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7FD92C024000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7FD92D4C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7FD92BE0D000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(_ZN5mongo10logContextEPKc+0x138) [0x12a7248] mongod(_ZN5mongo11msgassertedEiPKc+0x88) [0x128efe8] mongod(+0xE8F09C) [0x128f09c] mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x3B9) [0x973949] mongod(_ZN5mongo27appendGetMoreResponseObjectExNS_10StringDataENS_9BSONArrayEPNS_14BSONObjBuilderE+0x514) [0xda2484] mongod(_ZN5mongo8executor30upconvertLegacyGetMoreResponseEjNS_10StringDataERKNS_7MessageE+0x145) [0x10abf65] mongod(_ZN5mongo8executor20NetworkInterfaceASIO12AsyncCommand8responseENS_3rpc8ProtocolENS_6Date_tEPNS3_18EgressMetadataHookE+0x18B) [0x10b75fb] mongod(_ZN5mongo8executor20NetworkInterfaceASIO20_completedOpCallbackEPNS1_7AsyncOpE+0x5C) [0x10b929c] mongod(+0xCB98A8) [0x10b98a8] mongod(+0xCB7040) [0x10b7040] mongod(_ZN4asio6detail14strand_service8dispatchINS0_7binder2IRSt8functionIFvSt10error_codemEES5_mEEEEvRPNS1_11strand_implERT_+0x70) [0x108a750] mongod(_ZN4asio6detail14strand_service8dispatchINS0_17rewrapped_handlerINS0_7binder2INS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS8_EEEENS_17mutable_buffers_1ENS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEESI_mEESK_EEEEvRPNS1_11strand_implERT_+0x89C) [0x10994ac] mongod(_ZN4asio6detail23reactive_socket_recv_opINS_17mutable_buffers_1ENS0_7read_opINS_19basic_stream_socketINS_2ip3tcpENS_21stream_socket_serviceIS6_EEEES2_NS0_14transfer_all_tENS0_15wrapped_handlerINS_10io_service6strandESt8functionIFvSt10error_codemEENS0_26is_continuation_if_runningEEEEEE11do_completeEPvPNS0_19scheduler_operationERKSF_m+0x228) [0x1099968] mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x2F1) [0x1329e71] mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xC1) [0x132a091] mongod(_ZN4asio10io_service3runEv+0x2F) [0x132e22f] mongod(+0xCAEDA5) [0x10aeda5] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7fd92c3b7b50] libc.so.6(clone+0x6D) [0x7fd92c101fbd] ----- END BACKTRACE ----- 2016-09-19T14:12:59.267+0000 F ASIO [NetworkInterfaceASIO-BGSync-0] Uncaught exception in NetworkInterfaceASIO IO worker thread of type: Location10334: BSONObj size: 17320219 (0x108491B) is invalid. Size must be between 0 and 16793600(16MB) First element: id: 102676606954 2016-09-19T14:12:59.267+0000 I - [NetworkInterfaceASIO-BGSync-0] Fatal Assertion 28820 2016-09-19T14:12:59.267+0000 I - [NetworkInterfaceASIO-BGSync-0] ***aborting after fassert() failure 2016-09-19T14:12:59.270+0000 F - [NetworkInterfaceASIO-BGSync-0] Got signal: 6 (Aborted). 0x130c4a2 0x130b3c9 0x130bbd2 0x7fd92c3c00a0 0x7fd92c056125 0x7fd92c0593a0 0x128e902 0x10aef93 0x1b431c0 0x7fd92c3b7b50 0x7fd92c101fbd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"F0C4A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"F0B3C9"},{"b":"400000","o":"F0BBD2"},{"b":"7FD92C3B1000","o":"F0A0"},{"b":"7FD92C024000","o":"32125","s":"gsignal"},{"b":"7FD92C024000","o":"353A0","s":"abort"},{"b":"400000","o":"E8E902","s":"_ZN5mongo13fassertFailedEi"},{"b":"400000","o":"CAEF93"},{"b":"400000","o":"17431C0","s":"execute_native_thread_routine"},{"b":"7FD92C3B1000","o":"6B50"},{"b":"7FD92C024000","o":"DDFBD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.9", "gitVersion" : "22ec9e93b40c85fc7cae7d56e7d6a02fd811088c", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.73-2+deb7u2", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "9A35851B156CCAF69D719418740E962817B11EA7" }, { "b" : "7FFC2FCFE000", "elfType" : 3, "buildId" : "000E93FBF194E9B9370E69572D55070F81BD1815" }, { "b" : "7FD92D26A000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "16DA62C831D8080E3BCB9A1E7738D399EA3A89C0" }, { "b" : "7FD92CE71000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "079D784F9F4A88B6D87FC3E6B0B07BFBE209540E" }, { "b" : "7FD92CC69000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "07CC333722DC4237B5F88E47A38C214FDA0B9B59" }, { "b" : "7FD92CA65000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "028546D6F23D0FD259928FED6EFE53E64782EF2D" }, { "b" : "7FD92C7E3000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "2C5446FA41E784A1C6FDD528AB2BCC7BCA9EF06C" }, { "b" : "7FD92C5CD000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7FD92C3B1000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "3F3BFFEDAF77C955862785C6CBA7670F82A05563" }, { "b" : "7FD92C024000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "50B9FD83D874F18E3B385E0349FBD5D1281A19E3" }, { "b" : "7FD92D4C9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "37BC6FC6FF3FA04B0A3EC20DFF215AB55EA5F5CB" }, { "b" : "7FD92BE0D000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x130c4a2] mongod(+0xF0B3C9) [0x130b3c9] mongod(+0xF0BBD2) [0x130bbd2] libpthread.so.0(+0xF0A0) [0x7fd92c3c00a0] libc.so.6(gsignal+0x35) [0x7fd92c056125] libc.so.6(abort+0x180) [0x7fd92c0593a0] mongod(_ZN5mongo13fassertFailedEi+0x82) [0x128e902] mongod(+0xCAEF93) [0x10aef93] mongod(execute_native_thread_routine+0x20) [0x1b431c0] libpthread.so.0(+0x6B50) [0x7fd92c3b7b50] libc.so.6(clone+0x6D) [0x7fd92c101fbd] ----- END BACKTRACE -----