Sun Jul 28 12:43:09 [conn1] end connection 10.40.22.17:44290 (2 connections now open) ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:43:14 [conn8] end connection 10.40.22.16:54862 (1 connection now open) Sun Jul 28 12:43:14 [initandlisten] connection accepted from 10.40.22.16:54871 #10 (2 connections now open) Sun Jul 28 12:43:23 [conn9] end connection 10.40.22.17:42260 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:43:28 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: db01srv02.local.:20001 ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:43:29 [rsHealthPoll] replSet member db01srv02.local.:20001 is now in state SECONDARY ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:43:30 [rsHealthPoll] replSet member db01srv02.local.:20001 is now in state SECONDARY Sun Jul 28 12:43:30 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:43:35 [conn4] end connection 10.40.22.16:40016 (1 connection now open) Sun Jul 28 12:43:35 [initandlisten] connection accepted from 10.40.22.16:40021 #5 (2 connections now open) Sun Jul 28 12:43:36 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:43:42 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:43:44 [conn10] end connection 10.40.22.16:54871 (0 connections now open) Sun Jul 28 12:43:44 [initandlisten] connection accepted from 10.40.22.16:54875 #11 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:43:48 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:43:54 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:44:00 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:44:05 [conn5] end connection 10.40.22.16:40021 (1 connection now open) Sun Jul 28 12:44:05 [initandlisten] connection accepted from 10.40.22.16:40025 #6 (2 connections now open) Sun Jul 28 12:44:06 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:44:12 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:44:14 [conn11] end connection 10.40.22.16:54875 (0 connections now open) Sun Jul 28 12:44:14 [initandlisten] connection accepted from 10.40.22.16:54880 #12 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:44:18 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:44:24 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:44:30 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:44:35 [conn6] end connection 10.40.22.16:40025 (1 connection now open) Sun Jul 28 12:44:35 [initandlisten] connection accepted from 10.40.22.16:40031 #7 (2 connections now open) Sun Jul 28 12:44:36 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:44:41 [rsMgr] replSet I don't see a primary and I can't elect myself ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:44:42 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:44:44 [conn12] end connection 10.40.22.16:54880 (0 connections now open) Sun Jul 28 12:44:44 [initandlisten] connection accepted from 10.40.22.16:54885 #13 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:44:48 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:44:54 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:00 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:05 [conn7] end connection 10.40.22.16:40031 (1 connection now open) Sun Jul 28 12:45:05 [initandlisten] connection accepted from 10.40.22.16:40035 #8 (2 connections now open) Sun Jul 28 12:45:06 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:12 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:45:14 [conn13] end connection 10.40.22.16:54885 (0 connections now open) Sun Jul 28 12:45:14 [initandlisten] connection accepted from 10.40.22.16:54890 #14 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:45:18 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:24 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:30 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:35 [conn8] end connection 10.40.22.16:40035 (1 connection now open) Sun Jul 28 12:45:35 [initandlisten] connection accepted from 10.40.22.16:40040 #9 (2 connections now open) Sun Jul 28 12:45:36 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:42 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:45:44 [conn14] end connection 10.40.22.16:54890 (0 connections now open) Sun Jul 28 12:45:44 [initandlisten] connection accepted from 10.40.22.16:54894 #15 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:45:48 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:45:54 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:46:00 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:46:05 [conn9] end connection 10.40.22.16:40040 (1 connection now open) Sun Jul 28 12:46:05 [initandlisten] connection accepted from 10.40.22.16:40044 #10 (2 connections now open) Sun Jul 28 12:46:06 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:11 [rsMgr] replSet I don't see a primary and I can't elect myself ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:12 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:14 [conn15] end connection 10.40.22.16:54894 (0 connections now open) Sun Jul 28 12:46:14 [initandlisten] connection accepted from 10.40.22.16:54899 #16 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:18 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:46:24 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:46:30 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' Sun Jul 28 12:46:35 [conn10] end connection 10.40.22.16:40044 (1 connection now open) Sun Jul 28 12:46:35 [initandlisten] connection accepted from 10.40.22.16:40050 #11 (2 connections now open) Sun Jul 28 12:46:36 [rsMgr] not electing self, db01srv02.local.:20001 would veto with 'I don't think db01srv01.local.:10001 is electable' ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:39 [initandlisten] connection accepted from 10.40.22.17:42264 #17 (2 connections now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:39 [initandlisten] connection accepted from 10.40.22.17:44296 #12 (3 connections now open) ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:39 [conn17] end connection 10.40.22.17:42264 (1 connection now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:39 [conn12] end connection 10.40.22.17:44296 (2 connections now open) ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:39 [initandlisten] connection accepted from 10.40.22.17:42266 #18 (2 connections now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:39 [initandlisten] connection accepted from 10.40.22.17:44298 #13 (3 connections now open) Sun Jul 28 12:46:42 [rsMgr] replSet info electSelf 0 ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:42 [conn16] replSet info voting yea for db01srv01.local.:10001 (0) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:42 [rsMgr] replSet PRIMARY ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:43 [rsHealthPoll] replSet member db01srv01.local.:10001 is now in state PRIMARY ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:43 [initandlisten] connection accepted from 10.40.22.17:44299 #14 (4 connections now open) ==> db01arb01/logs/db01arb01.log <== Sun Jul 28 12:46:44 [conn16] end connection 10.40.22.16:54899 (1 connection now open) Sun Jul 28 12:46:44 [initandlisten] connection accepted from 10.40.22.16:54904 #19 (2 connections now open) ==> db01srv01/logs/db01srv01.log <== Sun Jul 28 12:46:45 [conn13] end connection 10.40.22.17:44298 (3 connections now open) Sun Jul 28 12:46:45 [initandlisten] connection accepted from 10.40.22.17:44300 #15 (4 connections now open) ============================================================== Sun Jul 28 12:43:14.711 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:14.711 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:14.712 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:14.712 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:14.712 [rsHealthPoll] replset info db01srv01.local.:10001 heartbeat failed, retrying Sun Jul 28 12:43:14.713 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:14.713 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:14.713 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:14.713 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:14.714 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:14.715 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:14.715 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:14.715 [rsHealthPoll] replSet info db01srv01.local.:10001 is down (or slow to respond): Sun Jul 28 12:43:14.715 [rsHealthPoll] replSet member db01srv01.local.:10001 is now in state DOWN Sun Jul 28 12:43:16.716 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known . . . Sun Jul 28 12:43:28.719 [rsHealthPoll] couldn't connect to db01arb01.local.:30001: couldn't connect to server db01arb01.local.:30001 Sun Jul 28 12:43:28.719 [rsHealthPoll] replSet info db01arb01.local.:30001 is down (or slow to respond): Sun Jul 28 12:43:28.719 [rsHealthPoll] replSet member db01arb01.local.:30001 is now in state DOWN Sun Jul 28 12:43:28.719 [rsMgr] can't see a majority of the set, relinquishing primary Sun Jul 28 12:43:28.719 [rsMgr] replSet relinquishing primary state Sun Jul 28 12:43:28.719 [rsMgr] replSet SECONDARY Sun Jul 28 12:43:28.719 [rsMgr] replSet closing client sockets after relinquishing primary Sun Jul 28 12:43:28.746 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:28.746 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:28.747 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:28.747 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:28.748 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:28.748 [rsHealthPoll] replset info db01srv01.local.:10001 heartbeat failed, retrying Sun Jul 28 12:43:28.749 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:28.749 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:28.749 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:28.750 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:28.750 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:43:28.750 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:43:30.722 [rsHealthPoll] replset info db01arb01.local.:30001 heartbeat failed, retrying . . . Sun Jul 28 12:46:29.174 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:46:37.192 [rsHealthPoll] replset info db01arb01.local.:30001 heartbeat failed, retrying Sun Jul 28 12:46:37.193 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:46:37.193 [rsHealthPoll] replset info db01srv01.local.:10001 heartbeat failed, retrying Sun Jul 28 12:46:37.193 [rsHealthPoll] getaddrinfo("db01arb01.local.") failed: Name or service not known Sun Jul 28 12:46:37.193 [rsHealthPoll] couldn't connect to db01arb01.local.:30001: couldn't connect to server db01arb01.local.:30001 Sun Jul 28 12:46:37.193 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:46:37.193 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:46:37.194 [rsHealthPoll] getaddrinfo("db01arb01.local.") failed: Name or service not known Sun Jul 28 12:46:37.194 [rsHealthPoll] couldn't connect to db01arb01.local.:30001: couldn't connect to server db01arb01.local.:30001 Sun Jul 28 12:46:37.194 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:46:37.194 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:46:37.194 [rsHealthPoll] getaddrinfo("db01arb01.local.") failed: Name or service not known Sun Jul 28 12:46:37.194 [rsHealthPoll] couldn't connect to db01arb01.local.:30001: couldn't connect to server db01arb01.local.:30001 Sun Jul 28 12:46:37.194 [rsHealthPoll] getaddrinfo("db01srv01.local.") failed: Name or service not known Sun Jul 28 12:46:37.194 [rsHealthPoll] couldn't connect to db01srv01.local.:10001: couldn't connect to server db01srv01.local.:10001 Sun Jul 28 12:46:39.196 [rsHealthPoll] replSet member db01arb01.local.:30001 is up Sun Jul 28 12:46:39.196 [rsHealthPoll] replSet member db01arb01.local.:30001 is now in state ARBITER Sun Jul 28 12:46:39.196 [rsHealthPoll] replSet member db01srv01.local.:10001 is up Sun Jul 28 12:46:39.196 [rsHealthPoll] replSet member db01srv01.local.:10001 is now in state SECONDARY Sun Jul 28 12:46:39.197 [rsMgr] not electing self, db01arb01.local.:30001 would veto Sun Jul 28 12:46:39.197 [rsMgr] not electing self, db01arb01.local.:30001 would veto Sun Jul 28 12:46:42.592 [conn30] replSet info voting yea for db01srv01.local.:10001 (0) Sun Jul 28 12:46:43.197 [rsHealthPoll] replSet member db01srv01.local.:10001 is now in state PRIMARY Sun Jul 28 12:46:43.738 [rsBackgroundSync] replSet syncing to: db01srv01.local.:10001 Sun Jul 28 12:46:49.365 [conn29] end connection 10.40.22.16:54738 (3 connections now open)