2016-01-11T09:03:06.567Z I REPL     [ReplicationExecutor] Standing for election
2016-01-11T09:03:06.761Z I REPL     [ReplicationExecutor] not electing self, jermongo-arb:27017 would veto with 'jermongo1:27017 is trying to elect itself but jermongo2:27017 is already primary and more up-to-date'
2016-01-11T09:03:06.761Z I REPL     [ReplicationExecutor] not electing self, we are not freshest
2016-01-11T09:03:07.178Z I REPL     [ReplicationExecutor] Standing for election
2016-01-11T09:03:07.351Z I REPL     [ReplicationExecutor] not electing self, jermongo-arb:27017 would veto with 'jermongo1:27017 is trying to elect itself but jermongo2:27017 is already primary and more up-to-date'
2016-01-11T09:03:07.351Z I REPL     [ReplicationExecutor] not electing self, we are not freshest
2016-01-11T09:03:09.358Z I REPL     [ReplicationExecutor] Standing for election
2016-01-11T09:03:09.532Z I REPL     [ReplicationExecutor] replSet info electSelf
2016-01-11T09:03:09.735Z I REPL     [ReplicationExecutor] received vote: 1 votes from jermongo-arb:27017
2016-01-11T09:03:09.735Z I REPL     [ReplicationExecutor] replSet election succeeded, assuming primary role
2016-01-11T09:03:09.742Z I REPL     [ReplicationExecutor] transition to PRIMARY
2016-01-11T09:03:25.328Z E REPL     [rsBackgroundSync] sync producer problem: 10278 dbclient error communicating with server: jermongo2:27017
2016-01-11T09:03:25.343Z I REPL     [rsSync] transition to primary complete; database writes are now permitted
2016-01-11T09:03:25.351Z I REPL     [SyncSourceFeedback] SyncSourceFeedback error sending update: DBClientBase::findN: transport error: jermongo2:27017 ns: admin.$cmd query: { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('56803511f04e9af132f6bae2'), optime: Timestamp 1452502725000|2, memberId: 0, cfgver: 7, config: { _id: 0, host: "jermongo1:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } }, { _id: ObjectId('565aeff5462fb7a9fc76aa3d'), optime: Timestamp 1452181108000|1, memberId: 2, cfgver: 7, config: { _id: 2, host: "jermongo2:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } } ] }
2016-01-11T09:23:05.636Z I REPL     [ReplicationExecutor] Member jermongo2:27017 is now in state SECONDARY
2016-01-11T09:23:14.336Z I REPL     [ReplicationExecutor] Member jermongo2:27017 is now in state ROLLBACK
2016-01-11T09:23:23.360Z I REPL     [ReplicationExecutor] Member jermongo2:27017 is now in state RECOVERING
2016-01-11T09:23:27.774Z I REPL     [ReplicationExecutor] Member jermongo2:27017 is now in state SECONDARY
2016-01-11T09:24:43.546Z I REPL     [ReplicationExecutor] Stepping down self (priority 0.5) because jermongo2:27017 has higher priority 1 and is only 7 seconds behind me
2016-01-11T09:24:43.546Z I REPL     [ReplicationExecutor] Stepping down from primary in response to heartbeat
2016-01-11T09:24:43.546Z I REPL     [replCallbackWithGlobalLock-0] transition to SECONDARY
2016-01-11T09:24:44.479Z I -        [rsBackgroundSync] caught exception (socket exception [SEND_ERROR] for jermongo2:27017) in destructor (~PiggyBackData)
2016-01-11T09:24:48.110Z I REPL     [ReplicationExecutor] replSetElect voting yea for jermongo2:27017 (2)
2016-01-11T09:24:50.078Z I REPL     [ReplicationExecutor] Member jermongo2:27017 is now in state PRIMARY
2016-01-11T09:24:57.482Z I REPL     [ReplicationExecutor] syncing from: jermongo2:27017
2016-01-11T09:24:58.949Z I REPL     [SyncSourceFeedback] replset setting syncSourceFeedback to jermongo2:27017
2016-01-11T10:08:00.879Z I INDEX    [repl writer worker 3] build index on: JER_SIGNALS.test_ndfd_weather_forecast properties: { v: 1, unique: true, key: { pid: 1, ts: 1 }, name: "pid_ts_1_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast" }
2016-01-11T10:08:00.879Z I INDEX    [repl writer worker 3]      building index using bulk method
2016-01-11T10:08:00.912Z I INDEX    [repl writer worker 3] build index done.  scanned 0 total records. 0 secs
2016-01-11T10:08:00.938Z I INDEX    [repl writer worker 3] build index on: JER_SIGNALS.test_ndfd_weather_forecast properties: { v: 1, key: { ts: 1 }, name: "ts_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast" }
2016-01-11T10:08:00.938Z I INDEX    [repl writer worker 3]      building index using bulk method
2016-01-11T10:08:00.971Z I INDEX    [repl writer worker 3] build index done.  scanned 0 total records. 0 secs
2016-01-11T11:56:42.319Z I INDEX    [repl writer worker 13] build index on: JER_SIGNALS.test_ndfd_weather_forecast_ properties: { v: 1, unique: true, key: { pid: 1, ts: 1 }, name: "pid_ts_1_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast_" }
2016-01-11T11:56:42.319Z I INDEX    [repl writer worker 13]      building index using bulk method
2016-01-11T11:56:42.351Z I INDEX    [repl writer worker 13] build index done.  scanned 0 total records. 0 secs
2016-01-11T11:56:42.377Z I INDEX    [repl writer worker 13] build index on: JER_SIGNALS.test_ndfd_weather_forecast_ properties: { v: 1, key: { ts: 1 }, name: "ts_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast_" }
2016-01-11T11:56:42.377Z I INDEX    [repl writer worker 13]      building index using bulk method
2016-01-11T11:56:42.409Z I INDEX    [repl writer worker 13] build index done.  scanned 0 total records. 0 secs
2016-01-11T13:05:15.799Z I INDEX    [repl writer worker 9] build index on: JER_SIGNALS.test_ndfd_weather_forecast_ properties: { v: 1, unique: true, key: { pid: 1, ts: 1 }, name: "pid_ts_1_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast_" }
2016-01-11T13:05:15.799Z I INDEX    [repl writer worker 9]      building index using bulk method
2016-01-11T13:05:15.832Z I INDEX    [repl writer worker 9] build index done.  scanned 0 total records. 0 secs
2016-01-11T13:05:15.857Z I INDEX    [repl writer worker 9] build index on: JER_SIGNALS.test_ndfd_weather_forecast_ properties: { v: 1, key: { ts: 1 }, name: "ts_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast_" }
2016-01-11T13:05:15.857Z I INDEX    [repl writer worker 9]      building index using bulk method
2016-01-11T13:05:15.890Z I INDEX    [repl writer worker 9] build index done.  scanned 0 total records. 0 secs
2016-01-11T13:10:46.041Z I INDEX    [repl writer worker 0] build index on: JER_SIGNALS.test_ndfd_weather_forecast_ properties: { v: 1, unique: true, key: { pid: 1, ts: 1 }, name: "pid_ts_1_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast_" }
2016-01-11T13:10:46.041Z I INDEX    [repl writer worker 0]      building index using bulk method
2016-01-11T13:10:46.066Z I INDEX    [repl writer worker 0] build index done.  scanned 0 total records. 0 secs
2016-01-11T13:10:46.091Z I INDEX    [repl writer worker 0] build index on: JER_SIGNALS.test_ndfd_weather_forecast_ properties: { v: 1, key: { ts: 1 }, name: "ts_1", ns: "JER_SIGNALS.test_ndfd_weather_forecast_" }
2016-01-11T13:10:46.091Z I INDEX    [repl writer worker 0]      building index using bulk method
2016-01-11T13:10:46.116Z I INDEX    [repl writer worker 0] build index done.  scanned 0 total records. 0 secs
2016-01-11T13:49:30.684Z E REPL     [rsBackgroundSync] sync producer problem: 10278 dbclient error communicating with server: jermongo2:27017
2016-01-11T13:49:30.684Z I -        [rsBackgroundSync] caught exception (socket exception [SEND_ERROR] for jermongo2:27017) in destructor (~PiggyBackData)
2016-01-11T13:49:30.684Z I REPL     [ReplicationExecutor] syncing from: jermongo2:27017
2016-01-11T13:49:30.684Z I REPL     [SyncSourceFeedback] SyncSourceFeedback error sending update: DBClientBase::findN: transport error: jermongo2:27017 ns: admin.$cmd query: { replSetUpdatePosition: 1, optimes: [ { _id: ObjectId('56803511f04e9af132f6bae2'), optime: Timestamp 1452517924000|148, memberId: 0, cfgver: 7, config: { _id: 0, host: "jermongo1:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } }, { _id: ObjectId('565aeff5462fb7a9fc76aa3d'), optime: Timestamp 1452504283000|4, memberId: 2, cfgver: 7, config: { _id: 2, host: "jermongo2:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } } ] }
2016-01-11T13:49:30.862Z I REPL     [rsBackgroundSync] repl: couldn't connect to server jermongo2:27017 (jermongo2), connection attempt failed
2016-01-11T13:49:30.862Z I REPL     [ReplicationExecutor] could not find member to sync from
2016-01-11T13:49:31.143Z I REPL     [ReplicationExecutor] Standing for election
2016-01-11T13:49:31.377Z I REPL     [ReplicationExecutor] replSet info electSelf
2016-01-11T13:49:31.622Z I REPL     [ReplicationExecutor] received vote: 1 votes from jermongo-arb:27017
2016-01-11T13:49:31.622Z I REPL     [ReplicationExecutor] replSet election succeeded, assuming primary role
2016-01-11T13:49:31.622Z I REPL     [ReplicationExecutor] transition to PRIMARY
2016-01-11T13:49:32.201Z I REPL     [rsSync] transition to primary complete; database writes are now permitted
2016-01-11T13:55:05.718Z I REPL     [ReplicationExecutor] Member jermongo2:27017 is now in state SECONDARY
2016-01-11T13:55:12.242Z I REPL     [ReplicationExecutor] Member jermongo2:27017 is now in state ROLLBACK