2016-03-13T08:53:35.844+0000 I SHARDING [conn2835] metadata of collection mydomain.Sessions already up to date (shard version : 30553|1||563ba74d869758a4542b9075, took 112ms) 2016-03-13T08:53:35.844+0000 I SHARDING [conn2977] collection version was loaded at version 30553|1||563ba74d869758a4542b9075, took 112ms 2016-03-13T08:53:35.844+0000 I SHARDING [conn1154] metadata of collection mydomain.Sessions already up to date (shard version : 30553|1||563ba74d869758a4542b9075, took 112ms) 2016-03-13T08:53:39.135+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:53:36.539+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:53:42.512+0000 I NETWORK [initandlisten] connection accepted from 10.0.69.42:46059 #3338 (3056 connections now open) 2016-03-13T08:53:42.843+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560876e2e5aec60e69ca1d42') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560877c7584ad16218d0cbf3') } 2016-03-13T08:53:42.867+0000 I NETWORK [initandlisten] connection accepted from 10.0.69.42:46060 #3339 (3057 connections now open) 2016-03-13T08:53:43.152+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560877c7584ad16218d0cbf3') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560878ac5366dd0e48f4d604') }, with opId: 768232744 2016-03-13T08:53:43.695+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30553000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:53:43.979+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }) in mydomain.Sessions', ts : 56e52a972848c4eacbd0104b 2016-03-13T08:53:43.979+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30553|1||563ba74d869758a4542b9075, current metadata version is 30553|1||563ba74d869758a4542b9075 2016-03-13T08:53:44.092+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30553|1||563ba74d869758a4542b9075, took 109ms) 2016-03-13T08:53:44.123+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:53:44.123+0000-56e52a982848c4eacbd0104c", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859224123), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:53:44.149+0000 I SHARDING [conn176] moveChunk request accepted at version 30553|1||563ba74d869758a4542b9075 2016-03-13T08:53:44.278+0000 I SHARDING [conn176] moveChunk number of documents: 5386 2016-03-13T08:53:44.328+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.331+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.335+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.345+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.366+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.406+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.487+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.629+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:44.912+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:45.428+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:46.460+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:47.492+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:48.524+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:49.549+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 108, clonedBytes: 127648, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:50.574+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2909, clonedBytes: 6539213, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:51.598+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5386, clonedBytes: 16271037, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:52.623+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52a982848c4eacbd0104d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5386, clonedBytes: 16271037, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:53:52.623+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:53:52.625+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:53:52.723+0000 I SHARDING [conn176] moveChunk setting version to: 30554|0||563ba74d869758a4542b9075 2016-03-13T08:53:52.751+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5386, clonedBytes: 16271037, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:53:52.751+0000 I SHARDING [conn176] moveChunk updating self version to: 30554|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') } for collection 'mydomain.Sessions' 2016-03-13T08:53:52.913+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:53:52.913+0000-56e52aa02848c4eacbd0104e", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859232913), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, from: "shmydomain1", to: "shmydomain3", cloned: 5386, clonedBytes: 16271037, catchup: 0, steady: 0 } } 2016-03-13T08:53:52.954+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:53:52.955+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:53:52.955+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:53:52.955+0000-56e52aa02848c4eacbd0104f", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859232955), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, step 1 of 6: 0, step 2 of 6: 453, step 3 of 6: 177, step 4 of 6: 8297, step 5 of 6: 332, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:53:53.186+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:53:53.186+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e86d99bdd00ea518c8ad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30553000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1668 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 91542, W: 3606 } } } protocol:op_command 9491ms 2016-03-13T08:53:58.277+0000 I SHARDING [conn2737] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30554|0||563ba74d869758a4542b9075, current metadata version is 30554|0||563ba74d869758a4542b9075 2016-03-13T08:53:58.277+0000 I SHARDING [conn2558] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30554|0||563ba74d869758a4542b9075, current metadata version is 30554|0||563ba74d869758a4542b9075 2016-03-13T08:53:58.279+0000 I SHARDING [conn1289] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30554|0||563ba74d869758a4542b9075, current metadata version is 30554|0||563ba74d869758a4542b9075 2016-03-13T08:54:04.619+0000 I SHARDING [conn2737] updating metadata for mydomain.Sessions from shard version 30554|0||563ba74d869758a4542b9075 to shard version 30554|1||563ba74d869758a4542b9075 2016-03-13T08:54:04.619+0000 I SHARDING [conn2737] collection version was loaded at version 30554|1||563ba74d869758a4542b9075, took 6341ms 2016-03-13T08:54:04.619+0000 I SHARDING [conn1387] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30554|1||563ba74d869758a4542b9075, current metadata version is 30554|1||563ba74d869758a4542b9075 2016-03-13T08:54:04.619+0000 I COMMAND [conn2737] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('55cef80cc334240e3ae70e7b'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30554|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 1, w: 2 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 499 } } } protocol:op_command 6341ms 2016-03-13T08:54:04.951+0000 I SHARDING [conn2558] metadata of collection mydomain.Sessions already up to date (shard version : 30554|1||563ba74d869758a4542b9075, took 6667ms) 2016-03-13T08:54:05.017+0000 I COMMAND [conn1907] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('56047f946f0eb90e522aa696'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 30553000|1, ObjectId('563ba74d869758a4542b9075') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version mismatch detected for mydomain.Sessions, stored major version 30554 does not match received 30553 ( ns : mydomain.Sessions, received : 30553|1||563ba74d869758a4542b9075, wanted : 30554|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:467 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 368 } } } protocol:op_command 6735ms 2016-03-13T08:54:05.017+0000 I COMMAND [conn1779] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('55ca116cb7c88a0e437f71fd'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 30553000|1, ObjectId('563ba74d869758a4542b9075') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version mismatch detected for mydomain.Sessions, stored major version 30554 does not match received 30553 ( ns : mydomain.Sessions, received : 30553|1||563ba74d869758a4542b9075, wanted : 30554|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:467 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 360 } } } protocol:op_command 6735ms 2016-03-13T08:54:05.017+0000 I COMMAND [conn912] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('55d4332f6ea1bf0e46808642'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 30553000|1, ObjectId('563ba74d869758a4542b9075') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version mismatch detected for mydomain.Sessions, stored major version 30554 does not match received 30553 ( ns : mydomain.Sessions, received : 30553|1||563ba74d869758a4542b9075, wanted : 30554|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:467 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 391 } } } protocol:op_command 6735ms 2016-03-13T08:54:05.017+0000 I COMMAND [conn2558] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('56047f946f0eb90e522aa696'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30554|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 }, acquireWaitCount: { R: 1, W: 1 }, timeAcquiringMicros: { R: 417, W: 5720 } } } protocol:op_command 6739ms 2016-03-13T08:54:06.176+0000 I SHARDING [conn1289] metadata of collection mydomain.Sessions already up to date (shard version : 30554|1||563ba74d869758a4542b9075, took 7896ms) 2016-03-13T08:54:06.291+0000 I COMMAND [conn1289] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('55c52c57584ad153a961a765'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30554|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 2, w: 1 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 2046 } } } protocol:op_command 8011ms 2016-03-13T08:54:08.016+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560877c7584ad16218d0cbf3') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560878ac5366dd0e48f4d604') } 2016-03-13T08:54:09.058+0000 I SHARDING [conn1387] metadata of collection mydomain.Sessions already up to date (shard version : 30554|1||563ba74d869758a4542b9075, took 4439ms) 2016-03-13T08:54:09.128+0000 I COMMAND [conn1387] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('55eb432cfde6c40e3e2c877e'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30554|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 } } } protocol:op_command 10847ms 2016-03-13T08:54:09.402+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:54:09.135+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:54:09.689+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560878ac5366dd0e48f4d604') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608798f2a8aa33e0315ae60') }, with opId: 768247324 2016-03-13T08:54:11.083+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30554000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:54:11.349+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }) in mydomain.Sessions', ts : 56e52ab32848c4eacbd01050 2016-03-13T08:54:11.349+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30554|1||563ba74d869758a4542b9075, current metadata version is 30554|1||563ba74d869758a4542b9075 2016-03-13T08:54:11.479+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30554|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T08:54:11.515+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:11.515+0000-56e52ab32848c4eacbd01051", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859251515), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:54:11.545+0000 I SHARDING [conn176] moveChunk request accepted at version 30554|1||563ba74d869758a4542b9075 2016-03-13T08:54:11.653+0000 I SHARDING [conn176] moveChunk number of documents: 5388 2016-03-13T08:54:11.703+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:11.705+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:11.709+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:11.719+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:11.740+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:11.780+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:11.861+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:12.002+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:12.266+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:12.792+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:13.845+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:14.876+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:15.910+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:16.934+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1002, clonedBytes: 1887929, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:17.959+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4516, clonedBytes: 10478394, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:18.984+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16101734, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:20.009+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ab32848c4eacbd01052", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16101734, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:20.009+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:54:20.009+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:54:20.010+0000 I SHARDING [conn3014] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:20.010+0000 I SHARDING [conn272] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:20.127+0000 I SHARDING [conn176] moveChunk setting version to: 30555|0||563ba74d869758a4542b9075 2016-03-13T08:54:20.128+0000 I SHARDING [conn3129] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:20.128+0000 I SHARDING [conn463] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:20.151+0000 I SHARDING [conn1306] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:20.151+0000 I SHARDING [conn2657] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:20.153+0000 I SHARDING [conn955] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:20.182+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16101734, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:54:20.182+0000 I SHARDING [conn176] moveChunk updating self version to: 30555|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') } for collection 'mydomain.Sessions' 2016-03-13T08:54:20.328+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:20.328+0000-56e52abc2848c4eacbd01053", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859260328), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16101734, catchup: 0, steady: 0 } } 2016-03-13T08:54:20.361+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:54:20.361+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:54:20.361+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:20.361+0000-56e52abc2848c4eacbd01054", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859260361), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, step 1 of 6: 0, step 2 of 6: 462, step 3 of 6: 156, step 4 of 6: 8307, step 5 of 6: 352, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:54:20.568+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:54:20.568+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633e98bce48b40ea18ce90f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30554000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 1500 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 66887, W: 4138 } } } protocol:op_command 9485ms 2016-03-13T08:54:21.176+0000 I SHARDING [conn1306] remotely refreshing metadata for mydomain.Sessions with requested shard version 30555|1||563ba74d869758a4542b9075 based on current shard version 30555|0||563ba74d869758a4542b9075, current metadata version is 30555|0||563ba74d869758a4542b9075 2016-03-13T08:54:21.176+0000 I SHARDING [conn659] remotely refreshing metadata for mydomain.Sessions with requested shard version 30555|1||563ba74d869758a4542b9075 based on current shard version 30555|0||563ba74d869758a4542b9075, current metadata version is 30555|0||563ba74d869758a4542b9075 2016-03-13T08:54:21.176+0000 I SHARDING [conn2657] remotely refreshing metadata for mydomain.Sessions with requested shard version 30555|1||563ba74d869758a4542b9075 based on current shard version 30555|0||563ba74d869758a4542b9075, current metadata version is 30555|0||563ba74d869758a4542b9075 2016-03-13T08:54:21.309+0000 I SHARDING [conn2657] updating metadata for mydomain.Sessions from shard version 30555|0||563ba74d869758a4542b9075 to shard version 30555|1||563ba74d869758a4542b9075 2016-03-13T08:54:21.309+0000 I SHARDING [conn2657] collection version was loaded at version 30555|1||563ba74d869758a4542b9075, took 132ms 2016-03-13T08:54:21.313+0000 I SHARDING [conn659] metadata of collection mydomain.Sessions already up to date (shard version : 30555|1||563ba74d869758a4542b9075, took 137ms) 2016-03-13T08:54:21.313+0000 I SHARDING [conn1306] metadata of collection mydomain.Sessions already up to date (shard version : 30555|1||563ba74d869758a4542b9075, took 137ms) 2016-03-13T08:54:24.499+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30555000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:54:24.804+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }) in mydomain.Sessions', ts : 56e52ac02848c4eacbd01055 2016-03-13T08:54:24.805+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30555|1||563ba74d869758a4542b9075, current metadata version is 30555|1||563ba74d869758a4542b9075 2016-03-13T08:54:24.930+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30555|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T08:54:24.967+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:24.967+0000-56e52ac02848c4eacbd01056", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859264967), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:54:25.012+0000 I SHARDING [conn152] moveChunk request accepted at version 30555|1||563ba74d869758a4542b9075 2016-03-13T08:54:25.129+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T08:54:25.210+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.230+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.251+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.271+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.291+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.352+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.453+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.595+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:25.858+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:26.384+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:27.416+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:28.468+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:29.500+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:30.531+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3430, clonedBytes: 7887725, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:31.556+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16544683, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:32.580+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ac12848c4eacbd01057", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16544683, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:32.580+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:54:32.581+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:54:32.582+0000 I SHARDING [conn2330] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:32.692+0000 I SHARDING [conn152] moveChunk setting version to: 30556|0||563ba74d869758a4542b9075 2016-03-13T08:54:32.692+0000 I SHARDING [conn793] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:32.692+0000 I SHARDING [conn2324] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:32.693+0000 I SHARDING [conn988] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:32.694+0000 I SHARDING [conn635] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:32.694+0000 I SHARDING [conn574] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:32.722+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16544683, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:54:32.722+0000 I SHARDING [conn152] moveChunk updating self version to: 30556|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') } for collection 'mydomain.Sessions' 2016-03-13T08:54:32.859+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:32.859+0000-56e52ac82848c4eacbd01058", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859272859), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16544683, catchup: 0, steady: 0 } } 2016-03-13T08:54:32.893+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:54:32.893+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:54:32.893+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:32.893+0000-56e52ac82848c4eacbd01059", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859272893), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, step 1 of 6: 0, step 2 of 6: 512, step 3 of 6: 174, step 4 of 6: 7393, step 5 of 6: 312, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:54:33.098+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:54:33.098+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633eaaace48b40ea367394a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30555000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2293 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 78104, W: 3772 } } } protocol:op_command 8599ms 2016-03-13T08:54:33.720+0000 I SHARDING [conn974] remotely refreshing metadata for mydomain.Sessions with requested shard version 30556|1||563ba74d869758a4542b9075 based on current shard version 30556|0||563ba74d869758a4542b9075, current metadata version is 30556|0||563ba74d869758a4542b9075 2016-03-13T08:54:33.720+0000 I SHARDING [conn1884] remotely refreshing metadata for mydomain.Sessions with requested shard version 30556|1||563ba74d869758a4542b9075 based on current shard version 30556|0||563ba74d869758a4542b9075, current metadata version is 30556|0||563ba74d869758a4542b9075 2016-03-13T08:54:33.771+0000 I SHARDING [conn594] remotely refreshing metadata for mydomain.Sessions with requested shard version 30556|1||563ba74d869758a4542b9075 based on current shard version 30556|0||563ba74d869758a4542b9075, current metadata version is 30556|0||563ba74d869758a4542b9075 2016-03-13T08:54:33.856+0000 I SHARDING [conn974] updating metadata for mydomain.Sessions from shard version 30556|0||563ba74d869758a4542b9075 to shard version 30556|1||563ba74d869758a4542b9075 2016-03-13T08:54:33.856+0000 I SHARDING [conn1884] metadata of collection mydomain.Sessions already up to date (shard version : 30556|1||563ba74d869758a4542b9075, took 134ms) 2016-03-13T08:54:33.856+0000 I SHARDING [conn974] collection version was loaded at version 30556|1||563ba74d869758a4542b9075, took 134ms 2016-03-13T08:54:33.883+0000 I SHARDING [conn594] metadata of collection mydomain.Sessions already up to date (shard version : 30556|1||563ba74d869758a4542b9075, took 112ms) 2016-03-13T08:54:38.002+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30556000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:54:38.289+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }) in mydomain.Sessions', ts : 56e52acd2848c4eacbd0105a 2016-03-13T08:54:38.289+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30556|1||563ba74d869758a4542b9075, current metadata version is 30556|1||563ba74d869758a4542b9075 2016-03-13T08:54:38.410+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30556|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T08:54:38.444+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:38.444+0000-56e52ace2848c4eacbd0105b", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859278444), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:54:38.472+0000 I SHARDING [conn152] moveChunk request accepted at version 30556|1||563ba74d869758a4542b9075 2016-03-13T08:54:38.579+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:54:38.631+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:38.634+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:38.638+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:38.646+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:38.671+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:38.711+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:38.792+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:38.934+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:39.197+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:39.688+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:54:39.402+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:54:39.723+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:40.755+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:41.787+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:42.839+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:43.864+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1985, clonedBytes: 3966451, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:44.144+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560878ac5366dd0e48f4d604') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608798f2a8aa33e0315ae60') } 2016-03-13T08:54:44.240+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608798f2a8aa33e0315ae60') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087a6f2a8aa33e0315c186') }, with opId: 768295914 2016-03-13T08:54:44.889+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5097, clonedBytes: 14323528, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:45.914+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16575337, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:46.938+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ace2848c4eacbd0105c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16575337, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:46.938+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:54:46.939+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:54:46.939+0000 I SHARDING [conn2980] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:47.049+0000 I SHARDING [conn152] moveChunk setting version to: 30557|0||563ba74d869758a4542b9075 2016-03-13T08:54:47.050+0000 I SHARDING [conn1737] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:47.050+0000 I SHARDING [conn1417] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:47.051+0000 I SHARDING [conn1016] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:47.053+0000 I SHARDING [conn2183] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:47.053+0000 I SHARDING [conn2094] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:47.053+0000 I SHARDING [conn2794] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:54:47.080+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16575337, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:54:47.081+0000 I SHARDING [conn152] moveChunk updating self version to: 30557|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') } for collection 'mydomain.Sessions' 2016-03-13T08:54:47.161+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:47.161+0000-56e52ad72848c4eacbd0105d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859287161), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16575337, catchup: 0, steady: 0 } } 2016-03-13T08:54:47.195+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:54:47.197+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:54:47.197+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:47.197+0000-56e52ad72848c4eacbd0105e", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859287197), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, step 1 of 6: 0, step 2 of 6: 469, step 3 of 6: 154, step 4 of 6: 8311, step 5 of 6: 258, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:54:47.332+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:54:47.332+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ebc499bdd00ea5191cf8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30556000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4768 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 2 }, timeAcquiringMicros: { R: 67112, W: 2568 } } } protocol:op_command 9331ms 2016-03-13T08:54:48.027+0000 I SHARDING [conn1765] remotely refreshing metadata for mydomain.Sessions with requested shard version 30557|1||563ba74d869758a4542b9075 based on current shard version 30557|0||563ba74d869758a4542b9075, current metadata version is 30557|0||563ba74d869758a4542b9075 2016-03-13T08:54:48.027+0000 I SHARDING [conn2231] remotely refreshing metadata for mydomain.Sessions with requested shard version 30557|1||563ba74d869758a4542b9075 based on current shard version 30557|0||563ba74d869758a4542b9075, current metadata version is 30557|0||563ba74d869758a4542b9075 2016-03-13T08:54:48.027+0000 I SHARDING [conn3121] remotely refreshing metadata for mydomain.Sessions with requested shard version 30557|1||563ba74d869758a4542b9075 based on current shard version 30557|0||563ba74d869758a4542b9075, current metadata version is 30557|0||563ba74d869758a4542b9075 2016-03-13T08:54:48.159+0000 I SHARDING [conn2231] updating metadata for mydomain.Sessions from shard version 30557|0||563ba74d869758a4542b9075 to shard version 30557|1||563ba74d869758a4542b9075 2016-03-13T08:54:48.159+0000 I SHARDING [conn1765] metadata of collection mydomain.Sessions already up to date (shard version : 30557|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:54:48.159+0000 I SHARDING [conn3121] metadata of collection mydomain.Sessions already up to date (shard version : 30557|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:54:48.159+0000 I SHARDING [conn2231] collection version was loaded at version 30557|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T08:54:52.206+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30557000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:54:52.467+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }) in mydomain.Sessions', ts : 56e52adc2848c4eacbd0105f 2016-03-13T08:54:52.467+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30557|1||563ba74d869758a4542b9075, current metadata version is 30557|1||563ba74d869758a4542b9075 2016-03-13T08:54:52.599+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30557|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T08:54:52.636+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:54:52.636+0000-56e52adc2848c4eacbd01060", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859292636), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:54:52.664+0000 I SHARDING [conn152] moveChunk request accepted at version 30557|1||563ba74d869758a4542b9075 2016-03-13T08:54:52.778+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:54:52.827+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:52.832+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:52.850+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:52.870+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:52.891+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:52.931+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:53.012+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:53.154+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:53.437+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:53.983+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:55.015+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:56.048+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:57.097+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:58.122+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3049, clonedBytes: 7054593, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:54:59.147+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 15896243, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:00.172+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52adc2848c4eacbd01061", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 15896243, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:00.172+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:55:00.172+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:55:00.173+0000 I SHARDING [conn2777] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:00.284+0000 I SHARDING [conn152] moveChunk setting version to: 30558|0||563ba74d869758a4542b9075 2016-03-13T08:55:00.284+0000 I SHARDING [conn828] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:00.286+0000 I SHARDING [conn1173] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:00.287+0000 I SHARDING [conn2680] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:00.287+0000 I SHARDING [conn1822] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:00.287+0000 I SHARDING [conn1395] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:00.288+0000 I SHARDING [conn2290] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:00.326+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 15896243, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:55:00.326+0000 I SHARDING [conn152] moveChunk updating self version to: 30558|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') } for collection 'mydomain.Sessions' 2016-03-13T08:55:00.462+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:00.462+0000-56e52ae42848c4eacbd01062", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859300462), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 15896243, catchup: 0, steady: 0 } } 2016-03-13T08:55:00.499+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:55:00.500+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:55:00.501+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:00.501+0000-56e52ae42848c4eacbd01063", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859300501), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, step 1 of 6: 0, step 2 of 6: 458, step 3 of 6: 161, step 4 of 6: 7346, step 5 of 6: 328, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:55:00.702+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:55:00.702+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ecdc584ad10f212bee45') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30557000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2117 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 71209, W: 2936 } } } protocol:op_command 8496ms 2016-03-13T08:55:01.340+0000 I SHARDING [conn265] remotely refreshing metadata for mydomain.Sessions with requested shard version 30558|1||563ba74d869758a4542b9075 based on current shard version 30558|0||563ba74d869758a4542b9075, current metadata version is 30558|0||563ba74d869758a4542b9075 2016-03-13T08:55:01.340+0000 I SHARDING [conn1005] remotely refreshing metadata for mydomain.Sessions with requested shard version 30558|1||563ba74d869758a4542b9075 based on current shard version 30558|0||563ba74d869758a4542b9075, current metadata version is 30558|0||563ba74d869758a4542b9075 2016-03-13T08:55:01.380+0000 I SHARDING [conn1356] remotely refreshing metadata for mydomain.Sessions with requested shard version 30558|1||563ba74d869758a4542b9075 based on current shard version 30558|0||563ba74d869758a4542b9075, current metadata version is 30558|0||563ba74d869758a4542b9075 2016-03-13T08:55:01.487+0000 I SHARDING [conn1356] updating metadata for mydomain.Sessions from shard version 30558|0||563ba74d869758a4542b9075 to shard version 30558|1||563ba74d869758a4542b9075 2016-03-13T08:55:01.487+0000 I SHARDING [conn1005] metadata of collection mydomain.Sessions already up to date (shard version : 30558|1||563ba74d869758a4542b9075, took 146ms) 2016-03-13T08:55:01.487+0000 I SHARDING [conn1356] collection version was loaded at version 30558|1||563ba74d869758a4542b9075, took 106ms 2016-03-13T08:55:01.487+0000 I SHARDING [conn265] metadata of collection mydomain.Sessions already up to date (shard version : 30558|1||563ba74d869758a4542b9075, took 146ms) 2016-03-13T08:55:05.883+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30558000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:55:06.019+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }) in mydomain.Sessions', ts : 56e52ae92848c4eacbd01064 2016-03-13T08:55:06.019+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30558|1||563ba74d869758a4542b9075, current metadata version is 30558|1||563ba74d869758a4542b9075 2016-03-13T08:55:06.146+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30558|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T08:55:06.183+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:06.183+0000-56e52aea2848c4eacbd01065", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859306183), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:55:06.218+0000 I SHARDING [conn152] moveChunk request accepted at version 30558|1||563ba74d869758a4542b9075 2016-03-13T08:55:06.342+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T08:55:06.391+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.397+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.412+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.432+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.453+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.493+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.574+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.715+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:06.999+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:07.536+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:08.567+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:09.620+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:09.908+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:55:09.688+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:55:10.672+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:11.697+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2599, clonedBytes: 5554902, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:12.722+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16256069, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:13.746+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52aea2848c4eacbd01066", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16256069, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:13.747+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:55:13.747+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:55:13.748+0000 I SHARDING [conn1012] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:13.854+0000 I SHARDING [conn152] moveChunk setting version to: 30559|0||563ba74d869758a4542b9075 2016-03-13T08:55:13.856+0000 I SHARDING [conn2390] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:13.856+0000 I SHARDING [conn943] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:13.856+0000 I SHARDING [conn2954] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:13.856+0000 I SHARDING [conn277] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:13.857+0000 I SHARDING [conn2831] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:13.857+0000 I SHARDING [conn1967] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:13.868+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16256069, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:55:13.868+0000 I SHARDING [conn152] moveChunk updating self version to: 30559|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') } for collection 'mydomain.Sessions' 2016-03-13T08:55:14.073+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:14.073+0000-56e52af22848c4eacbd01067", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859314073), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16256069, catchup: 0, steady: 0 } } 2016-03-13T08:55:14.107+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:55:14.112+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:55:14.112+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:14.112+0000-56e52af22848c4eacbd01068", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859314112), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, step 1 of 6: 0, step 2 of 6: 334, step 3 of 6: 172, step 4 of 6: 7356, step 5 of 6: 365, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:55:14.380+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:55:14.380+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633edf5584ad10f212c07aa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30558000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 4851 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 85608, W: 3475 } } } protocol:op_command 8497ms 2016-03-13T08:55:14.938+0000 I SHARDING [conn1835] remotely refreshing metadata for mydomain.Sessions with requested shard version 30559|1||563ba74d869758a4542b9075 based on current shard version 30559|0||563ba74d869758a4542b9075, current metadata version is 30559|0||563ba74d869758a4542b9075 2016-03-13T08:55:14.938+0000 I SHARDING [conn2106] remotely refreshing metadata for mydomain.Sessions with requested shard version 30559|1||563ba74d869758a4542b9075 based on current shard version 30559|0||563ba74d869758a4542b9075, current metadata version is 30559|0||563ba74d869758a4542b9075 2016-03-13T08:55:14.940+0000 I SHARDING [conn1724] remotely refreshing metadata for mydomain.Sessions with requested shard version 30559|1||563ba74d869758a4542b9075 based on current shard version 30559|0||563ba74d869758a4542b9075, current metadata version is 30559|0||563ba74d869758a4542b9075 2016-03-13T08:55:15.061+0000 I SHARDING [conn1724] updating metadata for mydomain.Sessions from shard version 30559|0||563ba74d869758a4542b9075 to shard version 30559|1||563ba74d869758a4542b9075 2016-03-13T08:55:15.061+0000 I SHARDING [conn1724] collection version was loaded at version 30559|1||563ba74d869758a4542b9075, took 120ms 2016-03-13T08:55:15.065+0000 I SHARDING [conn1835] metadata of collection mydomain.Sessions already up to date (shard version : 30559|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T08:55:15.065+0000 I SHARDING [conn2106] metadata of collection mydomain.Sessions already up to date (shard version : 30559|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T08:55:15.087+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608798f2a8aa33e0315ae60') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087a6f2a8aa33e0315c186') } 2016-03-13T08:55:15.509+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087a6f2a8aa33e0315c186') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087b515366dd0e4aaa77b7') }, with opId: 768342677 2016-03-13T08:55:19.235+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30559000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:55:19.369+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }) in mydomain.Sessions', ts : 56e52af72848c4eacbd01069 2016-03-13T08:55:19.370+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30559|1||563ba74d869758a4542b9075, current metadata version is 30559|1||563ba74d869758a4542b9075 2016-03-13T08:55:19.500+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30559|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T08:55:19.538+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:19.538+0000-56e52af72848c4eacbd0106a", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859319538), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:55:19.574+0000 I SHARDING [conn152] moveChunk request accepted at version 30559|1||563ba74d869758a4542b9075 2016-03-13T08:55:19.673+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:55:19.732+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:19.734+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:19.751+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:19.771+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:19.812+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:19.852+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:19.933+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:20.074+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:20.338+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:20.864+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:21.916+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:22.948+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:24.001+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:25.026+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2761, clonedBytes: 6180637, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:26.051+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16261100, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:27.075+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52af72848c4eacbd0106b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16261100, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:27.075+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:55:27.076+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:55:27.182+0000 I SHARDING [conn152] moveChunk setting version to: 30560|0||563ba74d869758a4542b9075 2016-03-13T08:55:27.182+0000 I SHARDING [conn1205] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:27.184+0000 I SHARDING [conn2077] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:27.184+0000 I SHARDING [conn2123] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:27.185+0000 I SHARDING [conn2857] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:27.185+0000 I SHARDING [conn2307] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:27.185+0000 I SHARDING [conn1899] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:27.186+0000 I SHARDING [conn1859] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:27.219+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16261100, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:55:27.219+0000 I SHARDING [conn152] moveChunk updating self version to: 30560|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') } for collection 'mydomain.Sessions' 2016-03-13T08:55:27.394+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:27.394+0000-56e52aff2848c4eacbd0106c", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859327394), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16261100, catchup: 0, steady: 0 } } 2016-03-13T08:55:27.433+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:55:27.434+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:55:27.434+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:27.434+0000-56e52aff2848c4eacbd0106d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859327434), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, step 1 of 6: 0, step 2 of 6: 339, step 3 of 6: 153, step 4 of 6: 7348, step 5 of 6: 358, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:55:27.599+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:55:27.599+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ef0099bdd00ea5196936') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30559000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2765 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 57104, W: 5447 } } } protocol:op_command 8365ms 2016-03-13T08:55:28.274+0000 I SHARDING [conn1965] remotely refreshing metadata for mydomain.Sessions with requested shard version 30560|1||563ba74d869758a4542b9075 based on current shard version 30560|0||563ba74d869758a4542b9075, current metadata version is 30560|0||563ba74d869758a4542b9075 2016-03-13T08:55:28.274+0000 I SHARDING [conn1930] remotely refreshing metadata for mydomain.Sessions with requested shard version 30560|1||563ba74d869758a4542b9075 based on current shard version 30560|0||563ba74d869758a4542b9075, current metadata version is 30560|0||563ba74d869758a4542b9075 2016-03-13T08:55:28.276+0000 I SHARDING [conn698] remotely refreshing metadata for mydomain.Sessions with requested shard version 30560|1||563ba74d869758a4542b9075 based on current shard version 30560|0||563ba74d869758a4542b9075, current metadata version is 30560|0||563ba74d869758a4542b9075 2016-03-13T08:55:28.414+0000 I SHARDING [conn698] updating metadata for mydomain.Sessions from shard version 30560|0||563ba74d869758a4542b9075 to shard version 30560|1||563ba74d869758a4542b9075 2016-03-13T08:55:28.414+0000 I SHARDING [conn1965] metadata of collection mydomain.Sessions already up to date (shard version : 30560|1||563ba74d869758a4542b9075, took 137ms) 2016-03-13T08:55:28.414+0000 I SHARDING [conn1930] metadata of collection mydomain.Sessions already up to date (shard version : 30560|1||563ba74d869758a4542b9075, took 137ms) 2016-03-13T08:55:28.414+0000 I SHARDING [conn698] collection version was loaded at version 30560|1||563ba74d869758a4542b9075, took 134ms 2016-03-13T08:55:32.633+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30560000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:55:32.927+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }) in mydomain.Sessions', ts : 56e52b042848c4eacbd0106e 2016-03-13T08:55:32.927+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30560|1||563ba74d869758a4542b9075, current metadata version is 30560|1||563ba74d869758a4542b9075 2016-03-13T08:55:33.054+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30560|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:55:33.091+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:33.091+0000-56e52b052848c4eacbd0106f", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859333091), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:55:33.113+0000 I SHARDING [conn152] moveChunk request accepted at version 30560|1||563ba74d869758a4542b9075 2016-03-13T08:55:33.217+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:55:33.266+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.270+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.303+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.323+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.343+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.384+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.465+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.606+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:33.870+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:34.396+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:35.427+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:36.460+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:37.492+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:38.517+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2757, clonedBytes: 5870016, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:39.541+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 15905568, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:40.165+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:55:39.908+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:55:40.566+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b052848c4eacbd01070", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 15905568, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:40.566+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:55:40.567+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:55:40.568+0000 I SHARDING [conn1145] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:40.676+0000 I SHARDING [conn152] moveChunk setting version to: 30561|0||563ba74d869758a4542b9075 2016-03-13T08:55:40.676+0000 I SHARDING [conn1667] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:40.676+0000 I SHARDING [conn1856] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:40.678+0000 I SHARDING [conn703] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:40.678+0000 I SHARDING [conn2120] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:40.679+0000 I SHARDING [conn1629] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:40.712+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 15905568, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:55:40.712+0000 I SHARDING [conn152] moveChunk updating self version to: 30561|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') } for collection 'mydomain.Sessions' 2016-03-13T08:55:40.849+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:40.849+0000-56e52b0c2848c4eacbd01071", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859340849), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 15905568, catchup: 0, steady: 0 } } 2016-03-13T08:55:40.882+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:55:40.883+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:55:40.885+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:40.885+0000-56e52b0c2848c4eacbd01072", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859340885), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, step 1 of 6: 0, step 2 of 6: 479, step 3 of 6: 151, step 4 of 6: 7301, step 5 of 6: 316, step 6 of 6: 2, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:55:41.088+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:55:41.088+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f011584ad10f212c3f27') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30560000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 632 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 67620, W: 1968 } } } protocol:op_command 8455ms 2016-03-13T08:55:41.718+0000 I SHARDING [conn2108] remotely refreshing metadata for mydomain.Sessions with requested shard version 30561|1||563ba74d869758a4542b9075 based on current shard version 30561|0||563ba74d869758a4542b9075, current metadata version is 30561|0||563ba74d869758a4542b9075 2016-03-13T08:55:41.718+0000 I SHARDING [conn1132] remotely refreshing metadata for mydomain.Sessions with requested shard version 30561|1||563ba74d869758a4542b9075 based on current shard version 30561|0||563ba74d869758a4542b9075, current metadata version is 30561|0||563ba74d869758a4542b9075 2016-03-13T08:55:41.718+0000 I SHARDING [conn2152] remotely refreshing metadata for mydomain.Sessions with requested shard version 30561|1||563ba74d869758a4542b9075 based on current shard version 30561|0||563ba74d869758a4542b9075, current metadata version is 30561|0||563ba74d869758a4542b9075 2016-03-13T08:55:41.845+0000 I SHARDING [conn2152] updating metadata for mydomain.Sessions from shard version 30561|0||563ba74d869758a4542b9075 to shard version 30561|1||563ba74d869758a4542b9075 2016-03-13T08:55:41.845+0000 I SHARDING [conn2108] metadata of collection mydomain.Sessions already up to date (shard version : 30561|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T08:55:41.845+0000 I SHARDING [conn1132] metadata of collection mydomain.Sessions already up to date (shard version : 30561|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:55:41.845+0000 I SHARDING [conn2152] collection version was loaded at version 30561|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T08:55:45.847+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087a6f2a8aa33e0315c186') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087b515366dd0e4aaa77b7') } 2016-03-13T08:55:46.011+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30561000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:55:46.609+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087b515366dd0e4aaa77b7') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087c342a8aa33e0579d620') }, with opId: 768392920 2016-03-13T08:55:48.525+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }) in mydomain.Sessions', ts : 56e52b122848c4eacbd01073 2016-03-13T08:55:48.525+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30561|1||563ba74d869758a4542b9075, current metadata version is 30561|1||563ba74d869758a4542b9075 2016-03-13T08:55:48.654+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30561|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:55:48.692+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:48.692+0000-56e52b142848c4eacbd01074", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859348692), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:55:48.712+0000 I SHARDING [conn152] moveChunk request accepted at version 30561|1||563ba74d869758a4542b9075 2016-03-13T08:55:48.859+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:55:48.908+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:48.910+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:48.915+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:48.930+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:48.949+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:48.990+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:49.058+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:49.212+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:49.475+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:50.022+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:51.054+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:52.086+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:53.118+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:54.142+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1721, clonedBytes: 3394345, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:55.167+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4956, clonedBytes: 14605100, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:56.192+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16426026, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:57.217+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b142848c4eacbd01075", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16426026, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:55:57.217+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:55:57.217+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:55:57.325+0000 I SHARDING [conn152] moveChunk setting version to: 30562|0||563ba74d869758a4542b9075 2016-03-13T08:55:57.327+0000 I SHARDING [conn1324] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:57.327+0000 I SHARDING [conn2468] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:57.327+0000 I SHARDING [conn249] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:57.327+0000 I SHARDING [conn2293] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:57.327+0000 I SHARDING [conn1090] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:57.327+0000 I SHARDING [conn3100] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:57.328+0000 I SHARDING [conn2039] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:55:57.360+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16426026, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:55:57.360+0000 I SHARDING [conn152] moveChunk updating self version to: 30562|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') } for collection 'mydomain.Sessions' 2016-03-13T08:55:57.516+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:57.516+0000-56e52b1d2848c4eacbd01076", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859357516), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16426026, catchup: 0, steady: 0 } } 2016-03-13T08:55:57.552+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:55:57.555+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:55:57.556+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:55:57.556+0000-56e52b1d2848c4eacbd01077", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859357556), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, step 1 of 6: 0, step 2 of 6: 2700, step 3 of 6: 194, step 4 of 6: 8310, step 5 of 6: 338, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:55:57.755+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:55:57.755+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f12f7bc3500e94580fe6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30561000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4611 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 103786, W: 4148 } } } protocol:op_command 11744ms 2016-03-13T08:55:58.387+0000 I SHARDING [conn2144] remotely refreshing metadata for mydomain.Sessions with requested shard version 30562|1||563ba74d869758a4542b9075 based on current shard version 30562|0||563ba74d869758a4542b9075, current metadata version is 30562|0||563ba74d869758a4542b9075 2016-03-13T08:55:58.387+0000 I SHARDING [conn1866] remotely refreshing metadata for mydomain.Sessions with requested shard version 30562|1||563ba74d869758a4542b9075 based on current shard version 30562|0||563ba74d869758a4542b9075, current metadata version is 30562|0||563ba74d869758a4542b9075 2016-03-13T08:55:58.420+0000 I SHARDING [conn2711] remotely refreshing metadata for mydomain.Sessions with requested shard version 30562|1||563ba74d869758a4542b9075 based on current shard version 30562|0||563ba74d869758a4542b9075, current metadata version is 30562|0||563ba74d869758a4542b9075 2016-03-13T08:55:58.528+0000 I SHARDING [conn2144] updating metadata for mydomain.Sessions from shard version 30562|0||563ba74d869758a4542b9075 to shard version 30562|1||563ba74d869758a4542b9075 2016-03-13T08:55:58.528+0000 I SHARDING [conn2144] collection version was loaded at version 30562|1||563ba74d869758a4542b9075, took 140ms 2016-03-13T08:55:58.544+0000 I SHARDING [conn1866] metadata of collection mydomain.Sessions already up to date (shard version : 30562|1||563ba74d869758a4542b9075, took 152ms) 2016-03-13T08:55:58.578+0000 I SHARDING [conn2711] metadata of collection mydomain.Sessions already up to date (shard version : 30562|1||563ba74d869758a4542b9075, took 157ms) 2016-03-13T08:56:03.336+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30562000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:56:03.479+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }) in mydomain.Sessions', ts : 56e52b232848c4eacbd01078 2016-03-13T08:56:03.479+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30562|1||563ba74d869758a4542b9075, current metadata version is 30562|1||563ba74d869758a4542b9075 2016-03-13T08:56:03.620+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30562|1||563ba74d869758a4542b9075, took 135ms) 2016-03-13T08:56:03.657+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:03.657+0000-56e52b232848c4eacbd01079", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859363657), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:56:03.683+0000 I SHARDING [conn152] moveChunk request accepted at version 30562|1||563ba74d869758a4542b9075 2016-03-13T08:56:03.796+0000 I SHARDING [conn152] moveChunk number of documents: 5390 2016-03-13T08:56:03.846+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:03.851+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:03.856+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:03.864+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:03.887+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:03.928+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:04.009+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:04.150+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:04.414+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:04.960+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:05.992+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:07.045+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:08.098+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:09.123+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2426, clonedBytes: 5259563, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:10.147+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5382, clonedBytes: 16781195, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:10.411+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:56:10.165+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:56:11.172+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 16868393, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:12.197+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b232848c4eacbd0107a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5390, clonedBytes: 16868393, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:12.197+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:56:12.197+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:56:12.310+0000 I SHARDING [conn152] moveChunk setting version to: 30563|0||563ba74d869758a4542b9075 2016-03-13T08:56:12.312+0000 I SHARDING [conn2008] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:12.312+0000 I SHARDING [conn184] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:12.312+0000 I SHARDING [conn2585] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:12.313+0000 I SHARDING [conn2815] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:12.313+0000 I SHARDING [conn769] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:12.313+0000 I SHARDING [conn1714] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:12.313+0000 I SHARDING [conn2271] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:12.343+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5390, clonedBytes: 16868393, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:56:12.343+0000 I SHARDING [conn152] moveChunk updating self version to: 30563|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') } for collection 'mydomain.Sessions' 2016-03-13T08:56:12.495+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:12.495+0000-56e52b2c2848c4eacbd0107b", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859372495), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, from: "shmydomain1", to: "shmydomain3", cloned: 5390, clonedBytes: 16868393, catchup: 0, steady: 0 } } 2016-03-13T08:56:12.528+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:56:12.531+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:56:12.534+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:12.534+0000-56e52b2c2848c4eacbd0107c", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859372534), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, step 1 of 6: 0, step 2 of 6: 347, step 3 of 6: 161, step 4 of 6: 8352, step 5 of 6: 334, step 6 of 6: 3, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:56:12.738+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:56:12.738+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f244584ad10f212c76e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30562000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 5100 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 75858, W: 6662 } } } protocol:op_command 9402ms 2016-03-13T08:56:13.362+0000 I SHARDING [conn1549] remotely refreshing metadata for mydomain.Sessions with requested shard version 30563|1||563ba74d869758a4542b9075 based on current shard version 30563|0||563ba74d869758a4542b9075, current metadata version is 30563|0||563ba74d869758a4542b9075 2016-03-13T08:56:13.363+0000 I SHARDING [conn2063] remotely refreshing metadata for mydomain.Sessions with requested shard version 30563|1||563ba74d869758a4542b9075 based on current shard version 30563|0||563ba74d869758a4542b9075, current metadata version is 30563|0||563ba74d869758a4542b9075 2016-03-13T08:56:13.362+0000 I SHARDING [conn901] remotely refreshing metadata for mydomain.Sessions with requested shard version 30563|1||563ba74d869758a4542b9075 based on current shard version 30563|0||563ba74d869758a4542b9075, current metadata version is 30563|0||563ba74d869758a4542b9075 2016-03-13T08:56:13.492+0000 I SHARDING [conn1549] updating metadata for mydomain.Sessions from shard version 30563|0||563ba74d869758a4542b9075 to shard version 30563|1||563ba74d869758a4542b9075 2016-03-13T08:56:13.492+0000 I SHARDING [conn901] metadata of collection mydomain.Sessions already up to date (shard version : 30563|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:56:13.492+0000 I SHARDING [conn1549] collection version was loaded at version 30563|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T08:56:13.492+0000 I SHARDING [conn2063] metadata of collection mydomain.Sessions already up to date (shard version : 30563|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:56:17.651+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30563000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:56:17.860+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }) in mydomain.Sessions', ts : 56e52b312848c4eacbd0107d 2016-03-13T08:56:17.860+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30563|1||563ba74d869758a4542b9075, current metadata version is 30563|1||563ba74d869758a4542b9075 2016-03-13T08:56:17.985+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30563|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T08:56:18.023+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:18.023+0000-56e52b322848c4eacbd0107e", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859378023), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:56:18.053+0000 I SHARDING [conn152] moveChunk request accepted at version 30563|1||563ba74d869758a4542b9075 2016-03-13T08:56:18.182+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:56:18.231+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.234+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.238+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.249+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.269+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.310+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.391+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.533+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:18.792+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:19.342+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:20.394+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:20.726+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087b515366dd0e4aaa77b7') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087c342a8aa33e0579d620') } 2016-03-13T08:56:20.743+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087c342a8aa33e0579d620') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087d10584ad1621aec6109') }, with opId: 768445035 2016-03-13T08:56:21.446+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:22.499+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:23.523+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2444, clonedBytes: 5484726, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:24.548+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5387, clonedBytes: 16793285, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:25.573+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b322848c4eacbd0107f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16793285, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:25.573+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:56:25.573+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:56:25.574+0000 I SHARDING [conn875] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:25.685+0000 I SHARDING [conn152] moveChunk setting version to: 30564|0||563ba74d869758a4542b9075 2016-03-13T08:56:25.687+0000 I SHARDING [conn2110] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:25.687+0000 I SHARDING [conn1420] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:25.687+0000 I SHARDING [conn257] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:25.687+0000 I SHARDING [conn1077] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:25.687+0000 I SHARDING [conn2445] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:25.687+0000 I SHARDING [conn1990] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:25.714+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16793285, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:56:25.714+0000 I SHARDING [conn152] moveChunk updating self version to: 30564|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') } for collection 'mydomain.Sessions' 2016-03-13T08:56:25.851+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:25.851+0000-56e52b392848c4eacbd01080", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859385851), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16793285, catchup: 0, steady: 0 } } 2016-03-13T08:56:25.884+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:56:25.885+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:56:25.889+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:25.889+0000-56e52b392848c4eacbd01081", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859385889), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, step 1 of 6: 0, step 2 of 6: 402, step 3 of 6: 176, step 4 of 6: 7343, step 5 of 6: 312, step 6 of 6: 4, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:56:26.089+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:56:26.089+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f354ce48b40ea18ddbfa') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30563000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1642 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 88720, W: 4608 } } } protocol:op_command 8438ms 2016-03-13T08:56:26.716+0000 I SHARDING [conn3135] remotely refreshing metadata for mydomain.Sessions with requested shard version 30564|1||563ba74d869758a4542b9075 based on current shard version 30564|0||563ba74d869758a4542b9075, current metadata version is 30564|0||563ba74d869758a4542b9075 2016-03-13T08:56:26.716+0000 I SHARDING [conn945] remotely refreshing metadata for mydomain.Sessions with requested shard version 30564|1||563ba74d869758a4542b9075 based on current shard version 30564|0||563ba74d869758a4542b9075, current metadata version is 30564|0||563ba74d869758a4542b9075 2016-03-13T08:56:26.716+0000 I SHARDING [conn2195] remotely refreshing metadata for mydomain.Sessions with requested shard version 30564|1||563ba74d869758a4542b9075 based on current shard version 30564|0||563ba74d869758a4542b9075, current metadata version is 30564|0||563ba74d869758a4542b9075 2016-03-13T08:56:26.847+0000 I SHARDING [conn3135] updating metadata for mydomain.Sessions from shard version 30564|0||563ba74d869758a4542b9075 to shard version 30564|1||563ba74d869758a4542b9075 2016-03-13T08:56:26.847+0000 I SHARDING [conn945] metadata of collection mydomain.Sessions already up to date (shard version : 30564|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T08:56:26.847+0000 I SHARDING [conn2195] metadata of collection mydomain.Sessions already up to date (shard version : 30564|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T08:56:26.847+0000 I SHARDING [conn3135] collection version was loaded at version 30564|1||563ba74d869758a4542b9075, took 125ms 2016-03-13T08:56:30.428+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30564000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:56:30.623+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }) in mydomain.Sessions', ts : 56e52b3e2848c4eacbd01082 2016-03-13T08:56:30.623+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30564|1||563ba74d869758a4542b9075, current metadata version is 30564|1||563ba74d869758a4542b9075 2016-03-13T08:56:30.745+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30564|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T08:56:30.779+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:30.779+0000-56e52b3e2848c4eacbd01083", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859390779), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:56:30.804+0000 I SHARDING [conn176] moveChunk request accepted at version 30564|1||563ba74d869758a4542b9075 2016-03-13T08:56:30.911+0000 I SHARDING [conn176] moveChunk number of documents: 5387 2016-03-13T08:56:30.960+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:30.963+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:30.967+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:31.001+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:31.021+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:31.082+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:31.163+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:31.309+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:31.568+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:32.094+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:33.126+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:34.158+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:35.191+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:36.216+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2062, clonedBytes: 4769519, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:37.240+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5223, clonedBytes: 15657286, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:38.265+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16362248, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:39.290+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b3e2848c4eacbd01084", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16362248, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:39.290+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:56:39.290+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:56:39.399+0000 I SHARDING [conn176] moveChunk setting version to: 30565|0||563ba74d869758a4542b9075 2016-03-13T08:56:39.399+0000 I SHARDING [conn2444] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:39.400+0000 I SHARDING [conn1914] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:39.400+0000 I SHARDING [conn1784] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:39.400+0000 I SHARDING [conn1789] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:39.401+0000 I SHARDING [conn928] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:39.401+0000 I SHARDING [conn2282] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:39.401+0000 I SHARDING [conn893] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:39.434+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16362248, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:56:39.434+0000 I SHARDING [conn176] moveChunk updating self version to: 30565|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') } for collection 'mydomain.Sessions' 2016-03-13T08:56:39.566+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:39.566+0000-56e52b472848c4eacbd01085", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859399566), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16362248, catchup: 0, steady: 0 } } 2016-03-13T08:56:39.599+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:56:39.599+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:56:39.599+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:39.599+0000-56e52b472848c4eacbd01086", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859399599), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, step 1 of 6: 0, step 2 of 6: 375, step 3 of 6: 155, step 4 of 6: 8330, step 5 of 6: 309, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:56:39.737+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:56:39.737+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f45e99bdd00ea519ea10') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30564000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 1296 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 65772, W: 2533 } } } protocol:op_command 9310ms 2016-03-13T08:56:40.435+0000 I SHARDING [conn2189] remotely refreshing metadata for mydomain.Sessions with requested shard version 30565|1||563ba74d869758a4542b9075 based on current shard version 30565|0||563ba74d869758a4542b9075, current metadata version is 30565|0||563ba74d869758a4542b9075 2016-03-13T08:56:40.435+0000 I SHARDING [conn2053] remotely refreshing metadata for mydomain.Sessions with requested shard version 30565|1||563ba74d869758a4542b9075 based on current shard version 30565|0||563ba74d869758a4542b9075, current metadata version is 30565|0||563ba74d869758a4542b9075 2016-03-13T08:56:40.435+0000 I SHARDING [conn1001] remotely refreshing metadata for mydomain.Sessions with requested shard version 30565|1||563ba74d869758a4542b9075 based on current shard version 30565|0||563ba74d869758a4542b9075, current metadata version is 30565|0||563ba74d869758a4542b9075 2016-03-13T08:56:40.564+0000 I SHARDING [conn2189] updating metadata for mydomain.Sessions from shard version 30565|0||563ba74d869758a4542b9075 to shard version 30565|1||563ba74d869758a4542b9075 2016-03-13T08:56:40.564+0000 I SHARDING [conn2053] metadata of collection mydomain.Sessions already up to date (shard version : 30565|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T08:56:40.564+0000 I SHARDING [conn1001] metadata of collection mydomain.Sessions already up to date (shard version : 30565|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T08:56:40.564+0000 I SHARDING [conn2189] collection version was loaded at version 30565|1||563ba74d869758a4542b9075, took 125ms 2016-03-13T08:56:40.592+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:56:40.412+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:56:44.956+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30565000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:56:45.098+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }) in mydomain.Sessions', ts : 56e52b4c2848c4eacbd01087 2016-03-13T08:56:45.098+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30565|1||563ba74d869758a4542b9075, current metadata version is 30565|1||563ba74d869758a4542b9075 2016-03-13T08:56:45.218+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30565|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T08:56:45.252+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:45.252+0000-56e52b4d2848c4eacbd01088", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859405252), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:56:45.272+0000 I SHARDING [conn176] moveChunk request accepted at version 30565|1||563ba74d869758a4542b9075 2016-03-13T08:56:45.402+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T08:56:45.454+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:45.473+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:45.493+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:45.515+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:45.533+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:45.594+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:45.695+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:45.837+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:46.100+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:46.627+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:47.689+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:48.721+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:49.753+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:50.778+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1948, clonedBytes: 4461741, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:51.802+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5166, clonedBytes: 14649738, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:52.827+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 15650424, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:53.111+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087c342a8aa33e0579d620') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087d10584ad1621aec6109') } 2016-03-13T08:56:53.252+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087d10584ad1621aec6109') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087de65366dd0e4aaaac79') }, with opId: 768496280 2016-03-13T08:56:53.852+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b4d2848c4eacbd01089", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 15650424, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:56:53.852+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:56:53.852+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:56:53.854+0000 I SHARDING [conn711] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:53.854+0000 I SHARDING [conn1006] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:53.855+0000 I SHARDING [conn1037] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:53.855+0000 I SHARDING [conn1642] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:53.856+0000 I SHARDING [conn3021] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:53.963+0000 I SHARDING [conn176] moveChunk setting version to: 30566|0||563ba74d869758a4542b9075 2016-03-13T08:56:53.963+0000 I SHARDING [conn1902] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:53.963+0000 I SHARDING [conn1704] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:56:53.997+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 15650424, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:56:53.997+0000 I SHARDING [conn176] moveChunk updating self version to: 30566|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') } for collection 'mydomain.Sessions' 2016-03-13T08:56:54.134+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:54.134+0000-56e52b562848c4eacbd0108a", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859414134), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 15650424, catchup: 0, steady: 0 } } 2016-03-13T08:56:54.167+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:56:54.167+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:56:54.168+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:56:54.168+0000-56e52b562848c4eacbd0108b", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859414168), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, step 1 of 6: 0, step 2 of 6: 316, step 3 of 6: 177, step 4 of 6: 8402, step 5 of 6: 315, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:56:54.423+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:56:54.423+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f56f7bc3500e9458792d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30565000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3616 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 85891, W: 6052 } } } protocol:op_command 9467ms 2016-03-13T08:56:54.995+0000 I SHARDING [conn1514] remotely refreshing metadata for mydomain.Sessions with requested shard version 30566|1||563ba74d869758a4542b9075 based on current shard version 30566|0||563ba74d869758a4542b9075, current metadata version is 30566|0||563ba74d869758a4542b9075 2016-03-13T08:56:54.995+0000 I SHARDING [conn1642] remotely refreshing metadata for mydomain.Sessions with requested shard version 30566|1||563ba74d869758a4542b9075 based on current shard version 30566|0||563ba74d869758a4542b9075, current metadata version is 30566|0||563ba74d869758a4542b9075 2016-03-13T08:56:55.036+0000 I SHARDING [conn1359] remotely refreshing metadata for mydomain.Sessions with requested shard version 30566|1||563ba74d869758a4542b9075 based on current shard version 30566|0||563ba74d869758a4542b9075, current metadata version is 30566|0||563ba74d869758a4542b9075 2016-03-13T08:56:55.113+0000 I SHARDING [conn1642] updating metadata for mydomain.Sessions from shard version 30566|0||563ba74d869758a4542b9075 to shard version 30566|1||563ba74d869758a4542b9075 2016-03-13T08:56:55.114+0000 I SHARDING [conn1642] collection version was loaded at version 30566|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T08:56:55.120+0000 I SHARDING [conn1514] metadata of collection mydomain.Sessions already up to date (shard version : 30566|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T08:56:55.181+0000 I SHARDING [conn1359] metadata of collection mydomain.Sessions already up to date (shard version : 30566|1||563ba74d869758a4542b9075, took 144ms) 2016-03-13T08:56:59.613+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30566000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:56:59.878+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }) in mydomain.Sessions', ts : 56e52b5b2848c4eacbd0108c 2016-03-13T08:56:59.878+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30566|1||563ba74d869758a4542b9075, current metadata version is 30566|1||563ba74d869758a4542b9075 2016-03-13T08:57:00.000+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30566|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T08:57:00.037+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:00.037+0000-56e52b5c2848c4eacbd0108d", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859420037), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:57:00.057+0000 I SHARDING [conn176] moveChunk request accepted at version 30566|1||563ba74d869758a4542b9075 2016-03-13T08:57:00.201+0000 I SHARDING [conn176] moveChunk number of documents: 5387 2016-03-13T08:57:00.250+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.253+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.257+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.269+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.289+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.330+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.411+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.553+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:00.836+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:01.362+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:02.394+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:03.426+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:04.458+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:05.483+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2522, clonedBytes: 6422426, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:06.508+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16829352, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:07.532+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b5c2848c4eacbd0108e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16829352, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:07.532+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:57:07.533+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:57:07.657+0000 I SHARDING [conn176] moveChunk setting version to: 30567|0||563ba74d869758a4542b9075 2016-03-13T08:57:07.658+0000 I SHARDING [conn3322] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:07.658+0000 I SHARDING [conn658] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:07.658+0000 I SHARDING [conn1660] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:07.658+0000 I SHARDING [conn1954] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:07.659+0000 I SHARDING [conn1271] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:07.659+0000 I SHARDING [conn2716] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:07.659+0000 I SHARDING [conn2362] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:07.673+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16829352, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:57:07.673+0000 I SHARDING [conn176] moveChunk updating self version to: 30567|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') } for collection 'mydomain.Sessions' 2016-03-13T08:57:07.742+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:07.742+0000-56e52b632848c4eacbd0108f", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859427742), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16829352, catchup: 0, steady: 0 } } 2016-03-13T08:57:07.775+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:57:07.778+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:57:07.778+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:07.778+0000-56e52b632848c4eacbd01090", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859427778), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, step 1 of 6: 0, step 2 of 6: 443, step 3 of 6: 191, step 4 of 6: 7283, step 5 of 6: 245, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:57:07.912+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:57:07.913+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f67e99bdd00ea3c9252c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30566000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3635 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 15738 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 97067, W: 3004 } } } protocol:op_command 8299ms 2016-03-13T08:57:08.604+0000 I SHARDING [conn624] remotely refreshing metadata for mydomain.Sessions with requested shard version 30567|1||563ba74d869758a4542b9075 based on current shard version 30567|0||563ba74d869758a4542b9075, current metadata version is 30567|0||563ba74d869758a4542b9075 2016-03-13T08:57:08.604+0000 I SHARDING [conn1650] remotely refreshing metadata for mydomain.Sessions with requested shard version 30567|1||563ba74d869758a4542b9075 based on current shard version 30567|0||563ba74d869758a4542b9075, current metadata version is 30567|0||563ba74d869758a4542b9075 2016-03-13T08:57:08.604+0000 I SHARDING [conn835] remotely refreshing metadata for mydomain.Sessions with requested shard version 30567|1||563ba74d869758a4542b9075 based on current shard version 30567|0||563ba74d869758a4542b9075, current metadata version is 30567|0||563ba74d869758a4542b9075 2016-03-13T08:57:08.732+0000 I SHARDING [conn835] updating metadata for mydomain.Sessions from shard version 30567|0||563ba74d869758a4542b9075 to shard version 30567|1||563ba74d869758a4542b9075 2016-03-13T08:57:08.732+0000 I SHARDING [conn624] metadata of collection mydomain.Sessions already up to date (shard version : 30567|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:57:08.732+0000 I SHARDING [conn835] collection version was loaded at version 30567|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T08:57:08.732+0000 I SHARDING [conn1650] metadata of collection mydomain.Sessions already up to date (shard version : 30567|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:57:10.886+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:57:10.592+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:57:13.172+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30567000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:57:13.450+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }) in mydomain.Sessions', ts : 56e52b692848c4eacbd01091 2016-03-13T08:57:13.450+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30567|1||563ba74d869758a4542b9075, current metadata version is 30567|1||563ba74d869758a4542b9075 2016-03-13T08:57:13.575+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30567|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T08:57:13.611+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:13.611+0000-56e52b692848c4eacbd01092", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859433611), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:57:13.637+0000 I SHARDING [conn176] moveChunk request accepted at version 30567|1||563ba74d869758a4542b9075 2016-03-13T08:57:13.748+0000 I SHARDING [conn176] moveChunk number of documents: 5387 2016-03-13T08:57:13.801+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:13.803+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:13.822+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:13.840+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:13.862+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:13.901+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:13.966+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:14.105+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:14.387+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:14.955+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:15.986+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:17.018+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:18.070+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:19.115+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1253, clonedBytes: 2894634, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:19.819+0000 I JOURNAL [journal writer] old journal file will be removed: /data/journal/j._1154 2016-03-13T08:57:20.140+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2109, clonedBytes: 4920961, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:21.165+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4497, clonedBytes: 12477859, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:22.190+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 15975341, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:23.214+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b692848c4eacbd01093", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 15975341, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:23.214+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:57:23.215+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:57:23.216+0000 I SHARDING [conn1353] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:23.324+0000 I SHARDING [conn176] moveChunk setting version to: 30568|0||563ba74d869758a4542b9075 2016-03-13T08:57:23.324+0000 I SHARDING [conn1886] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:23.326+0000 I SHARDING [conn2046] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:23.327+0000 I SHARDING [conn1726] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:23.327+0000 I SHARDING [conn1164] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:23.328+0000 I SHARDING [conn3321] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:23.328+0000 I SHARDING [conn2730] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:23.357+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 15975341, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:57:23.357+0000 I SHARDING [conn176] moveChunk updating self version to: 30568|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') } for collection 'mydomain.Sessions' 2016-03-13T08:57:23.485+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:23.485+0000-56e52b732848c4eacbd01094", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859443485), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 15975341, catchup: 0, steady: 0 } } 2016-03-13T08:57:23.518+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:57:23.519+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:57:23.523+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:23.523+0000-56e52b732848c4eacbd01095", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859443523), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, step 1 of 6: 0, step 2 of 6: 465, step 3 of 6: 159, step 4 of 6: 9418, step 5 of 6: 304, step 6 of 6: 3, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:57:23.723+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:57:23.723+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f78cce48b40ea18e400f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30567000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1542 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 76820, W: 2771 } } } protocol:op_command 10551ms 2016-03-13T08:57:24.303+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087d10584ad1621aec6109') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087de65366dd0e4aaaac79') } 2016-03-13T08:57:24.348+0000 I SHARDING [conn1720] remotely refreshing metadata for mydomain.Sessions with requested shard version 30568|1||563ba74d869758a4542b9075 based on current shard version 30568|0||563ba74d869758a4542b9075, current metadata version is 30568|0||563ba74d869758a4542b9075 2016-03-13T08:57:24.348+0000 I SHARDING [conn1886] remotely refreshing metadata for mydomain.Sessions with requested shard version 30568|1||563ba74d869758a4542b9075 based on current shard version 30568|0||563ba74d869758a4542b9075, current metadata version is 30568|0||563ba74d869758a4542b9075 2016-03-13T08:57:24.349+0000 I SHARDING [conn904] remotely refreshing metadata for mydomain.Sessions with requested shard version 30568|1||563ba74d869758a4542b9075 based on current shard version 30568|0||563ba74d869758a4542b9075, current metadata version is 30568|0||563ba74d869758a4542b9075 2016-03-13T08:57:24.468+0000 I SHARDING [conn904] updating metadata for mydomain.Sessions from shard version 30568|0||563ba74d869758a4542b9075 to shard version 30568|1||563ba74d869758a4542b9075 2016-03-13T08:57:24.468+0000 I SHARDING [conn1720] metadata of collection mydomain.Sessions already up to date (shard version : 30568|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T08:57:24.468+0000 I SHARDING [conn1886] metadata of collection mydomain.Sessions already up to date (shard version : 30568|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T08:57:24.468+0000 I SHARDING [conn904] collection version was loaded at version 30568|1||563ba74d869758a4542b9075, took 119ms 2016-03-13T08:57:24.720+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087de65366dd0e4aaaac79') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087ebfe5aec60e69cabfb8') }, with opId: 768545901 2016-03-13T08:57:29.160+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30568000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:57:29.441+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }) in mydomain.Sessions', ts : 56e52b792848c4eacbd01096 2016-03-13T08:57:29.441+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30568|1||563ba74d869758a4542b9075, current metadata version is 30568|1||563ba74d869758a4542b9075 2016-03-13T08:57:29.572+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30568|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T08:57:29.609+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:29.609+0000-56e52b792848c4eacbd01097", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859449609), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:57:29.637+0000 I SHARDING [conn176] moveChunk request accepted at version 30568|1||563ba74d869758a4542b9075 2016-03-13T08:57:29.749+0000 I SHARDING [conn176] moveChunk number of documents: 5310 2016-03-13T08:57:29.799+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:29.803+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:29.821+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:29.842+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:29.862+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:29.902+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:29.967+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:30.104+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:30.368+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:30.894+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:31.926+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:32.958+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:33.990+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:35.015+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2404, clonedBytes: 6013728, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:36.039+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4414, clonedBytes: 12680416, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:37.064+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5310, clonedBytes: 16412747, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:38.089+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b792848c4eacbd01098", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5310, clonedBytes: 16412747, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:38.089+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:57:38.090+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:57:38.214+0000 I SHARDING [conn176] moveChunk setting version to: 30569|0||563ba74d869758a4542b9075 2016-03-13T08:57:38.216+0000 I SHARDING [conn1942] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:38.217+0000 I SHARDING [conn2835] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:38.217+0000 I SHARDING [conn2380] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:38.217+0000 I SHARDING [conn1384] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:38.217+0000 I SHARDING [conn1785] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:38.217+0000 I SHARDING [conn689] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:38.218+0000 I SHARDING [conn2864] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:38.250+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5310, clonedBytes: 16412747, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:57:38.250+0000 I SHARDING [conn176] moveChunk updating self version to: 30569|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') } for collection 'mydomain.Sessions' 2016-03-13T08:57:38.369+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:38.369+0000-56e52b822848c4eacbd01099", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859458369), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, from: "shmydomain1", to: "shmydomain3", cloned: 5310, clonedBytes: 16412747, catchup: 0, steady: 0 } } 2016-03-13T08:57:38.402+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:57:38.402+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:57:38.402+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:38.402+0000-56e52b822848c4eacbd0109a", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859458402), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, step 1 of 6: 0, step 2 of 6: 476, step 3 of 6: 160, step 4 of 6: 8291, step 5 of 6: 313, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:57:38.577+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:57:38.577+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f89a7bc3500e961adecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30568000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:41 reslen:134 locks:{ Global: { acquireCount: { r: 90, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3022 } }, MMAPV1Journal: { acquireCount: { r: 82, w: 4 } }, Database: { acquireCount: { r: 43, w: 2 } }, Collection: { acquireCount: { R: 43, W: 2 }, acquireWaitCount: { R: 37, W: 2 }, timeAcquiringMicros: { R: 72998, W: 20033 } } } protocol:op_command 9417ms 2016-03-13T08:57:39.238+0000 I SHARDING [conn908] remotely refreshing metadata for mydomain.Sessions with requested shard version 30569|1||563ba74d869758a4542b9075 based on current shard version 30569|0||563ba74d869758a4542b9075, current metadata version is 30569|0||563ba74d869758a4542b9075 2016-03-13T08:57:39.238+0000 I SHARDING [conn438] remotely refreshing metadata for mydomain.Sessions with requested shard version 30569|1||563ba74d869758a4542b9075 based on current shard version 30569|0||563ba74d869758a4542b9075, current metadata version is 30569|0||563ba74d869758a4542b9075 2016-03-13T08:57:39.242+0000 I SHARDING [conn1296] remotely refreshing metadata for mydomain.Sessions with requested shard version 30569|1||563ba74d869758a4542b9075 based on current shard version 30569|0||563ba74d869758a4542b9075, current metadata version is 30569|0||563ba74d869758a4542b9075 2016-03-13T08:57:39.362+0000 I SHARDING [conn438] updating metadata for mydomain.Sessions from shard version 30569|0||563ba74d869758a4542b9075 to shard version 30569|1||563ba74d869758a4542b9075 2016-03-13T08:57:39.362+0000 I SHARDING [conn908] metadata of collection mydomain.Sessions already up to date (shard version : 30569|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T08:57:39.362+0000 I SHARDING [conn1296] metadata of collection mydomain.Sessions already up to date (shard version : 30569|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T08:57:39.362+0000 I SHARDING [conn438] collection version was loaded at version 30569|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T08:57:41.100+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:57:40.886+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:57:43.815+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30569000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:57:43.971+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }) in mydomain.Sessions', ts : 56e52b872848c4eacbd0109b 2016-03-13T08:57:43.971+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30569|1||563ba74d869758a4542b9075, current metadata version is 30569|1||563ba74d869758a4542b9075 2016-03-13T08:57:44.095+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30569|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T08:57:44.130+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:44.130+0000-56e52b882848c4eacbd0109c", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859464130), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:57:44.141+0000 I SHARDING [conn176] moveChunk request accepted at version 30569|1||563ba74d869758a4542b9075 2016-03-13T08:57:44.248+0000 I SHARDING [conn176] moveChunk number of documents: 5386 2016-03-13T08:57:44.298+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.301+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.315+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.334+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.355+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.395+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.476+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.618+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:44.881+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:45.407+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:46.439+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:47.471+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:48.504+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:49.529+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1923, clonedBytes: 4146357, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:50.554+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4960, clonedBytes: 14352663, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:51.579+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5133, clonedBytes: 15035380, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:52.603+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5386, clonedBytes: 17065339, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:53.628+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b882848c4eacbd0109d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5386, clonedBytes: 17065339, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:57:53.628+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T08:57:53.637+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T08:57:53.637+0000 I SHARDING [conn2576] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:53.638+0000 I SHARDING [conn818] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:53.638+0000 I SHARDING [conn666] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:53.748+0000 I SHARDING [conn176] moveChunk setting version to: 30570|0||563ba74d869758a4542b9075 2016-03-13T08:57:53.750+0000 I SHARDING [conn610] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:53.751+0000 I SHARDING [conn902] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:53.758+0000 I SHARDING [conn1607] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:53.758+0000 I SHARDING [conn2182] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:57:55.060+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5386, clonedBytes: 17065339, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:57:55.060+0000 I SHARDING [conn176] moveChunk updating self version to: 30570|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') } for collection 'mydomain.Sessions' 2016-03-13T08:57:56.167+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087de65366dd0e4aaaac79') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087ebfe5aec60e69cabfb8') } 2016-03-13T08:57:56.321+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087ebfe5aec60e69cabfb8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087f9a2a8aa33e03162d51') }, with opId: 768594310 2016-03-13T08:57:56.642+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:56.642+0000-56e52b942848c4eacbd0109e", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859476642), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, from: "shmydomain1", to: "shmydomain3", cloned: 5386, clonedBytes: 17065339, catchup: 0, steady: 0 } } 2016-03-13T08:57:56.678+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:57:56.678+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T08:57:56.679+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:57:56.679+0000-56e52b942848c4eacbd0109f", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859476679), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, step 1 of 6: 0, step 2 of 6: 326, step 3 of 6: 154, step 4 of 6: 9331, step 5 of 6: 3050, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:57:57.030+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:57:57.030+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633f9a1ce48b40ea18e72fb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30569000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4483 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 2 }, timeAcquiringMicros: { R: 62933, W: 7794 } } } protocol:op_command 13215ms 2016-03-13T08:57:57.513+0000 I SHARDING [conn1717] remotely refreshing metadata for mydomain.Sessions with requested shard version 30570|1||563ba74d869758a4542b9075 based on current shard version 30570|0||563ba74d869758a4542b9075, current metadata version is 30570|0||563ba74d869758a4542b9075 2016-03-13T08:57:57.516+0000 I SHARDING [conn1753] remotely refreshing metadata for mydomain.Sessions with requested shard version 30570|1||563ba74d869758a4542b9075 based on current shard version 30570|0||563ba74d869758a4542b9075, current metadata version is 30570|0||563ba74d869758a4542b9075 2016-03-13T08:57:57.516+0000 I SHARDING [conn798] remotely refreshing metadata for mydomain.Sessions with requested shard version 30570|1||563ba74d869758a4542b9075 based on current shard version 30570|0||563ba74d869758a4542b9075, current metadata version is 30570|0||563ba74d869758a4542b9075 2016-03-13T08:57:57.647+0000 I SHARDING [conn798] updating metadata for mydomain.Sessions from shard version 30570|0||563ba74d869758a4542b9075 to shard version 30570|1||563ba74d869758a4542b9075 2016-03-13T08:57:57.647+0000 I SHARDING [conn1717] metadata of collection mydomain.Sessions already up to date (shard version : 30570|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T08:57:57.647+0000 I SHARDING [conn1753] metadata of collection mydomain.Sessions already up to date (shard version : 30570|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T08:57:57.647+0000 I SHARDING [conn798] collection version was loaded at version 30570|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T08:58:01.590+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30570000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:58:01.850+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }) in mydomain.Sessions', ts : 56e52b992848c4eacbd010a0 2016-03-13T08:58:01.851+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30570|1||563ba74d869758a4542b9075, current metadata version is 30570|1||563ba74d869758a4542b9075 2016-03-13T08:58:01.974+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30570|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T08:58:02.011+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:02.011+0000-56e52b9a2848c4eacbd010a1", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859482011), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:58:02.037+0000 I SHARDING [conn152] moveChunk request accepted at version 30570|1||563ba74d869758a4542b9075 2016-03-13T08:58:02.148+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T08:58:02.198+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.200+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.205+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.218+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.238+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.298+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.399+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.582+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:02.845+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:03.371+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:04.403+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:05.435+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:06.467+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:07.512+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 201, clonedBytes: 442163, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:08.537+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3009, clonedBytes: 7494525, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:09.562+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16554470, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:10.586+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52b9a2848c4eacbd010a2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16554470, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:10.586+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:58:10.587+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:58:10.587+0000 I SHARDING [conn2326] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:10.695+0000 I SHARDING [conn152] moveChunk setting version to: 30571|0||563ba74d869758a4542b9075 2016-03-13T08:58:10.695+0000 I SHARDING [conn2011] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:10.695+0000 I SHARDING [conn2267] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:10.696+0000 I SHARDING [conn617] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:10.697+0000 I SHARDING [conn1728] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:10.697+0000 I SHARDING [conn1628] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:10.697+0000 I SHARDING [conn102] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:10.743+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16554470, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:58:10.743+0000 I SHARDING [conn152] moveChunk updating self version to: 30571|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') } for collection 'mydomain.Sessions' 2016-03-13T08:58:10.864+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:10.864+0000-56e52ba22848c4eacbd010a3", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859490864), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16554470, catchup: 0, steady: 0 } } 2016-03-13T08:58:10.918+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:58:10.921+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:58:10.921+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:10.921+0000-56e52ba22848c4eacbd010a4", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859490921), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, step 1 of 6: 0, step 2 of 6: 446, step 3 of 6: 159, step 4 of 6: 8390, step 5 of 6: 334, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:58:11.173+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:58:11.173+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633faaace48b40ea18e8bb6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30570000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3708 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 74344, W: 1771 } } } protocol:op_command 9583ms 2016-03-13T08:58:11.376+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:58:11.100+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:58:11.728+0000 I SHARDING [conn2134] remotely refreshing metadata for mydomain.Sessions with requested shard version 30571|1||563ba74d869758a4542b9075 based on current shard version 30571|0||563ba74d869758a4542b9075, current metadata version is 30571|0||563ba74d869758a4542b9075 2016-03-13T08:58:11.728+0000 I SHARDING [conn1875] remotely refreshing metadata for mydomain.Sessions with requested shard version 30571|1||563ba74d869758a4542b9075 based on current shard version 30571|0||563ba74d869758a4542b9075, current metadata version is 30571|0||563ba74d869758a4542b9075 2016-03-13T08:58:11.728+0000 I SHARDING [conn1728] remotely refreshing metadata for mydomain.Sessions with requested shard version 30571|1||563ba74d869758a4542b9075 based on current shard version 30571|0||563ba74d869758a4542b9075, current metadata version is 30571|0||563ba74d869758a4542b9075 2016-03-13T08:58:11.862+0000 I SHARDING [conn1875] updating metadata for mydomain.Sessions from shard version 30571|0||563ba74d869758a4542b9075 to shard version 30571|1||563ba74d869758a4542b9075 2016-03-13T08:58:11.862+0000 I SHARDING [conn1728] metadata of collection mydomain.Sessions already up to date (shard version : 30571|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T08:58:11.862+0000 I SHARDING [conn2134] metadata of collection mydomain.Sessions already up to date (shard version : 30571|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T08:58:11.862+0000 I SHARDING [conn1875] collection version was loaded at version 30571|1||563ba74d869758a4542b9075, took 129ms 2016-03-13T08:58:15.838+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30571000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:58:16.059+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }) in mydomain.Sessions', ts : 56e52ba72848c4eacbd010a5 2016-03-13T08:58:16.059+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30571|1||563ba74d869758a4542b9075, current metadata version is 30571|1||563ba74d869758a4542b9075 2016-03-13T08:58:16.197+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30571|1||563ba74d869758a4542b9075, took 134ms) 2016-03-13T08:58:16.246+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:16.246+0000-56e52ba82848c4eacbd010a6", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859496246), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:58:16.272+0000 I SHARDING [conn152] moveChunk request accepted at version 30571|1||563ba74d869758a4542b9075 2016-03-13T08:58:16.570+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T08:58:16.623+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:16.640+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:16.662+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:16.680+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:16.701+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:16.741+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:16.822+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:16.971+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:17.228+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:17.753+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:18.785+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:19.837+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:20.870+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:21.895+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2462, clonedBytes: 5356407, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:22.919+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4905, clonedBytes: 14060030, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:23.944+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 17059189, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:24.969+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ba82848c4eacbd010a7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 17059189, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:24.969+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:58:24.970+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:58:24.970+0000 I SHARDING [conn1947] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:24.970+0000 I SHARDING [conn2719] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:24.970+0000 I SHARDING [conn2358] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:24.971+0000 I SHARDING [conn1110] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:25.080+0000 I SHARDING [conn152] moveChunk setting version to: 30572|0||563ba74d869758a4542b9075 2016-03-13T08:58:25.082+0000 I SHARDING [conn433] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:25.082+0000 I SHARDING [conn904] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:25.083+0000 I SHARDING [conn3001] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:25.112+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 17059189, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:58:25.112+0000 I SHARDING [conn152] moveChunk updating self version to: 30572|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') } for collection 'mydomain.Sessions' 2016-03-13T08:58:25.276+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:25.276+0000-56e52bb12848c4eacbd010a8", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859505276), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 17059189, catchup: 0, steady: 0 } } 2016-03-13T08:58:25.308+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:58:25.312+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:58:25.312+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:25.312+0000-56e52bb12848c4eacbd010a9", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859505312), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, step 1 of 6: 0, step 2 of 6: 434, step 3 of 6: 345, step 4 of 6: 8350, step 5 of 6: 343, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:58:25.572+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:58:25.572+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fbb4ce48b40ea368d54f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30571000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:43 reslen:134 locks:{ Global: { acquireCount: { r: 94, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 9586 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 45, w: 2 } }, Collection: { acquireCount: { R: 45, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 149325, W: 6127 } } } protocol:op_command 9735ms 2016-03-13T08:58:26.136+0000 I SHARDING [conn1847] remotely refreshing metadata for mydomain.Sessions with requested shard version 30572|1||563ba74d869758a4542b9075 based on current shard version 30572|0||563ba74d869758a4542b9075, current metadata version is 30572|0||563ba74d869758a4542b9075 2016-03-13T08:58:26.144+0000 I SHARDING [conn773] remotely refreshing metadata for mydomain.Sessions with requested shard version 30572|1||563ba74d869758a4542b9075 based on current shard version 30572|0||563ba74d869758a4542b9075, current metadata version is 30572|0||563ba74d869758a4542b9075 2016-03-13T08:58:26.144+0000 I SHARDING [conn2086] remotely refreshing metadata for mydomain.Sessions with requested shard version 30572|1||563ba74d869758a4542b9075 based on current shard version 30572|0||563ba74d869758a4542b9075, current metadata version is 30572|0||563ba74d869758a4542b9075 2016-03-13T08:58:26.261+0000 I SHARDING [conn1847] updating metadata for mydomain.Sessions from shard version 30572|0||563ba74d869758a4542b9075 to shard version 30572|1||563ba74d869758a4542b9075 2016-03-13T08:58:26.261+0000 I SHARDING [conn773] metadata of collection mydomain.Sessions already up to date (shard version : 30572|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T08:58:26.261+0000 I SHARDING [conn2086] metadata of collection mydomain.Sessions already up to date (shard version : 30572|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T08:58:26.262+0000 I SHARDING [conn1847] collection version was loaded at version 30572|1||563ba74d869758a4542b9075, took 125ms 2016-03-13T08:58:27.214+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087ebfe5aec60e69cabfb8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087f9a2a8aa33e03162d51') } 2016-03-13T08:58:27.509+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087f9a2a8aa33e03162d51') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608806fe5aec60e69cae2ed') }, with opId: 768641465 2016-03-13T08:58:30.428+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30572000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:58:30.699+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }) in mydomain.Sessions', ts : 56e52bb62848c4eacbd010aa 2016-03-13T08:58:30.699+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30572|1||563ba74d869758a4542b9075, current metadata version is 30572|1||563ba74d869758a4542b9075 2016-03-13T08:58:30.826+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30572|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T08:58:30.863+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:30.863+0000-56e52bb62848c4eacbd010ab", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859510863), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:58:30.887+0000 I SHARDING [conn152] moveChunk request accepted at version 30572|1||563ba74d869758a4542b9075 2016-03-13T08:58:31.011+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:58:31.082+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.084+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.089+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.097+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.122+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.163+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.244+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.385+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:31.649+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:32.175+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:33.207+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:34.259+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:35.312+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:36.337+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2305, clonedBytes: 5127949, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:37.376+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5322, clonedBytes: 16740382, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:38.401+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 17150103, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:39.426+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bb62848c4eacbd010ac", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 17150103, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:39.426+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:58:39.427+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:58:39.428+0000 I SHARDING [conn2341] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:39.428+0000 I SHARDING [conn2882] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:39.537+0000 I SHARDING [conn152] moveChunk setting version to: 30573|0||563ba74d869758a4542b9075 2016-03-13T08:58:39.537+0000 I SHARDING [conn1770] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:39.565+0000 I SHARDING [conn1560] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:39.565+0000 I SHARDING [conn2415] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:39.565+0000 I SHARDING [conn1443] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:39.566+0000 I SHARDING [conn1384] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:39.590+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 17150103, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:58:39.590+0000 I SHARDING [conn152] moveChunk updating self version to: 30573|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') } for collection 'mydomain.Sessions' 2016-03-13T08:58:39.727+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:39.727+0000-56e52bbf2848c4eacbd010ad", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859519727), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 17150103, catchup: 0, steady: 0 } } 2016-03-13T08:58:39.761+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:58:39.762+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:58:39.763+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:39.763+0000-56e52bbf2848c4eacbd010ae", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859519763), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, step 1 of 6: 0, step 2 of 6: 459, step 3 of 6: 171, step 4 of 6: 8367, step 5 of 6: 336, step 6 of 6: 1, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:58:39.933+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:58:39.933+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fcb7ce48b40ea18eb8ce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30572000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3615 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 77348, W: 7688 } } } protocol:op_command 9505ms 2016-03-13T08:58:40.592+0000 I SHARDING [conn1770] remotely refreshing metadata for mydomain.Sessions with requested shard version 30573|1||563ba74d869758a4542b9075 based on current shard version 30573|0||563ba74d869758a4542b9075, current metadata version is 30573|0||563ba74d869758a4542b9075 2016-03-13T08:58:40.592+0000 I SHARDING [conn2882] remotely refreshing metadata for mydomain.Sessions with requested shard version 30573|1||563ba74d869758a4542b9075 based on current shard version 30573|0||563ba74d869758a4542b9075, current metadata version is 30573|0||563ba74d869758a4542b9075 2016-03-13T08:58:40.600+0000 I SHARDING [conn1784] remotely refreshing metadata for mydomain.Sessions with requested shard version 30573|1||563ba74d869758a4542b9075 based on current shard version 30573|0||563ba74d869758a4542b9075, current metadata version is 30573|0||563ba74d869758a4542b9075 2016-03-13T08:58:40.716+0000 I SHARDING [conn2882] updating metadata for mydomain.Sessions from shard version 30573|0||563ba74d869758a4542b9075 to shard version 30573|1||563ba74d869758a4542b9075 2016-03-13T08:58:40.716+0000 I SHARDING [conn1770] metadata of collection mydomain.Sessions already up to date (shard version : 30573|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T08:58:40.716+0000 I SHARDING [conn1784] metadata of collection mydomain.Sessions already up to date (shard version : 30573|1||563ba74d869758a4542b9075, took 115ms) 2016-03-13T08:58:40.716+0000 I SHARDING [conn2882] collection version was loaded at version 30573|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T08:58:41.538+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:58:41.376+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:58:44.977+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30573000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:58:45.158+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }) in mydomain.Sessions', ts : 56e52bc42848c4eacbd010af 2016-03-13T08:58:45.158+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30573|1||563ba74d869758a4542b9075, current metadata version is 30573|1||563ba74d869758a4542b9075 2016-03-13T08:58:45.291+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30573|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T08:58:45.327+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:45.327+0000-56e52bc52848c4eacbd010b0", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859525327), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:58:45.362+0000 I SHARDING [conn152] moveChunk request accepted at version 30573|1||563ba74d869758a4542b9075 2016-03-13T08:58:45.489+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:58:45.538+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:45.541+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:45.555+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:45.575+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:45.595+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:45.635+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:45.717+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:45.858+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:46.121+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:46.647+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:47.690+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:48.722+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:49.756+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:50.799+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1782, clonedBytes: 3806188, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:51.838+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4904, clonedBytes: 14533422, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:52.862+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16874981, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:53.887+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bc52848c4eacbd010b1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16874981, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:58:53.887+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:58:53.888+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:58:53.889+0000 I SHARDING [conn1408] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:53.890+0000 I SHARDING [conn1398] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:53.998+0000 I SHARDING [conn152] moveChunk setting version to: 30574|0||563ba74d869758a4542b9075 2016-03-13T08:58:53.998+0000 I SHARDING [conn1047] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:54.000+0000 I SHARDING [conn2218] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:54.000+0000 I SHARDING [conn210] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:54.000+0000 I SHARDING [conn2355] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:54.002+0000 I SHARDING [conn1091] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:58:54.022+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16874981, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:58:54.022+0000 I SHARDING [conn152] moveChunk updating self version to: 30574|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') } for collection 'mydomain.Sessions' 2016-03-13T08:58:54.160+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:54.160+0000-56e52bce2848c4eacbd010b2", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859534160), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16874981, catchup: 0, steady: 0 } } 2016-03-13T08:58:54.194+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:58:54.195+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:58:54.196+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:58:54.195+0000-56e52bce2848c4eacbd010b3", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859534195), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, step 1 of 6: 0, step 2 of 6: 385, step 3 of 6: 174, step 4 of 6: 8350, step 5 of 6: 308, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:58:54.399+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:58:54.399+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fdb9ce48b40ea369059d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30573000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1302 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 82799, W: 6741 } } } protocol:op_command 9423ms 2016-03-13T08:58:55.021+0000 I SHARDING [conn1704] remotely refreshing metadata for mydomain.Sessions with requested shard version 30574|1||563ba74d869758a4542b9075 based on current shard version 30574|0||563ba74d869758a4542b9075, current metadata version is 30574|0||563ba74d869758a4542b9075 2016-03-13T08:58:55.021+0000 I SHARDING [conn2218] remotely refreshing metadata for mydomain.Sessions with requested shard version 30574|1||563ba74d869758a4542b9075 based on current shard version 30574|0||563ba74d869758a4542b9075, current metadata version is 30574|0||563ba74d869758a4542b9075 2016-03-13T08:58:55.024+0000 I SHARDING [conn210] remotely refreshing metadata for mydomain.Sessions with requested shard version 30574|1||563ba74d869758a4542b9075 based on current shard version 30574|0||563ba74d869758a4542b9075, current metadata version is 30574|0||563ba74d869758a4542b9075 2016-03-13T08:58:55.148+0000 I SHARDING [conn1704] updating metadata for mydomain.Sessions from shard version 30574|0||563ba74d869758a4542b9075 to shard version 30574|1||563ba74d869758a4542b9075 2016-03-13T08:58:55.148+0000 I SHARDING [conn2218] metadata of collection mydomain.Sessions already up to date (shard version : 30574|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:58:55.148+0000 I SHARDING [conn210] metadata of collection mydomain.Sessions already up to date (shard version : 30574|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T08:58:55.148+0000 I SHARDING [conn1704] collection version was loaded at version 30574|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T08:58:58.761+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56087f9a2a8aa33e03162d51') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608806fe5aec60e69cae2ed') } 2016-03-13T08:58:58.888+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608806fe5aec60e69cae2ed') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608814b5366dd0e48f588ca') }, with opId: 768693270 2016-03-13T08:59:00.770+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30574000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:59:00.980+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }) in mydomain.Sessions', ts : 56e52bd42848c4eacbd010b4 2016-03-13T08:59:00.981+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30574|1||563ba74d869758a4542b9075, current metadata version is 30574|1||563ba74d869758a4542b9075 2016-03-13T08:59:01.099+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30574|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T08:59:01.136+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:01.136+0000-56e52bd52848c4eacbd010b5", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859541136), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:59:01.171+0000 I SHARDING [conn152] moveChunk request accepted at version 30574|1||563ba74d869758a4542b9075 2016-03-13T08:59:01.266+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T08:59:01.318+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.321+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.334+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.355+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.394+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.435+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.536+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.677+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:01.941+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:02.467+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:03.500+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:04.551+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:05.583+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:06.608+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2177, clonedBytes: 4991139, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:07.633+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5113, clonedBytes: 15956172, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:08.658+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16979813, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:09.683+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bd52848c4eacbd010b6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16979813, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:09.683+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:59:09.683+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:59:09.685+0000 I SHARDING [conn2801] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:09.685+0000 I SHARDING [conn849] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:09.685+0000 I SHARDING [conn1019] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:09.685+0000 I SHARDING [conn1191] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:09.687+0000 I SHARDING [conn1372] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:09.795+0000 I SHARDING [conn152] moveChunk setting version to: 30575|0||563ba74d869758a4542b9075 2016-03-13T08:59:09.798+0000 I SHARDING [conn1810] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:09.798+0000 I SHARDING [conn2353] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:09.835+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16979813, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:59:09.835+0000 I SHARDING [conn152] moveChunk updating self version to: 30575|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') } for collection 'mydomain.Sessions' 2016-03-13T08:59:09.961+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:09.961+0000-56e52bdd2848c4eacbd010b7", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859549961), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16979813, catchup: 0, steady: 0 } } 2016-03-13T08:59:10.012+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:59:10.014+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:59:10.014+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:10.014+0000-56e52bde2848c4eacbd010b8", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859550014), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, step 1 of 6: 0, step 2 of 6: 401, step 3 of 6: 143, step 4 of 6: 8368, step 5 of 6: 331, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:59:10.233+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:59:10.233+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633fec0ce48b40ea18eeb51') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30574000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2591 } }, MMAPV1Journal: { acquireCount: { r: 79, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 33, W: 1 }, timeAcquiringMicros: { R: 55665, W: 3954 } } } protocol:op_command 9463ms 2016-03-13T08:59:10.852+0000 I SHARDING [conn1403] remotely refreshing metadata for mydomain.Sessions with requested shard version 30575|1||563ba74d869758a4542b9075 based on current shard version 30575|0||563ba74d869758a4542b9075, current metadata version is 30575|0||563ba74d869758a4542b9075 2016-03-13T08:59:10.855+0000 I SHARDING [conn2362] remotely refreshing metadata for mydomain.Sessions with requested shard version 30575|1||563ba74d869758a4542b9075 based on current shard version 30575|0||563ba74d869758a4542b9075, current metadata version is 30575|0||563ba74d869758a4542b9075 2016-03-13T08:59:10.878+0000 I SHARDING [conn2011] remotely refreshing metadata for mydomain.Sessions with requested shard version 30575|1||563ba74d869758a4542b9075 based on current shard version 30575|0||563ba74d869758a4542b9075, current metadata version is 30575|0||563ba74d869758a4542b9075 2016-03-13T08:59:10.984+0000 I SHARDING [conn2362] updating metadata for mydomain.Sessions from shard version 30575|0||563ba74d869758a4542b9075 to shard version 30575|1||563ba74d869758a4542b9075 2016-03-13T08:59:10.984+0000 I SHARDING [conn1403] metadata of collection mydomain.Sessions already up to date (shard version : 30575|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T08:59:10.984+0000 I SHARDING [conn2362] collection version was loaded at version 30575|1||563ba74d869758a4542b9075, took 128ms 2016-03-13T08:59:10.991+0000 I SHARDING [conn2011] metadata of collection mydomain.Sessions already up to date (shard version : 30575|1||563ba74d869758a4542b9075, took 110ms) 2016-03-13T08:59:11.802+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:59:11.538+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:59:15.190+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30575000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:59:15.388+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }) in mydomain.Sessions', ts : 56e52be32848c4eacbd010b9 2016-03-13T08:59:15.388+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30575|1||563ba74d869758a4542b9075, current metadata version is 30575|1||563ba74d869758a4542b9075 2016-03-13T08:59:15.522+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30575|1||563ba74d869758a4542b9075, took 130ms) 2016-03-13T08:59:15.560+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:15.560+0000-56e52be32848c4eacbd010ba", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859555560), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:59:15.594+0000 I SHARDING [conn152] moveChunk request accepted at version 30575|1||563ba74d869758a4542b9075 2016-03-13T08:59:15.709+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:59:15.761+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:15.764+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:15.776+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:15.796+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:15.817+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:15.877+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:15.943+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:16.080+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:16.343+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:16.869+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:17.922+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:18.954+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:19.987+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:21.031+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 487, clonedBytes: 1371083, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:22.056+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3764, clonedBytes: 12022590, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:23.081+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 17013226, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:24.105+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52be32848c4eacbd010bb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 17013226, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:24.105+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:59:24.106+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:59:24.107+0000 I SHARDING [conn637] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:24.108+0000 I SHARDING [conn3014] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:24.217+0000 I SHARDING [conn152] moveChunk setting version to: 30576|0||563ba74d869758a4542b9075 2016-03-13T08:59:24.219+0000 I SHARDING [conn2773] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:24.219+0000 I SHARDING [conn2460] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:24.219+0000 I SHARDING [conn738] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:24.219+0000 I SHARDING [conn659] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:24.219+0000 I SHARDING [conn1849] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:24.239+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 17013226, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:59:24.239+0000 I SHARDING [conn152] moveChunk updating self version to: 30576|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') } for collection 'mydomain.Sessions' 2016-03-13T08:59:24.368+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:24.368+0000-56e52bec2848c4eacbd010bc", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859564368), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 17013226, catchup: 0, steady: 0 } } 2016-03-13T08:59:24.401+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:59:24.404+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:59:24.405+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:24.405+0000-56e52bec2848c4eacbd010bd", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859564405), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, step 1 of 6: 0, step 2 of 6: 404, step 3 of 6: 162, step 4 of 6: 8348, step 5 of 6: 299, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:59:24.607+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:59:24.607+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5633ffc6584ad10f212db43d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30575000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 5651 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 72696, W: 6937 } } } protocol:op_command 9417ms 2016-03-13T08:59:25.227+0000 I SHARDING [conn1726] remotely refreshing metadata for mydomain.Sessions with requested shard version 30576|1||563ba74d869758a4542b9075 based on current shard version 30576|0||563ba74d869758a4542b9075, current metadata version is 30576|0||563ba74d869758a4542b9075 2016-03-13T08:59:25.227+0000 I SHARDING [conn918] remotely refreshing metadata for mydomain.Sessions with requested shard version 30576|1||563ba74d869758a4542b9075 based on current shard version 30576|0||563ba74d869758a4542b9075, current metadata version is 30576|0||563ba74d869758a4542b9075 2016-03-13T08:59:25.267+0000 I SHARDING [conn386] remotely refreshing metadata for mydomain.Sessions with requested shard version 30576|1||563ba74d869758a4542b9075 based on current shard version 30576|0||563ba74d869758a4542b9075, current metadata version is 30576|0||563ba74d869758a4542b9075 2016-03-13T08:59:25.356+0000 I SHARDING [conn1726] updating metadata for mydomain.Sessions from shard version 30576|0||563ba74d869758a4542b9075 to shard version 30576|1||563ba74d869758a4542b9075 2016-03-13T08:59:25.356+0000 I SHARDING [conn918] metadata of collection mydomain.Sessions already up to date (shard version : 30576|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T08:59:25.356+0000 I SHARDING [conn1726] collection version was loaded at version 30576|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T08:59:25.373+0000 I SHARDING [conn386] metadata of collection mydomain.Sessions already up to date (shard version : 30576|1||563ba74d869758a4542b9075, took 104ms) 2016-03-13T08:59:29.673+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30576000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:59:29.762+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608806fe5aec60e69cae2ed') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608814b5366dd0e48f588ca') } 2016-03-13T08:59:29.945+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }) in mydomain.Sessions', ts : 56e52bf12848c4eacbd010be 2016-03-13T08:59:29.945+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30576|1||563ba74d869758a4542b9075, current metadata version is 30576|1||563ba74d869758a4542b9075 2016-03-13T08:59:30.074+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30576|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T08:59:30.111+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:30.111+0000-56e52bf22848c4eacbd010bf", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859570111), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:59:30.139+0000 I SHARDING [conn152] moveChunk request accepted at version 30576|1||563ba74d869758a4542b9075 2016-03-13T08:59:30.180+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T08:59:30.240+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608814b5366dd0e48f588ca') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088224584ad1621aecc471') }, with opId: 768744665 2016-03-13T08:59:30.250+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.270+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.290+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.331+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.371+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.432+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.516+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.675+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:30.931+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:31.444+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:32.476+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:33.508+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:34.540+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:35.566+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2800, clonedBytes: 6735111, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:36.590+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16875408, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:37.615+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bf22848c4eacbd010c0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16875408, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:37.615+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:59:37.616+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:59:37.725+0000 I SHARDING [conn152] moveChunk setting version to: 30577|0||563ba74d869758a4542b9075 2016-03-13T08:59:37.727+0000 I SHARDING [conn910] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:37.727+0000 I SHARDING [conn2723] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:37.727+0000 I SHARDING [conn1941] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:37.727+0000 I SHARDING [conn395] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:37.728+0000 I SHARDING [conn2117] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:37.728+0000 I SHARDING [conn2388] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:37.728+0000 I SHARDING [conn2504] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:37.757+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16875408, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:59:37.757+0000 I SHARDING [conn152] moveChunk updating self version to: 30577|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') } for collection 'mydomain.Sessions' 2016-03-13T08:59:37.880+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:37.880+0000-56e52bf92848c4eacbd010c1", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859577880), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16875408, catchup: 0, steady: 0 } } 2016-03-13T08:59:37.918+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:59:37.919+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:59:37.919+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:37.919+0000-56e52bf92848c4eacbd010c2", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859577919), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, step 1 of 6: 0, step 2 of 6: 465, step 3 of 6: 88, step 4 of 6: 7387, step 5 of 6: 304, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:59:38.191+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:59:38.191+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563400d2ce48b40ea18f188b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30576000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 795 } }, MMAPV1Journal: { acquireCount: { r: 46, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1843 } } } protocol:op_command 8518ms 2016-03-13T08:59:38.750+0000 I SHARDING [conn1884] remotely refreshing metadata for mydomain.Sessions with requested shard version 30577|1||563ba74d869758a4542b9075 based on current shard version 30577|0||563ba74d869758a4542b9075, current metadata version is 30577|0||563ba74d869758a4542b9075 2016-03-13T08:59:38.750+0000 I SHARDING [conn1942] remotely refreshing metadata for mydomain.Sessions with requested shard version 30577|1||563ba74d869758a4542b9075 based on current shard version 30577|0||563ba74d869758a4542b9075, current metadata version is 30577|0||563ba74d869758a4542b9075 2016-03-13T08:59:38.758+0000 I SHARDING [conn2636] remotely refreshing metadata for mydomain.Sessions with requested shard version 30577|1||563ba74d869758a4542b9075 based on current shard version 30577|0||563ba74d869758a4542b9075, current metadata version is 30577|0||563ba74d869758a4542b9075 2016-03-13T08:59:38.867+0000 I SHARDING [conn1884] updating metadata for mydomain.Sessions from shard version 30577|0||563ba74d869758a4542b9075 to shard version 30577|1||563ba74d869758a4542b9075 2016-03-13T08:59:38.867+0000 I SHARDING [conn1884] collection version was loaded at version 30577|1||563ba74d869758a4542b9075, took 116ms 2016-03-13T08:59:38.883+0000 I SHARDING [conn1942] metadata of collection mydomain.Sessions already up to date (shard version : 30577|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T08:59:38.928+0000 I SHARDING [conn2636] metadata of collection mydomain.Sessions already up to date (shard version : 30577|1||563ba74d869758a4542b9075, took 166ms) 2016-03-13T08:59:42.051+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T08:59:41.802+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T08:59:43.025+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30577000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:59:43.251+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }) in mydomain.Sessions', ts : 56e52bff2848c4eacbd010c3 2016-03-13T08:59:43.251+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30577|1||563ba74d869758a4542b9075, current metadata version is 30577|1||563ba74d869758a4542b9075 2016-03-13T08:59:43.369+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30577|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T08:59:43.403+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:43.403+0000-56e52bff2848c4eacbd010c4", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859583403), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:59:43.428+0000 I SHARDING [conn152] moveChunk request accepted at version 30577|1||563ba74d869758a4542b9075 2016-03-13T08:59:43.534+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:59:43.586+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:43.598+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:43.618+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:43.639+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:43.659+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:43.699+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:43.781+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:43.942+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:44.225+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:44.751+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:45.785+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:46.816+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:47.848+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:48.873+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2405, clonedBytes: 5967561, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:49.898+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16632232, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:50.922+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52bff2848c4eacbd010c5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16632232, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:50.922+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T08:59:50.923+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T08:59:50.923+0000 I SHARDING [conn2587] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:50.923+0000 I SHARDING [conn2820] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:50.923+0000 I SHARDING [conn201] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:50.924+0000 I SHARDING [conn905] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:50.925+0000 I SHARDING [conn2458] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:50.925+0000 I SHARDING [conn2503] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:51.033+0000 I SHARDING [conn152] moveChunk setting version to: 30578|0||563ba74d869758a4542b9075 2016-03-13T08:59:51.035+0000 I SHARDING [conn1396] Waiting for 30 seconds for the migration critical section to end 2016-03-13T08:59:51.067+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16632232, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T08:59:51.067+0000 I SHARDING [conn152] moveChunk updating self version to: 30578|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') } for collection 'mydomain.Sessions' 2016-03-13T08:59:51.210+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:51.210+0000-56e52c072848c4eacbd010c6", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859591210), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16632232, catchup: 0, steady: 0 } } 2016-03-13T08:59:51.243+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T08:59:51.243+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T08:59:51.243+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:51.243+0000-56e52c072848c4eacbd010c7", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859591243), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, step 1 of 6: 0, step 2 of 6: 403, step 3 of 6: 154, step 4 of 6: 7340, step 5 of 6: 320, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T08:59:51.449+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T08:59:51.450+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563401d799bdd00ea51b14e2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30577000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 2419 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 1 }, timeAcquiringMicros: { R: 68373, W: 2970 } } } protocol:op_command 8425ms 2016-03-13T08:59:52.071+0000 I SHARDING [conn2180] remotely refreshing metadata for mydomain.Sessions with requested shard version 30578|1||563ba74d869758a4542b9075 based on current shard version 30578|0||563ba74d869758a4542b9075, current metadata version is 30578|0||563ba74d869758a4542b9075 2016-03-13T08:59:52.071+0000 I SHARDING [conn733] remotely refreshing metadata for mydomain.Sessions with requested shard version 30578|1||563ba74d869758a4542b9075 based on current shard version 30578|0||563ba74d869758a4542b9075, current metadata version is 30578|0||563ba74d869758a4542b9075 2016-03-13T08:59:52.111+0000 I SHARDING [conn291] remotely refreshing metadata for mydomain.Sessions with requested shard version 30578|1||563ba74d869758a4542b9075 based on current shard version 30578|0||563ba74d869758a4542b9075, current metadata version is 30578|0||563ba74d869758a4542b9075 2016-03-13T08:59:52.202+0000 I SHARDING [conn2180] updating metadata for mydomain.Sessions from shard version 30578|0||563ba74d869758a4542b9075 to shard version 30578|1||563ba74d869758a4542b9075 2016-03-13T08:59:52.202+0000 I SHARDING [conn733] metadata of collection mydomain.Sessions already up to date (shard version : 30578|1||563ba74d869758a4542b9075, took 130ms) 2016-03-13T08:59:52.202+0000 I SHARDING [conn2180] collection version was loaded at version 30578|1||563ba74d869758a4542b9075, took 130ms 2016-03-13T08:59:52.232+0000 I SHARDING [conn291] metadata of collection mydomain.Sessions already up to date (shard version : 30578|1||563ba74d869758a4542b9075, took 102ms) 2016-03-13T08:59:56.340+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30578000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T08:59:56.631+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }) in mydomain.Sessions', ts : 56e52c0c2848c4eacbd010c8 2016-03-13T08:59:56.631+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30578|1||563ba74d869758a4542b9075, current metadata version is 30578|1||563ba74d869758a4542b9075 2016-03-13T08:59:56.768+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30578|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T08:59:56.806+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T08:59:56.806+0000-56e52c0c2848c4eacbd010c9", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859596806), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T08:59:56.837+0000 I SHARDING [conn152] moveChunk request accepted at version 30578|1||563ba74d869758a4542b9075 2016-03-13T08:59:56.939+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T08:59:56.988+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:56.991+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:57.008+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:57.028+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:57.048+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:57.089+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:57.190+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:57.331+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:57.595+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:58.121+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T08:59:59.163+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:00.088+0000 I COMMAND [conn711] command mydomain.UserFunnelHistory command: getMore { getMore: 163095910246, collection: "UserFunnelHistory" } cursorid:163095910246 keyUpdates:0 writeConflicts:0 numYields:7572 nreturned:24537 reslen:4194480 locks:{ Global: { acquireCount: { r: 15146 } }, MMAPV1Journal: { acquireCount: { r: 8471 }, acquireWaitCount: { r: 4 }, timeAcquiringMicros: { r: 54384 } }, Database: { acquireCount: { r: 7573 } }, Collection: { acquireCount: { R: 7573 }, acquireWaitCount: { R: 898 }, timeAcquiringMicros: { R: 523014 } } } protocol:op_command 5532ms 2016-03-13T09:00:00.216+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:01.248+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:02.273+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1496, clonedBytes: 3746069, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:03.298+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4643, clonedBytes: 14330326, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:04.323+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 17146965, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:04.674+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5318 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608814b5366dd0e48f588ca') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088224584ad1621aecc471') } 2016-03-13T09:00:05.073+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088224584ad1621aecc471') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560882fd2a8aa33e057a6309') }, with opId: 768795048 2016-03-13T09:00:05.347+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c0c2848c4eacbd010ca", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 17146965, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:05.347+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:00:05.348+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:00:05.457+0000 I SHARDING [conn152] moveChunk setting version to: 30579|0||563ba74d869758a4542b9075 2016-03-13T09:00:05.459+0000 I SHARDING [conn1290] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:05.459+0000 I SHARDING [conn2289] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:05.459+0000 I SHARDING [conn836] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:05.460+0000 I SHARDING [conn2033] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:05.460+0000 I SHARDING [conn2707] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:05.461+0000 I SHARDING [conn578] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:05.495+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 17146965, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:00:05.495+0000 I SHARDING [conn152] moveChunk updating self version to: 30579|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') } for collection 'mydomain.Sessions' 2016-03-13T09:00:05.631+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:05.631+0000-56e52c152848c4eacbd010cb", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859605631), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 17146965, catchup: 0, steady: 0 } } 2016-03-13T09:00:05.665+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:00:05.667+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:00:05.667+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:05.667+0000-56e52c152848c4eacbd010cc", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859605667), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, step 1 of 6: 0, step 2 of 6: 497, step 3 of 6: 149, step 4 of 6: 8360, step 5 of 6: 319, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:00:05.904+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:00:05.904+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563402d87bc3500e9459b0eb') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30578000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3433 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 63608, W: 5720 } } } protocol:op_command 9573ms 2016-03-13T09:00:06.496+0000 I SHARDING [conn1929] remotely refreshing metadata for mydomain.Sessions with requested shard version 30579|1||563ba74d869758a4542b9075 based on current shard version 30579|0||563ba74d869758a4542b9075, current metadata version is 30579|0||563ba74d869758a4542b9075 2016-03-13T09:00:06.508+0000 I SHARDING [conn2436] remotely refreshing metadata for mydomain.Sessions with requested shard version 30579|1||563ba74d869758a4542b9075 based on current shard version 30579|0||563ba74d869758a4542b9075, current metadata version is 30579|0||563ba74d869758a4542b9075 2016-03-13T09:00:06.508+0000 I SHARDING [conn578] remotely refreshing metadata for mydomain.Sessions with requested shard version 30579|1||563ba74d869758a4542b9075 based on current shard version 30579|0||563ba74d869758a4542b9075, current metadata version is 30579|0||563ba74d869758a4542b9075 2016-03-13T09:00:06.618+0000 I SHARDING [conn578] updating metadata for mydomain.Sessions from shard version 30579|0||563ba74d869758a4542b9075 to shard version 30579|1||563ba74d869758a4542b9075 2016-03-13T09:00:06.618+0000 I SHARDING [conn2436] metadata of collection mydomain.Sessions already up to date (shard version : 30579|1||563ba74d869758a4542b9075, took 110ms) 2016-03-13T09:00:06.618+0000 I SHARDING [conn1929] metadata of collection mydomain.Sessions already up to date (shard version : 30579|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:00:06.618+0000 I SHARDING [conn578] collection version was loaded at version 30579|1||563ba74d869758a4542b9075, took 110ms 2016-03-13T09:00:11.323+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30579000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:00:11.598+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }) in mydomain.Sessions', ts : 56e52c1b2848c4eacbd010cd 2016-03-13T09:00:11.598+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30579|1||563ba74d869758a4542b9075, current metadata version is 30579|1||563ba74d869758a4542b9075 2016-03-13T09:00:11.722+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30579|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:00:11.759+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:11.759+0000-56e52c1b2848c4eacbd010ce", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859611759), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:00:11.792+0000 I SHARDING [conn152] moveChunk request accepted at version 30579|1||563ba74d869758a4542b9075 2016-03-13T09:00:11.901+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:00:11.954+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:11.958+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:11.963+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:11.976+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:11.996+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:12.037+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:12.118+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:12.260+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:12.315+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:00:12.051+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:00:12.543+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:13.089+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:14.122+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:15.154+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:16.196+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:17.221+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 863, clonedBytes: 2462708, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:18.245+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4547, clonedBytes: 13658821, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:19.271+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4847, clonedBytes: 14889643, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:20.295+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5085, clonedBytes: 15927099, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:21.320+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16906828, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:22.345+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c1b2848c4eacbd010cf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16906828, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:22.345+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:00:22.345+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:00:22.453+0000 I SHARDING [conn152] moveChunk setting version to: 30580|0||563ba74d869758a4542b9075 2016-03-13T09:00:22.455+0000 I SHARDING [conn463] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:22.455+0000 I SHARDING [conn2454] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:22.455+0000 I SHARDING [conn1189] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:22.455+0000 I SHARDING [conn1294] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:22.455+0000 I SHARDING [conn2556] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:22.456+0000 I SHARDING [conn423] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:22.456+0000 I SHARDING [conn544] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:22.490+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16906828, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:00:22.490+0000 I SHARDING [conn152] moveChunk updating self version to: 30580|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') } for collection 'mydomain.Sessions' 2016-03-13T09:00:22.627+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:22.627+0000-56e52c262848c4eacbd010d0", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859622627), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16906828, catchup: 0, steady: 0 } } 2016-03-13T09:00:22.660+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:00:22.665+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:00:22.665+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:22.665+0000-56e52c262848c4eacbd010d1", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859622665), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, step 1 of 6: 0, step 2 of 6: 468, step 3 of 6: 159, step 4 of 6: 10392, step 5 of 6: 320, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:00:22.866+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:00:22.866+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563403dc584ad10f212e10bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30579000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 11388 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 65841, W: 4116 } } } protocol:op_command 11543ms 2016-03-13T09:00:23.490+0000 I SHARDING [conn1251] remotely refreshing metadata for mydomain.Sessions with requested shard version 30580|1||563ba74d869758a4542b9075 based on current shard version 30580|0||563ba74d869758a4542b9075, current metadata version is 30580|0||563ba74d869758a4542b9075 2016-03-13T09:00:23.492+0000 I SHARDING [conn1548] remotely refreshing metadata for mydomain.Sessions with requested shard version 30580|1||563ba74d869758a4542b9075 based on current shard version 30580|0||563ba74d869758a4542b9075, current metadata version is 30580|0||563ba74d869758a4542b9075 2016-03-13T09:00:23.530+0000 I SHARDING [conn1224] remotely refreshing metadata for mydomain.Sessions with requested shard version 30580|1||563ba74d869758a4542b9075 based on current shard version 30580|0||563ba74d869758a4542b9075, current metadata version is 30580|0||563ba74d869758a4542b9075 2016-03-13T09:00:23.616+0000 I SHARDING [conn1548] updating metadata for mydomain.Sessions from shard version 30580|0||563ba74d869758a4542b9075 to shard version 30580|1||563ba74d869758a4542b9075 2016-03-13T09:00:23.616+0000 I SHARDING [conn1251] metadata of collection mydomain.Sessions already up to date (shard version : 30580|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:00:23.616+0000 I SHARDING [conn1548] collection version was loaded at version 30580|1||563ba74d869758a4542b9075, took 121ms 2016-03-13T09:00:23.638+0000 I SHARDING [conn1224] metadata of collection mydomain.Sessions already up to date (shard version : 30580|1||563ba74d869758a4542b9075, took 105ms) 2016-03-13T09:00:26.934+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30580000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:00:27.087+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }) in mydomain.Sessions', ts : 56e52c2a2848c4eacbd010d2 2016-03-13T09:00:27.087+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30580|1||563ba74d869758a4542b9075, current metadata version is 30580|1||563ba74d869758a4542b9075 2016-03-13T09:00:27.213+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30580|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:00:27.251+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:27.250+0000-56e52c2b2848c4eacbd010d3", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859627250), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:00:27.267+0000 I SHARDING [conn176] moveChunk request accepted at version 30580|1||563ba74d869758a4542b9075 2016-03-13T09:00:27.376+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:00:27.428+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:27.431+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:27.461+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:27.482+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:27.502+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:27.562+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:27.644+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:27.785+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:28.048+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:28.594+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:29.640+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:30.680+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:31.732+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:32.777+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2431, clonedBytes: 5950645, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:33.801+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16689042, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:34.826+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c2b2848c4eacbd010d4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16689042, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:34.826+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:00:34.827+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:00:34.829+0000 I SHARDING [conn1122] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:34.936+0000 I SHARDING [conn176] moveChunk setting version to: 30581|0||563ba74d869758a4542b9075 2016-03-13T09:00:34.936+0000 I SHARDING [conn2166] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:34.936+0000 I SHARDING [conn445] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:34.951+0000 I SHARDING [conn1657] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:34.951+0000 I SHARDING [conn1235] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:34.951+0000 I SHARDING [conn574] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:34.951+0000 I SHARDING [conn936] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:34.983+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16689042, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:00:34.983+0000 I SHARDING [conn176] moveChunk updating self version to: 30581|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') } for collection 'mydomain.Sessions' 2016-03-13T09:00:35.179+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:35.179+0000-56e52c332848c4eacbd010d5", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859635179), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16689042, catchup: 0, steady: 0 } } 2016-03-13T09:00:35.215+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:00:35.217+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:00:35.217+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:35.217+0000-56e52c332848c4eacbd010d6", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859635217), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, step 1 of 6: 0, step 2 of 6: 332, step 3 of 6: 157, step 4 of 6: 7402, step 5 of 6: 391, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:00:35.457+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:00:35.457+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563404e3ce48b40ea369afed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30580000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4953 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 1023 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 65202, W: 1327 } } } protocol:op_command 8523ms 2016-03-13T09:00:35.832+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5385 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088224584ad1621aecc471') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560882fd2a8aa33e057a6309') } 2016-03-13T09:00:36.044+0000 I SHARDING [conn390] remotely refreshing metadata for mydomain.Sessions with requested shard version 30581|1||563ba74d869758a4542b9075 based on current shard version 30581|0||563ba74d869758a4542b9075, current metadata version is 30581|0||563ba74d869758a4542b9075 2016-03-13T09:00:36.044+0000 I SHARDING [conn906] remotely refreshing metadata for mydomain.Sessions with requested shard version 30581|1||563ba74d869758a4542b9075 based on current shard version 30581|0||563ba74d869758a4542b9075, current metadata version is 30581|0||563ba74d869758a4542b9075 2016-03-13T09:00:36.056+0000 I SHARDING [conn1122] remotely refreshing metadata for mydomain.Sessions with requested shard version 30581|1||563ba74d869758a4542b9075 based on current shard version 30581|0||563ba74d869758a4542b9075, current metadata version is 30581|0||563ba74d869758a4542b9075 2016-03-13T09:00:36.162+0000 I SHARDING [conn1122] updating metadata for mydomain.Sessions from shard version 30581|0||563ba74d869758a4542b9075 to shard version 30581|1||563ba74d869758a4542b9075 2016-03-13T09:00:36.162+0000 I SHARDING [conn390] metadata of collection mydomain.Sessions already up to date (shard version : 30581|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T09:00:36.162+0000 I SHARDING [conn906] metadata of collection mydomain.Sessions already up to date (shard version : 30581|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T09:00:36.162+0000 I SHARDING [conn1122] collection version was loaded at version 30581|1||563ba74d869758a4542b9075, took 106ms 2016-03-13T09:00:36.172+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560882fd2a8aa33e057a6309') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560883d8c5ab960e4d3d7a0a') }, with opId: 768842321 2016-03-13T09:00:40.321+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30581000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:00:40.492+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }) in mydomain.Sessions', ts : 56e52c382848c4eacbd010d7 2016-03-13T09:00:40.492+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30581|1||563ba74d869758a4542b9075, current metadata version is 30581|1||563ba74d869758a4542b9075 2016-03-13T09:00:40.612+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30581|1||563ba74d869758a4542b9075, took 116ms) 2016-03-13T09:00:40.646+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:40.646+0000-56e52c382848c4eacbd010d8", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859640646), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:00:40.670+0000 I SHARDING [conn176] moveChunk request accepted at version 30581|1||563ba74d869758a4542b9075 2016-03-13T09:00:40.782+0000 I SHARDING [conn176] moveChunk number of documents: 5387 2016-03-13T09:00:40.831+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:40.836+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:40.841+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:40.872+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:40.912+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:40.952+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:41.034+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:41.176+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:41.459+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:41.985+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:42.477+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:00:42.315+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:00:43.017+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:44.049+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:45.091+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:46.116+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1705, clonedBytes: 4443301, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:47.141+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4812, clonedBytes: 15013528, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:48.166+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 17002994, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:49.190+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c382848c4eacbd010d9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 17002994, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:49.190+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:00:49.191+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:00:49.192+0000 I SHARDING [conn2327] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:49.300+0000 I SHARDING [conn176] moveChunk setting version to: 30582|0||563ba74d869758a4542b9075 2016-03-13T09:00:49.302+0000 I SHARDING [conn388] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:49.302+0000 I SHARDING [conn209] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:49.302+0000 I SHARDING [conn971] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:49.303+0000 I SHARDING [conn2575] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:49.303+0000 I SHARDING [conn1545] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:49.304+0000 I SHARDING [conn710] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:00:49.337+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 17002994, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:00:49.337+0000 I SHARDING [conn176] moveChunk updating self version to: 30582|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') } for collection 'mydomain.Sessions' 2016-03-13T09:00:49.508+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:49.508+0000-56e52c412848c4eacbd010da", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859649508), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 17002994, catchup: 0, steady: 0 } } 2016-03-13T09:00:49.541+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:00:49.543+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:00:49.544+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:49.544+0000-56e52c412848c4eacbd010db", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859649544), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, step 1 of 6: 0, step 2 of 6: 348, step 3 of 6: 160, step 4 of 6: 8360, step 5 of 6: 353, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:00:49.784+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:00:49.784+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563405e87bc3500e961c21dd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30581000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3371 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 67621, W: 4758 } } } protocol:op_command 9462ms 2016-03-13T09:00:50.368+0000 I SHARDING [conn655] remotely refreshing metadata for mydomain.Sessions with requested shard version 30582|1||563ba74d869758a4542b9075 based on current shard version 30582|0||563ba74d869758a4542b9075, current metadata version is 30582|0||563ba74d869758a4542b9075 2016-03-13T09:00:50.372+0000 I SHARDING [conn867] remotely refreshing metadata for mydomain.Sessions with requested shard version 30582|1||563ba74d869758a4542b9075 based on current shard version 30582|0||563ba74d869758a4542b9075, current metadata version is 30582|0||563ba74d869758a4542b9075 2016-03-13T09:00:50.410+0000 I SHARDING [conn2373] remotely refreshing metadata for mydomain.Sessions with requested shard version 30582|1||563ba74d869758a4542b9075 based on current shard version 30582|0||563ba74d869758a4542b9075, current metadata version is 30582|0||563ba74d869758a4542b9075 2016-03-13T09:00:50.501+0000 I SHARDING [conn655] updating metadata for mydomain.Sessions from shard version 30582|0||563ba74d869758a4542b9075 to shard version 30582|1||563ba74d869758a4542b9075 2016-03-13T09:00:50.501+0000 I SHARDING [conn867] metadata of collection mydomain.Sessions already up to date (shard version : 30582|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:00:50.501+0000 I SHARDING [conn655] collection version was loaded at version 30582|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:00:50.517+0000 I SHARDING [conn2373] metadata of collection mydomain.Sessions already up to date (shard version : 30582|1||563ba74d869758a4542b9075, took 104ms) 2016-03-13T09:00:55.057+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30582000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:00:55.346+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }) in mydomain.Sessions', ts : 56e52c472848c4eacbd010dc 2016-03-13T09:00:55.346+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30582|1||563ba74d869758a4542b9075, current metadata version is 30582|1||563ba74d869758a4542b9075 2016-03-13T09:00:55.468+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30582|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:00:55.503+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:00:55.503+0000-56e52c472848c4eacbd010dd", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859655503), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:00:55.538+0000 I SHARDING [conn176] moveChunk request accepted at version 30582|1||563ba74d869758a4542b9075 2016-03-13T09:00:55.675+0000 I SHARDING [conn176] moveChunk number of documents: 5387 2016-03-13T09:00:55.724+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:55.727+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:55.738+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:55.780+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:55.820+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:55.860+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:55.941+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:56.082+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:56.346+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:56.872+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:57.904+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:58.936+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:00:59.968+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:00.993+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2690, clonedBytes: 7514612, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:02.017+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16399603, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:03.042+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c472848c4eacbd010de", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16399603, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:03.042+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:01:03.043+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:01:03.043+0000 I SHARDING [conn2825] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:03.044+0000 I SHARDING [conn2430] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:03.152+0000 I SHARDING [conn176] moveChunk setting version to: 30583|0||563ba74d869758a4542b9075 2016-03-13T09:01:03.152+0000 I SHARDING [conn1288] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:03.154+0000 I SHARDING [conn2144] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:03.155+0000 I SHARDING [conn185] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:03.155+0000 I SHARDING [conn1356] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:03.189+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16399603, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:01:03.189+0000 I SHARDING [conn176] moveChunk updating self version to: 30583|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') } for collection 'mydomain.Sessions' 2016-03-13T09:01:03.340+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:03.340+0000-56e52c4f2848c4eacbd010df", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859663340), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16399603, catchup: 0, steady: 0 } } 2016-03-13T09:01:03.373+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:01:03.374+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:01:03.379+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:03.379+0000-56e52c4f2848c4eacbd010e0", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859663379), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, step 1 of 6: 0, step 2 of 6: 480, step 3 of 6: 185, step 4 of 6: 7319, step 5 of 6: 331, step 6 of 6: 5, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:01:03.579+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:01:03.579+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563406e8ce48b40ea18fafd4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30582000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 19564 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 81820, W: 2873 } } } protocol:op_command 8522ms 2016-03-13T09:01:04.208+0000 I SHARDING [conn2092] remotely refreshing metadata for mydomain.Sessions with requested shard version 30583|1||563ba74d869758a4542b9075 based on current shard version 30583|0||563ba74d869758a4542b9075, current metadata version is 30583|0||563ba74d869758a4542b9075 2016-03-13T09:01:04.208+0000 I SHARDING [conn1612] remotely refreshing metadata for mydomain.Sessions with requested shard version 30583|1||563ba74d869758a4542b9075 based on current shard version 30583|0||563ba74d869758a4542b9075, current metadata version is 30583|0||563ba74d869758a4542b9075 2016-03-13T09:01:04.221+0000 I SHARDING [conn2500] remotely refreshing metadata for mydomain.Sessions with requested shard version 30583|1||563ba74d869758a4542b9075 based on current shard version 30583|0||563ba74d869758a4542b9075, current metadata version is 30583|0||563ba74d869758a4542b9075 2016-03-13T09:01:04.335+0000 I SHARDING [conn2500] updating metadata for mydomain.Sessions from shard version 30583|0||563ba74d869758a4542b9075 to shard version 30583|1||563ba74d869758a4542b9075 2016-03-13T09:01:04.335+0000 I SHARDING [conn1612] metadata of collection mydomain.Sessions already up to date (shard version : 30583|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:01:04.335+0000 I SHARDING [conn2092] metadata of collection mydomain.Sessions already up to date (shard version : 30583|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:01:04.335+0000 I SHARDING [conn2500] collection version was loaded at version 30583|1||563ba74d869758a4542b9075, took 113ms 2016-03-13T09:01:07.347+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560882fd2a8aa33e057a6309') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560883d8c5ab960e4d3d7a0a') } 2016-03-13T09:01:07.870+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560883d8c5ab960e4d3d7a0a') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560884acc5ab960e4fdffed2') }, with opId: 768893998 2016-03-13T09:01:09.482+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30583000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:01:09.769+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }) in mydomain.Sessions', ts : 56e52c552848c4eacbd010e1 2016-03-13T09:01:09.769+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30583|1||563ba74d869758a4542b9075, current metadata version is 30583|1||563ba74d869758a4542b9075 2016-03-13T09:01:09.891+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30583|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T09:01:09.930+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:09.930+0000-56e52c552848c4eacbd010e2", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859669930), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:01:09.964+0000 I SHARDING [conn152] moveChunk request accepted at version 30583|1||563ba74d869758a4542b9075 2016-03-13T09:01:10.076+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:01:10.127+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.130+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.141+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.160+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.201+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.241+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.306+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.444+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:10.727+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:11.253+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:12.286+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:12.663+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:01:12.477+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:01:13.317+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:14.350+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:15.375+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2321, clonedBytes: 5520445, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:16.399+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16662393, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:17.424+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c552848c4eacbd010e3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16662393, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:17.424+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:01:17.425+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:01:17.532+0000 I SHARDING [conn152] moveChunk setting version to: 30584|0||563ba74d869758a4542b9075 2016-03-13T09:01:17.534+0000 I SHARDING [conn1549] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:17.534+0000 I SHARDING [conn1724] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:17.535+0000 I SHARDING [conn586] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:17.536+0000 I SHARDING [conn1714] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:17.536+0000 I SHARDING [conn1083] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:17.537+0000 I SHARDING [conn2658] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:17.537+0000 I SHARDING [conn2490] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:17.570+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16662393, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:01:17.571+0000 I SHARDING [conn152] moveChunk updating self version to: 30584|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') } for collection 'mydomain.Sessions' 2016-03-13T09:01:17.855+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:17.855+0000-56e52c5d2848c4eacbd010e4", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859677855), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16662393, catchup: 0, steady: 0 } } 2016-03-13T09:01:17.965+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:01:17.968+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:01:17.970+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:17.970+0000-56e52c5d2848c4eacbd010e5", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859677970), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, step 1 of 6: 0, step 2 of 6: 481, step 3 of 6: 159, step 4 of 6: 7300, step 5 of 6: 543, step 6 of 6: 2, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:01:18.338+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:01:18.338+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563407eea2a4330ea28ebf60') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30583000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 2886 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 79344, W: 3388 } } } protocol:op_command 8856ms 2016-03-13T09:01:18.719+0000 I SHARDING [conn2200] remotely refreshing metadata for mydomain.Sessions with requested shard version 30584|1||563ba74d869758a4542b9075 based on current shard version 30584|0||563ba74d869758a4542b9075, current metadata version is 30584|0||563ba74d869758a4542b9075 2016-03-13T09:01:18.719+0000 I SHARDING [conn1760] remotely refreshing metadata for mydomain.Sessions with requested shard version 30584|1||563ba74d869758a4542b9075 based on current shard version 30584|0||563ba74d869758a4542b9075, current metadata version is 30584|0||563ba74d869758a4542b9075 2016-03-13T09:01:18.719+0000 I SHARDING [conn1816] remotely refreshing metadata for mydomain.Sessions with requested shard version 30584|1||563ba74d869758a4542b9075 based on current shard version 30584|0||563ba74d869758a4542b9075, current metadata version is 30584|0||563ba74d869758a4542b9075 2016-03-13T09:01:18.838+0000 I SHARDING [conn1760] updating metadata for mydomain.Sessions from shard version 30584|0||563ba74d869758a4542b9075 to shard version 30584|1||563ba74d869758a4542b9075 2016-03-13T09:01:18.838+0000 I SHARDING [conn1760] collection version was loaded at version 30584|1||563ba74d869758a4542b9075, took 117ms 2016-03-13T09:01:18.840+0000 I SHARDING [conn2200] metadata of collection mydomain.Sessions already up to date (shard version : 30584|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:01:18.840+0000 I SHARDING [conn1816] metadata of collection mydomain.Sessions already up to date (shard version : 30584|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:01:22.981+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30584000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:01:23.189+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }) in mydomain.Sessions', ts : 56e52c622848c4eacbd010e6 2016-03-13T09:01:23.190+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30584|1||563ba74d869758a4542b9075, current metadata version is 30584|1||563ba74d869758a4542b9075 2016-03-13T09:01:23.341+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30584|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:01:23.382+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:23.382+0000-56e52c632848c4eacbd010e7", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859683382), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:01:23.413+0000 I SHARDING [conn152] moveChunk request accepted at version 30584|1||563ba74d869758a4542b9075 2016-03-13T09:01:23.529+0000 I SHARDING [conn152] moveChunk number of documents: 5310 2016-03-13T09:01:23.578+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:23.582+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:23.601+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:23.621+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:23.641+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:23.703+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:23.767+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:23.905+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:24.168+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:24.694+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:25.752+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:26.778+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:27.812+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:28.837+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2641, clonedBytes: 6467373, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:29.862+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5310, clonedBytes: 16568087, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:30.886+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c632848c4eacbd010e8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5310, clonedBytes: 16568087, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:30.886+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:01:30.887+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:01:30.994+0000 I SHARDING [conn152] moveChunk setting version to: 30585|0||563ba74d869758a4542b9075 2016-03-13T09:01:30.996+0000 I SHARDING [conn2634] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:30.996+0000 I SHARDING [conn2790] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:30.997+0000 I SHARDING [conn1178] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:30.997+0000 I SHARDING [conn2038] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:30.998+0000 I SHARDING [conn1281] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:30.998+0000 I SHARDING [conn639] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:31.002+0000 I SHARDING [conn2310] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:31.034+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5310, clonedBytes: 16568087, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:01:31.035+0000 I SHARDING [conn152] moveChunk updating self version to: 30585|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') } for collection 'mydomain.Sessions' 2016-03-13T09:01:31.118+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:31.118+0000-56e52c6b2848c4eacbd010e9", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859691118), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, from: "shmydomain1", to: "shmydomain3", cloned: 5310, clonedBytes: 16568087, catchup: 0, steady: 0 } } 2016-03-13T09:01:31.152+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:01:31.154+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:01:31.154+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:31.154+0000-56e52c6b2848c4eacbd010ea", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859691154), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, step 1 of 6: 0, step 2 of 6: 431, step 3 of 6: 163, step 4 of 6: 7309, step 5 of 6: 267, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:01:31.380+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:01:31.380+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563408f6a2a4330ea41aac59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30584000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:41 reslen:134 locks:{ Global: { acquireCount: { r: 90, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3958 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 22051 } }, Database: { acquireCount: { r: 43, w: 2 } }, Collection: { acquireCount: { R: 43, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 71256, W: 3967 } } } protocol:op_command 8399ms 2016-03-13T09:01:31.985+0000 I SHARDING [conn1155] remotely refreshing metadata for mydomain.Sessions with requested shard version 30585|1||563ba74d869758a4542b9075 based on current shard version 30585|0||563ba74d869758a4542b9075, current metadata version is 30585|0||563ba74d869758a4542b9075 2016-03-13T09:01:31.985+0000 I SHARDING [conn2098] remotely refreshing metadata for mydomain.Sessions with requested shard version 30585|1||563ba74d869758a4542b9075 based on current shard version 30585|0||563ba74d869758a4542b9075, current metadata version is 30585|0||563ba74d869758a4542b9075 2016-03-13T09:01:32.000+0000 I SHARDING [conn527] remotely refreshing metadata for mydomain.Sessions with requested shard version 30585|1||563ba74d869758a4542b9075 based on current shard version 30585|0||563ba74d869758a4542b9075, current metadata version is 30585|0||563ba74d869758a4542b9075 2016-03-13T09:01:32.111+0000 I SHARDING [conn2098] updating metadata for mydomain.Sessions from shard version 30585|0||563ba74d869758a4542b9075 to shard version 30585|1||563ba74d869758a4542b9075 2016-03-13T09:01:32.111+0000 I SHARDING [conn527] metadata of collection mydomain.Sessions already up to date (shard version : 30585|1||563ba74d869758a4542b9075, took 110ms) 2016-03-13T09:01:32.111+0000 I SHARDING [conn1155] metadata of collection mydomain.Sessions already up to date (shard version : 30585|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:01:32.112+0000 I SHARDING [conn2098] collection version was loaded at version 30585|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:01:36.242+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30585000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:01:36.366+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }) in mydomain.Sessions', ts : 56e52c702848c4eacbd010eb 2016-03-13T09:01:36.366+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30585|1||563ba74d869758a4542b9075, current metadata version is 30585|1||563ba74d869758a4542b9075 2016-03-13T09:01:36.491+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30585|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:01:36.525+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:36.525+0000-56e52c702848c4eacbd010ec", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859696525), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:01:36.557+0000 I SHARDING [conn152] moveChunk request accepted at version 30585|1||563ba74d869758a4542b9075 2016-03-13T09:01:36.660+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:01:36.712+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:36.728+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:36.748+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:36.768+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:36.808+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:36.849+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:36.913+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:37.052+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:37.315+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:37.830+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:38.884+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:39.915+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:40.947+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:41.972+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2416, clonedBytes: 5929330, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:42.686+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560883d8c5ab960e4d3d7a0a') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560884acc5ab960e4fdffed2') } 2016-03-13T09:01:42.769+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560884acc5ab960e4fdffed2') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088582e5aec60e6b12bb2c') }, with opId: 768946674 2016-03-13T09:01:42.997+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16860801, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:43.027+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:01:42.663+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:01:44.022+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c702848c4eacbd010ed", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16860801, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:44.022+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:01:44.022+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:01:44.131+0000 I SHARDING [conn152] moveChunk setting version to: 30586|0||563ba74d869758a4542b9075 2016-03-13T09:01:44.133+0000 I SHARDING [conn1839] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:44.135+0000 I SHARDING [conn2152] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:44.135+0000 I SHARDING [conn438] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:44.135+0000 I SHARDING [conn1296] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:44.135+0000 I SHARDING [conn1181] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:44.136+0000 I SHARDING [conn825] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:44.136+0000 I SHARDING [conn2444] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:44.154+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16860801, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:01:44.154+0000 I SHARDING [conn152] moveChunk updating self version to: 30586|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') } for collection 'mydomain.Sessions' 2016-03-13T09:01:44.292+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:44.292+0000-56e52c782848c4eacbd010ee", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859704292), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16860801, catchup: 0, steady: 0 } } 2016-03-13T09:01:44.328+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:01:44.329+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:01:44.329+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:44.329+0000-56e52c782848c4eacbd010ef", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859704329), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, step 1 of 6: 0, step 2 of 6: 314, step 3 of 6: 153, step 4 of 6: 7311, step 5 of 6: 307, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:01:44.533+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:01:44.533+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563409ffce48b40ea36a33c7') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30585000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1040 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 65453, W: 5165 } } } protocol:op_command 8291ms 2016-03-13T09:01:45.164+0000 I SHARDING [conn1987] remotely refreshing metadata for mydomain.Sessions with requested shard version 30586|1||563ba74d869758a4542b9075 based on current shard version 30586|0||563ba74d869758a4542b9075, current metadata version is 30586|0||563ba74d869758a4542b9075 2016-03-13T09:01:45.164+0000 I SHARDING [conn1855] remotely refreshing metadata for mydomain.Sessions with requested shard version 30586|1||563ba74d869758a4542b9075 based on current shard version 30586|0||563ba74d869758a4542b9075, current metadata version is 30586|0||563ba74d869758a4542b9075 2016-03-13T09:01:45.164+0000 I SHARDING [conn1910] remotely refreshing metadata for mydomain.Sessions with requested shard version 30586|1||563ba74d869758a4542b9075 based on current shard version 30586|0||563ba74d869758a4542b9075, current metadata version is 30586|0||563ba74d869758a4542b9075 2016-03-13T09:01:45.290+0000 I SHARDING [conn1987] updating metadata for mydomain.Sessions from shard version 30586|0||563ba74d869758a4542b9075 to shard version 30586|1||563ba74d869758a4542b9075 2016-03-13T09:01:45.290+0000 I SHARDING [conn1910] metadata of collection mydomain.Sessions already up to date (shard version : 30586|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:01:45.290+0000 I SHARDING [conn1987] collection version was loaded at version 30586|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:01:45.290+0000 I SHARDING [conn1855] metadata of collection mydomain.Sessions already up to date (shard version : 30586|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:01:49.359+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30586000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:01:49.622+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }) in mydomain.Sessions', ts : 56e52c7d2848c4eacbd010f0 2016-03-13T09:01:49.622+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30586|1||563ba74d869758a4542b9075, current metadata version is 30586|1||563ba74d869758a4542b9075 2016-03-13T09:01:49.748+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30586|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:01:49.786+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:49.786+0000-56e52c7d2848c4eacbd010f1", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859709786), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:01:49.796+0000 I SHARDING [conn152] moveChunk request accepted at version 30586|1||563ba74d869758a4542b9075 2016-03-13T09:01:49.904+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:01:49.953+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:49.956+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:49.960+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:49.975+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:49.996+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:50.036+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:50.101+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:50.238+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:50.522+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:51.048+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:52.093+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:53.123+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:54.155+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:55.179+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1810, clonedBytes: 3985701, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:56.204+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5078, clonedBytes: 15031443, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:57.229+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16032443, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:58.254+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c7d2848c4eacbd010f2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16032443, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:01:58.254+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:01:58.255+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:01:58.255+0000 I SHARDING [conn1037] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:58.363+0000 I SHARDING [conn152] moveChunk setting version to: 30587|0||563ba74d869758a4542b9075 2016-03-13T09:01:58.363+0000 I SHARDING [conn2368] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:58.365+0000 I SHARDING [conn2284] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:58.365+0000 I SHARDING [conn1704] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:58.365+0000 I SHARDING [conn2171] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:58.366+0000 I SHARDING [conn2317] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:58.366+0000 I SHARDING [conn1408] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:01:58.400+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16032443, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:01:58.400+0000 I SHARDING [conn152] moveChunk updating self version to: 30587|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') } for collection 'mydomain.Sessions' 2016-03-13T09:01:58.519+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:58.519+0000-56e52c862848c4eacbd010f3", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859718519), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16032443, catchup: 0, steady: 0 } } 2016-03-13T09:01:58.555+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:01:58.555+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:01:58.555+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:01:58.555+0000-56e52c862848c4eacbd010f4", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859718555), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, step 1 of 6: 0, step 2 of 6: 437, step 3 of 6: 155, step 4 of 6: 8302, step 5 of 6: 301, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:01:58.760+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:01:58.760+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340b0fa2a4330ea28f0aed') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30586000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1918 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 68178, W: 4609 } } } protocol:op_command 9402ms 2016-03-13T09:01:59.014+0000 I JOURNAL [journal writer] old journal file will be removed: /data/journal/j._1155 2016-03-13T09:01:59.384+0000 I SHARDING [conn610] remotely refreshing metadata for mydomain.Sessions with requested shard version 30587|1||563ba74d869758a4542b9075 based on current shard version 30587|0||563ba74d869758a4542b9075, current metadata version is 30587|0||563ba74d869758a4542b9075 2016-03-13T09:01:59.384+0000 I SHARDING [conn1757] remotely refreshing metadata for mydomain.Sessions with requested shard version 30587|1||563ba74d869758a4542b9075 based on current shard version 30587|0||563ba74d869758a4542b9075, current metadata version is 30587|0||563ba74d869758a4542b9075 2016-03-13T09:01:59.405+0000 I SHARDING [conn666] remotely refreshing metadata for mydomain.Sessions with requested shard version 30587|1||563ba74d869758a4542b9075 based on current shard version 30587|0||563ba74d869758a4542b9075, current metadata version is 30587|0||563ba74d869758a4542b9075 2016-03-13T09:01:59.515+0000 I SHARDING [conn666] updating metadata for mydomain.Sessions from shard version 30587|0||563ba74d869758a4542b9075 to shard version 30587|1||563ba74d869758a4542b9075 2016-03-13T09:01:59.515+0000 I SHARDING [conn666] collection version was loaded at version 30587|1||563ba74d869758a4542b9075, took 109ms 2016-03-13T09:01:59.521+0000 I SHARDING [conn1757] metadata of collection mydomain.Sessions already up to date (shard version : 30587|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T09:01:59.521+0000 I SHARDING [conn610] metadata of collection mydomain.Sessions already up to date (shard version : 30587|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T09:02:04.020+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30587000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:02:04.268+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }) in mydomain.Sessions', ts : 56e52c8c2848c4eacbd010f5 2016-03-13T09:02:04.268+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30587|1||563ba74d869758a4542b9075, current metadata version is 30587|1||563ba74d869758a4542b9075 2016-03-13T09:02:04.387+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30587|1||563ba74d869758a4542b9075, took 116ms) 2016-03-13T09:02:04.421+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:04.421+0000-56e52c8c2848c4eacbd010f6", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859724421), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:02:04.452+0000 I SHARDING [conn152] moveChunk request accepted at version 30587|1||563ba74d869758a4542b9075 2016-03-13T09:02:04.572+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T09:02:04.621+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:04.626+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:04.631+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:04.660+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:04.680+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:04.722+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:04.802+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:04.944+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:05.208+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:05.733+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:06.765+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:07.797+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:08.830+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:09.855+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2080, clonedBytes: 4729637, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:10.881+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5194, clonedBytes: 15965643, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:11.906+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16523054, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:12.931+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c8c2848c4eacbd010f7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16523054, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:12.931+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:02:12.931+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:02:13.037+0000 I SHARDING [conn152] moveChunk setting version to: 30588|0||563ba74d869758a4542b9075 2016-03-13T09:02:13.037+0000 I SHARDING [conn2778] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:13.039+0000 I SHARDING [conn2417] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:13.039+0000 I SHARDING [conn1776] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:13.039+0000 I SHARDING [conn1850] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:13.040+0000 I SHARDING [conn2011] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:13.041+0000 I SHARDING [conn1429] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:13.043+0000 I SHARDING [conn1722] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:13.301+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16523054, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:02:13.301+0000 I SHARDING [conn152] moveChunk updating self version to: 30588|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') } for collection 'mydomain.Sessions' 2016-03-13T09:02:13.412+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:13.412+0000-56e52c952848c4eacbd010f8", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859733412), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16523054, catchup: 0, steady: 0 } } 2016-03-13T09:02:13.669+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560884acc5ab960e4fdffed2') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088582e5aec60e6b12bb2c') } 2016-03-13T09:02:13.670+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:02:13.027+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:02:13.675+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:02:13.675+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:02:13.676+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:13.676+0000-56e52c952848c4eacbd010f9", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859733676), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, step 1 of 6: 0, step 2 of 6: 432, step 3 of 6: 167, step 4 of 6: 8310, step 5 of 6: 744, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:02:13.817+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088582e5aec60e6b12bb2c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088658584ad16218d1f24d') }, with opId: 768994577 2016-03-13T09:02:13.959+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:02:13.959+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340c1a584ad10f1f91c16a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30587000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 405 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 1 }, timeAcquiringMicros: { R: 82077, W: 2144 } } } protocol:op_command 9939ms 2016-03-13T09:02:14.280+0000 I SHARDING [conn1776] remotely refreshing metadata for mydomain.Sessions with requested shard version 30588|1||563ba74d869758a4542b9075 based on current shard version 30588|0||563ba74d869758a4542b9075, current metadata version is 30588|0||563ba74d869758a4542b9075 2016-03-13T09:02:14.281+0000 I SHARDING [conn813] remotely refreshing metadata for mydomain.Sessions with requested shard version 30588|1||563ba74d869758a4542b9075 based on current shard version 30588|0||563ba74d869758a4542b9075, current metadata version is 30588|0||563ba74d869758a4542b9075 2016-03-13T09:02:14.281+0000 I SHARDING [conn2134] remotely refreshing metadata for mydomain.Sessions with requested shard version 30588|1||563ba74d869758a4542b9075 based on current shard version 30588|0||563ba74d869758a4542b9075, current metadata version is 30588|0||563ba74d869758a4542b9075 2016-03-13T09:02:14.410+0000 I SHARDING [conn2134] updating metadata for mydomain.Sessions from shard version 30588|0||563ba74d869758a4542b9075 to shard version 30588|1||563ba74d869758a4542b9075 2016-03-13T09:02:14.410+0000 I SHARDING [conn813] metadata of collection mydomain.Sessions already up to date (shard version : 30588|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T09:02:14.410+0000 I SHARDING [conn1776] metadata of collection mydomain.Sessions already up to date (shard version : 30588|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T09:02:14.411+0000 I SHARDING [conn2134] collection version was loaded at version 30588|1||563ba74d869758a4542b9075, took 129ms 2016-03-13T09:02:18.603+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30588000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:02:18.869+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }) in mydomain.Sessions', ts : 56e52c9a2848c4eacbd010fa 2016-03-13T09:02:18.869+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30588|1||563ba74d869758a4542b9075, current metadata version is 30588|1||563ba74d869758a4542b9075 2016-03-13T09:02:18.995+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30588|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:02:19.031+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:19.031+0000-56e52c9b2848c4eacbd010fb", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859739031), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:02:19.042+0000 I SHARDING [conn152] moveChunk request accepted at version 30588|1||563ba74d869758a4542b9075 2016-03-13T09:02:19.164+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:02:19.221+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.228+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.233+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.245+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.264+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.305+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.369+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.508+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:19.771+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:20.297+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:21.329+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:22.361+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:23.393+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:24.439+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2058, clonedBytes: 4884921, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:25.464+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5096, clonedBytes: 15902856, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:26.488+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 17071657, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:27.513+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52c9b2848c4eacbd010fc", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 17071657, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:27.513+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:02:27.514+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:02:27.516+0000 I SHARDING [conn1849] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:27.623+0000 I SHARDING [conn152] moveChunk setting version to: 30589|0||563ba74d869758a4542b9075 2016-03-13T09:02:27.625+0000 I SHARDING [conn1143] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:27.625+0000 I SHARDING [conn645] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:27.625+0000 I SHARDING [conn1541] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:27.625+0000 I SHARDING [conn2358] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:27.625+0000 I SHARDING [conn877] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:27.625+0000 I SHARDING [conn1215] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:27.669+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 17071657, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:02:27.669+0000 I SHARDING [conn152] moveChunk updating self version to: 30589|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') } for collection 'mydomain.Sessions' 2016-03-13T09:02:27.809+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:27.809+0000-56e52ca32848c4eacbd010fd", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859747809), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 17071657, catchup: 0, steady: 0 } } 2016-03-13T09:02:27.844+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:02:27.844+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:02:27.844+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:27.844+0000-56e52ca32848c4eacbd010fe", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859747844), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, step 1 of 6: 0, step 2 of 6: 438, step 3 of 6: 177, step 4 of 6: 8293, step 5 of 6: 331, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:02:28.054+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:02:28.054+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340d2a7bc3500e945ac59c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30588000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 610 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 79764, W: 5723 } } } protocol:op_command 9451ms 2016-03-13T09:02:28.677+0000 I SHARDING [conn1947] remotely refreshing metadata for mydomain.Sessions with requested shard version 30589|1||563ba74d869758a4542b9075 based on current shard version 30589|0||563ba74d869758a4542b9075, current metadata version is 30589|0||563ba74d869758a4542b9075 2016-03-13T09:02:28.677+0000 I SHARDING [conn1694] remotely refreshing metadata for mydomain.Sessions with requested shard version 30589|1||563ba74d869758a4542b9075 based on current shard version 30589|0||563ba74d869758a4542b9075, current metadata version is 30589|0||563ba74d869758a4542b9075 2016-03-13T09:02:28.677+0000 I SHARDING [conn1215] remotely refreshing metadata for mydomain.Sessions with requested shard version 30589|1||563ba74d869758a4542b9075 based on current shard version 30589|0||563ba74d869758a4542b9075, current metadata version is 30589|0||563ba74d869758a4542b9075 2016-03-13T09:02:28.805+0000 I SHARDING [conn1215] updating metadata for mydomain.Sessions from shard version 30589|0||563ba74d869758a4542b9075 to shard version 30589|1||563ba74d869758a4542b9075 2016-03-13T09:02:28.805+0000 I SHARDING [conn1947] metadata of collection mydomain.Sessions already up to date (shard version : 30589|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:02:28.805+0000 I SHARDING [conn1694] metadata of collection mydomain.Sessions already up to date (shard version : 30589|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:02:28.805+0000 I SHARDING [conn1215] collection version was loaded at version 30589|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:02:32.876+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30589000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:02:33.126+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }) in mydomain.Sessions', ts : 56e52ca82848c4eacbd010ff 2016-03-13T09:02:33.126+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30589|1||563ba74d869758a4542b9075, current metadata version is 30589|1||563ba74d869758a4542b9075 2016-03-13T09:02:33.257+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30589|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:02:33.294+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:33.294+0000-56e52ca92848c4eacbd01100", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859753294), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:02:33.323+0000 I SHARDING [conn152] moveChunk request accepted at version 30589|1||563ba74d869758a4542b9075 2016-03-13T09:02:33.444+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:02:33.493+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:33.497+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:33.514+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:33.535+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:33.556+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:33.596+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:33.676+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:33.818+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:34.101+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:34.627+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:35.660+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:36.712+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:37.745+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:38.770+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2666, clonedBytes: 6518651, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:39.795+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16565696, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:40.819+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ca92848c4eacbd01101", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16565696, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:40.819+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:02:40.820+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:02:40.929+0000 I SHARDING [conn152] moveChunk setting version to: 30590|0||563ba74d869758a4542b9075 2016-03-13T09:02:40.932+0000 I SHARDING [conn440] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:40.932+0000 I SHARDING [conn1435] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:40.932+0000 I SHARDING [conn1852] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:40.932+0000 I SHARDING [conn689] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:40.932+0000 I SHARDING [conn2117] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:40.932+0000 I SHARDING [conn3007] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:40.932+0000 I SHARDING [conn759] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:40.963+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16565696, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:02:40.963+0000 I SHARDING [conn152] moveChunk updating self version to: 30590|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') } for collection 'mydomain.Sessions' 2016-03-13T09:02:41.112+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:41.112+0000-56e52cb12848c4eacbd01102", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859761112), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16565696, catchup: 0, steady: 0 } } 2016-03-13T09:02:41.146+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:02:41.154+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:02:41.155+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:41.155+0000-56e52cb12848c4eacbd01103", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859761155), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, step 1 of 6: 0, step 2 of 6: 446, step 3 of 6: 168, step 4 of 6: 7327, step 5 of 6: 334, step 6 of 6: 1, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:02:41.355+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:02:41.355+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340e3da2a4330ea41b2a5d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30589000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 8728 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 81387, W: 10507 } } } protocol:op_command 8479ms 2016-03-13T09:02:41.972+0000 I SHARDING [conn440] remotely refreshing metadata for mydomain.Sessions with requested shard version 30590|1||563ba74d869758a4542b9075 based on current shard version 30590|0||563ba74d869758a4542b9075, current metadata version is 30590|0||563ba74d869758a4542b9075 2016-03-13T09:02:41.972+0000 I SHARDING [conn1001] remotely refreshing metadata for mydomain.Sessions with requested shard version 30590|1||563ba74d869758a4542b9075 based on current shard version 30590|0||563ba74d869758a4542b9075, current metadata version is 30590|0||563ba74d869758a4542b9075 2016-03-13T09:02:41.972+0000 I SHARDING [conn2209] remotely refreshing metadata for mydomain.Sessions with requested shard version 30590|1||563ba74d869758a4542b9075 based on current shard version 30590|0||563ba74d869758a4542b9075, current metadata version is 30590|0||563ba74d869758a4542b9075 2016-03-13T09:02:42.093+0000 I SHARDING [conn440] updating metadata for mydomain.Sessions from shard version 30590|0||563ba74d869758a4542b9075 to shard version 30590|1||563ba74d869758a4542b9075 2016-03-13T09:02:42.093+0000 I SHARDING [conn440] collection version was loaded at version 30590|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:02:42.097+0000 I SHARDING [conn1001] metadata of collection mydomain.Sessions already up to date (shard version : 30590|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:02:42.097+0000 I SHARDING [conn2209] metadata of collection mydomain.Sessions already up to date (shard version : 30590|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:02:44.014+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:02:43.670+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:02:44.544+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088582e5aec60e6b12bb2c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088658584ad16218d1f24d') } 2016-03-13T09:02:44.918+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088658584ad16218d1f24d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088730584ad16218d201ef') }, with opId: 769044228 2016-03-13T09:02:46.309+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30590000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:02:46.516+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }) in mydomain.Sessions', ts : 56e52cb62848c4eacbd01104 2016-03-13T09:02:46.516+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30590|1||563ba74d869758a4542b9075, current metadata version is 30590|1||563ba74d869758a4542b9075 2016-03-13T09:02:46.635+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30590|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T09:02:46.669+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:46.669+0000-56e52cb62848c4eacbd01105", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859766669), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:02:46.699+0000 I SHARDING [conn152] moveChunk request accepted at version 30590|1||563ba74d869758a4542b9075 2016-03-13T09:02:46.803+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T09:02:46.853+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:46.857+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:46.862+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:46.874+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:46.915+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:46.954+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:47.035+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:47.201+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:47.471+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:47.996+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:49.028+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:50.060+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:51.093+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:52.118+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1526, clonedBytes: 3925248, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:53.142+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4871, clonedBytes: 15001401, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:54.167+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 15969510, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:55.192+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cb62848c4eacbd01106", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 15969510, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:02:55.192+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:02:55.192+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:02:55.193+0000 I SHARDING [conn2058] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:55.194+0000 I SHARDING [conn1392] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:55.195+0000 I SHARDING [conn1584] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:55.195+0000 I SHARDING [conn1305] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:55.303+0000 I SHARDING [conn152] moveChunk setting version to: 30591|0||563ba74d869758a4542b9075 2016-03-13T09:02:55.303+0000 I SHARDING [conn1550] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:55.303+0000 I SHARDING [conn1099] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:55.305+0000 I SHARDING [conn867] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:02:55.335+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 15969510, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:02:55.335+0000 I SHARDING [conn152] moveChunk updating self version to: 30591|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') } for collection 'mydomain.Sessions' 2016-03-13T09:02:55.431+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:55.431+0000-56e52cbf2848c4eacbd01107", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859775431), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 15969510, catchup: 0, steady: 0 } } 2016-03-13T09:02:55.463+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:02:55.465+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:02:55.465+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:02:55.465+0000-56e52cbf2848c4eacbd01108", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859775465), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, step 1 of 6: 0, step 2 of 6: 390, step 3 of 6: 152, step 4 of 6: 8340, step 5 of 6: 273, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:02:55.604+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:02:55.604+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56340f4bce48b40ea36ab4ba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30590000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 9951 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 1 }, timeAcquiringMicros: { R: 57365, W: 3665 } } } protocol:op_command 9295ms 2016-03-13T09:02:56.294+0000 I SHARDING [conn1922] remotely refreshing metadata for mydomain.Sessions with requested shard version 30591|1||563ba74d869758a4542b9075 based on current shard version 30591|0||563ba74d869758a4542b9075, current metadata version is 30591|0||563ba74d869758a4542b9075 2016-03-13T09:02:56.294+0000 I SHARDING [conn1874] remotely refreshing metadata for mydomain.Sessions with requested shard version 30591|1||563ba74d869758a4542b9075 based on current shard version 30591|0||563ba74d869758a4542b9075, current metadata version is 30591|0||563ba74d869758a4542b9075 2016-03-13T09:02:56.294+0000 I SHARDING [conn2889] remotely refreshing metadata for mydomain.Sessions with requested shard version 30591|1||563ba74d869758a4542b9075 based on current shard version 30591|0||563ba74d869758a4542b9075, current metadata version is 30591|0||563ba74d869758a4542b9075 2016-03-13T09:02:56.420+0000 I SHARDING [conn1874] updating metadata for mydomain.Sessions from shard version 30591|0||563ba74d869758a4542b9075 to shard version 30591|1||563ba74d869758a4542b9075 2016-03-13T09:02:56.420+0000 I SHARDING [conn2889] metadata of collection mydomain.Sessions already up to date (shard version : 30591|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:02:56.420+0000 I SHARDING [conn1922] metadata of collection mydomain.Sessions already up to date (shard version : 30591|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:02:56.420+0000 I SHARDING [conn1874] collection version was loaded at version 30591|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:03:00.461+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30591000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:03:00.728+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }) in mydomain.Sessions', ts : 56e52cc42848c4eacbd01109 2016-03-13T09:03:00.728+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30591|1||563ba74d869758a4542b9075, current metadata version is 30591|1||563ba74d869758a4542b9075 2016-03-13T09:03:00.850+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30591|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T09:03:00.885+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:00.885+0000-56e52cc42848c4eacbd0110a", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859780885), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:03:00.917+0000 I SHARDING [conn152] moveChunk request accepted at version 30591|1||563ba74d869758a4542b9075 2016-03-13T09:03:01.042+0000 I SHARDING [conn152] moveChunk number of documents: 5391 2016-03-13T09:03:01.092+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.095+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.113+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.134+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.153+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.194+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.275+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.417+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:01.683+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:02.226+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:03.258+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:04.290+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:05.322+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:06.347+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1452, clonedBytes: 3568839, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:07.371+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4517, clonedBytes: 14790119, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:08.396+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5391, clonedBytes: 16661178, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:09.421+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cc42848c4eacbd0110b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5391, clonedBytes: 16661178, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:09.421+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:03:09.422+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:03:09.422+0000 I SHARDING [conn1245] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:09.422+0000 I SHARDING [conn640] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:09.530+0000 I SHARDING [conn152] moveChunk setting version to: 30592|0||563ba74d869758a4542b9075 2016-03-13T09:03:09.533+0000 I SHARDING [conn1271] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:09.533+0000 I SHARDING [conn810] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:09.533+0000 I SHARDING [conn2361] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:09.538+0000 I SHARDING [conn646] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:09.538+0000 I SHARDING [conn243] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:09.572+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5391, clonedBytes: 16661178, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:03:09.572+0000 I SHARDING [conn152] moveChunk updating self version to: 30592|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') } for collection 'mydomain.Sessions' 2016-03-13T09:03:09.704+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:09.704+0000-56e52ccd2848c4eacbd0110c", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859789704), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, from: "shmydomain1", to: "shmydomain3", cloned: 5391, clonedBytes: 16661178, catchup: 0, steady: 0 } } 2016-03-13T09:03:09.740+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:03:09.744+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:03:09.744+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:09.744+0000-56e52ccd2848c4eacbd0110d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859789744), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, step 1 of 6: 0, step 2 of 6: 456, step 3 of 6: 172, step 4 of 6: 8330, step 5 of 6: 322, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:03:09.944+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:03:09.945+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341059ce48b40ea36ad002') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30591000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4457 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 82277, W: 3380 } } } protocol:op_command 9484ms 2016-03-13T09:03:10.605+0000 I SHARDING [conn2416] remotely refreshing metadata for mydomain.Sessions with requested shard version 30592|1||563ba74d869758a4542b9075 based on current shard version 30592|0||563ba74d869758a4542b9075, current metadata version is 30592|0||563ba74d869758a4542b9075 2016-03-13T09:03:10.605+0000 I SHARDING [conn2589] remotely refreshing metadata for mydomain.Sessions with requested shard version 30592|1||563ba74d869758a4542b9075 based on current shard version 30592|0||563ba74d869758a4542b9075, current metadata version is 30592|0||563ba74d869758a4542b9075 2016-03-13T09:03:10.605+0000 I SHARDING [conn1372] remotely refreshing metadata for mydomain.Sessions with requested shard version 30592|1||563ba74d869758a4542b9075 based on current shard version 30592|0||563ba74d869758a4542b9075, current metadata version is 30592|0||563ba74d869758a4542b9075 2016-03-13T09:03:10.735+0000 I SHARDING [conn2416] updating metadata for mydomain.Sessions from shard version 30592|0||563ba74d869758a4542b9075 to shard version 30592|1||563ba74d869758a4542b9075 2016-03-13T09:03:10.735+0000 I SHARDING [conn2589] metadata of collection mydomain.Sessions already up to date (shard version : 30592|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:03:10.735+0000 I SHARDING [conn1372] metadata of collection mydomain.Sessions already up to date (shard version : 30592|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:03:10.735+0000 I SHARDING [conn2416] collection version was loaded at version 30592|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:03:14.988+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30592000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:03:15.828+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:03:14.014+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:03:16.562+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088658584ad16218d1f24d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088730584ad16218d201ef') } 2016-03-13T09:03:16.700+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088730584ad16218d201ef') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888082a8aa33e0316d7d9') }, with opId: 769095168 2016-03-13T09:03:18.434+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }) in mydomain.Sessions', ts : 56e52cd22848c4eacbd0110e 2016-03-13T09:03:18.434+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30592|1||563ba74d869758a4542b9075, current metadata version is 30592|1||563ba74d869758a4542b9075 2016-03-13T09:03:18.565+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30592|1||563ba74d869758a4542b9075, took 130ms) 2016-03-13T09:03:18.602+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:18.602+0000-56e52cd62848c4eacbd0110f", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859798602), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:03:18.638+0000 I SHARDING [conn152] moveChunk request accepted at version 30592|1||563ba74d869758a4542b9075 2016-03-13T09:03:18.742+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:03:18.791+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:18.793+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:18.798+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:18.808+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:18.845+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:18.885+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:18.966+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:19.107+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:19.371+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:19.897+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:20.949+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:21.981+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:23.014+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:24.039+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2474, clonedBytes: 5292242, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:25.064+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5121, clonedBytes: 16157267, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:26.088+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 17382196, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:27.113+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cd62848c4eacbd01110", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 17382196, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:27.113+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:03:27.114+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:03:27.221+0000 I SHARDING [conn152] moveChunk setting version to: 30593|0||563ba74d869758a4542b9075 2016-03-13T09:03:27.221+0000 I SHARDING [conn272] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:27.223+0000 I SHARDING [conn3136] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:27.223+0000 I SHARDING [conn1928] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:27.223+0000 I SHARDING [conn2046] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:27.223+0000 I SHARDING [conn423] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:27.224+0000 I SHARDING [conn3129] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:27.224+0000 I SHARDING [conn1794] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:27.245+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 17382196, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:03:27.245+0000 I SHARDING [conn152] moveChunk updating self version to: 30593|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') } for collection 'mydomain.Sessions' 2016-03-13T09:03:27.415+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:27.415+0000-56e52cdf2848c4eacbd01111", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859807415), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 17382196, catchup: 0, steady: 0 } } 2016-03-13T09:03:27.449+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:03:27.449+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:03:27.455+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:27.455+0000-56e52cdf2848c4eacbd01112", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859807455), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, step 1 of 6: 0, step 2 of 6: 3650, step 3 of 6: 151, step 4 of 6: 8323, step 5 of 6: 335, step 6 of 6: 5, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:03:27.655+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:03:27.655+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634115b7bc3500e945b2eba') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30592000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 394 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 68185, W: 496 } } } protocol:op_command 12667ms 2016-03-13T09:03:28.280+0000 I SHARDING [conn433] remotely refreshing metadata for mydomain.Sessions with requested shard version 30593|1||563ba74d869758a4542b9075 based on current shard version 30593|0||563ba74d869758a4542b9075, current metadata version is 30593|0||563ba74d869758a4542b9075 2016-03-13T09:03:28.280+0000 I SHARDING [conn2046] remotely refreshing metadata for mydomain.Sessions with requested shard version 30593|1||563ba74d869758a4542b9075 based on current shard version 30593|0||563ba74d869758a4542b9075, current metadata version is 30593|0||563ba74d869758a4542b9075 2016-03-13T09:03:28.280+0000 I SHARDING [conn1928] remotely refreshing metadata for mydomain.Sessions with requested shard version 30593|1||563ba74d869758a4542b9075 based on current shard version 30593|0||563ba74d869758a4542b9075, current metadata version is 30593|0||563ba74d869758a4542b9075 2016-03-13T09:03:28.408+0000 I SHARDING [conn1928] updating metadata for mydomain.Sessions from shard version 30593|0||563ba74d869758a4542b9075 to shard version 30593|1||563ba74d869758a4542b9075 2016-03-13T09:03:28.408+0000 I SHARDING [conn433] metadata of collection mydomain.Sessions already up to date (shard version : 30593|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:03:28.408+0000 I SHARDING [conn2046] metadata of collection mydomain.Sessions already up to date (shard version : 30593|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:03:28.408+0000 I SHARDING [conn1928] collection version was loaded at version 30593|1||563ba74d869758a4542b9075, took 119ms 2016-03-13T09:03:32.180+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30593000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:03:32.494+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }) in mydomain.Sessions', ts : 56e52ce42848c4eacbd01113 2016-03-13T09:03:32.495+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30593|1||563ba74d869758a4542b9075, current metadata version is 30593|1||563ba74d869758a4542b9075 2016-03-13T09:03:32.616+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30593|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:03:32.651+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:32.651+0000-56e52ce42848c4eacbd01114", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859812651), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:03:32.669+0000 I SHARDING [conn176] moveChunk request accepted at version 30593|1||563ba74d869758a4542b9075 2016-03-13T09:03:32.792+0000 I SHARDING [conn176] moveChunk number of documents: 5387 2016-03-13T09:03:32.841+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:32.844+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:32.848+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:32.861+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:32.882+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:32.942+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:33.023+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:33.165+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:33.428+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:33.944+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:34.976+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:36.008+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:37.040+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:38.086+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2435, clonedBytes: 6030302, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:39.110+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16036842, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:40.135+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ce42848c4eacbd01115", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16036842, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:40.135+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:03:40.136+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:03:40.136+0000 I SHARDING [conn2832] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:40.137+0000 I SHARDING [conn1862] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:40.247+0000 I SHARDING [conn176] moveChunk setting version to: 30594|0||563ba74d869758a4542b9075 2016-03-13T09:03:40.247+0000 I SHARDING [conn1979] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:40.249+0000 I SHARDING [conn1759] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:40.249+0000 I SHARDING [conn3117] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:40.249+0000 I SHARDING [conn672] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:40.249+0000 I SHARDING [conn2977] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:40.282+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16036842, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:03:40.282+0000 I SHARDING [conn176] moveChunk updating self version to: 30594|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') } for collection 'mydomain.Sessions' 2016-03-13T09:03:40.454+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:40.454+0000-56e52cec2848c4eacbd01116", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859820454), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16036842, catchup: 0, steady: 0 } } 2016-03-13T09:03:40.487+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:03:40.487+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:03:40.487+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:40.487+0000-56e52cec2848c4eacbd01117", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859820487), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, step 1 of 6: 0, step 2 of 6: 488, step 3 of 6: 171, step 4 of 6: 7295, step 5 of 6: 351, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:03:40.692+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:03:40.692+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341262ce48b40ea190c99b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30593000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 12710 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 67661, W: 1533 } } } protocol:op_command 8512ms 2016-03-13T09:03:41.320+0000 I SHARDING [conn2881] remotely refreshing metadata for mydomain.Sessions with requested shard version 30594|1||563ba74d869758a4542b9075 based on current shard version 30594|0||563ba74d869758a4542b9075, current metadata version is 30594|0||563ba74d869758a4542b9075 2016-03-13T09:03:41.320+0000 I SHARDING [conn2117] remotely refreshing metadata for mydomain.Sessions with requested shard version 30594|1||563ba74d869758a4542b9075 based on current shard version 30594|0||563ba74d869758a4542b9075, current metadata version is 30594|0||563ba74d869758a4542b9075 2016-03-13T09:03:41.324+0000 I SHARDING [conn1785] remotely refreshing metadata for mydomain.Sessions with requested shard version 30594|1||563ba74d869758a4542b9075 based on current shard version 30594|0||563ba74d869758a4542b9075, current metadata version is 30594|0||563ba74d869758a4542b9075 2016-03-13T09:03:41.450+0000 I SHARDING [conn1785] updating metadata for mydomain.Sessions from shard version 30594|0||563ba74d869758a4542b9075 to shard version 30594|1||563ba74d869758a4542b9075 2016-03-13T09:03:41.450+0000 I SHARDING [conn2881] metadata of collection mydomain.Sessions already up to date (shard version : 30594|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:03:41.450+0000 I SHARDING [conn1785] collection version was loaded at version 30594|1||563ba74d869758a4542b9075, took 120ms 2016-03-13T09:03:41.450+0000 I SHARDING [conn2117] metadata of collection mydomain.Sessions already up to date (shard version : 30594|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:03:46.003+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30594000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:03:46.091+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:03:45.828+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:03:46.227+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }) in mydomain.Sessions', ts : 56e52cf12848c4eacbd01118 2016-03-13T09:03:46.227+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30594|1||563ba74d869758a4542b9075, current metadata version is 30594|1||563ba74d869758a4542b9075 2016-03-13T09:03:46.357+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30594|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:03:46.396+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:46.396+0000-56e52cf22848c4eacbd01119", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859826396), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:03:46.431+0000 I SHARDING [conn176] moveChunk request accepted at version 30594|1||563ba74d869758a4542b9075 2016-03-13T09:03:46.531+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:03:46.580+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:46.584+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:46.588+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:46.615+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:46.636+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:46.717+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:46.799+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:46.939+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:47.223+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:47.748+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:48.720+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088730584ad16218d201ef') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888082a8aa33e0316d7d9') } 2016-03-13T09:03:48.770+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888082a8aa33e0316d7d9') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888d82a8aa33e0316e98e') }, with opId: 769143566 2016-03-13T09:03:48.781+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:49.813+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:50.865+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:51.910+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1726, clonedBytes: 4182145, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:52.935+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4932, clonedBytes: 14712065, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:53.968+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16503506, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:54.993+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52cf22848c4eacbd0111a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16503506, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:03:54.993+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:03:54.994+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:03:55.113+0000 I SHARDING [conn176] moveChunk setting version to: 30595|0||563ba74d869758a4542b9075 2016-03-13T09:03:55.115+0000 I SHARDING [conn1872] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:55.115+0000 I SHARDING [conn2230] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:55.115+0000 I SHARDING [conn616] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:55.115+0000 I SHARDING [conn2970] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:55.116+0000 I SHARDING [conn1578] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:55.116+0000 I SHARDING [conn1417] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:55.124+0000 I SHARDING [conn1734] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:03:55.146+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16503506, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:03:55.146+0000 I SHARDING [conn176] moveChunk updating self version to: 30595|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') } for collection 'mydomain.Sessions' 2016-03-13T09:03:55.298+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:55.298+0000-56e52cfb2848c4eacbd0111b", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859835298), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16503506, catchup: 0, steady: 0 } } 2016-03-13T09:03:55.337+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:03:55.338+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:03:55.339+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:03:55.339+0000-56e52cfb2848c4eacbd0111c", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859835339), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, step 1 of 6: 0, step 2 of 6: 427, step 3 of 6: 147, step 4 of 6: 8414, step 5 of 6: 345, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:03:55.537+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:03:55.537+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341367ce48b40ea36b162a') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30594000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3523 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 12004 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 60433, W: 2477 } } } protocol:op_command 9534ms 2016-03-13T09:03:56.166+0000 I SHARDING [conn1584] remotely refreshing metadata for mydomain.Sessions with requested shard version 30595|1||563ba74d869758a4542b9075 based on current shard version 30595|0||563ba74d869758a4542b9075, current metadata version is 30595|0||563ba74d869758a4542b9075 2016-03-13T09:03:56.166+0000 I SHARDING [conn2058] remotely refreshing metadata for mydomain.Sessions with requested shard version 30595|1||563ba74d869758a4542b9075 based on current shard version 30595|0||563ba74d869758a4542b9075, current metadata version is 30595|0||563ba74d869758a4542b9075 2016-03-13T09:03:56.166+0000 I SHARDING [conn1719] remotely refreshing metadata for mydomain.Sessions with requested shard version 30595|1||563ba74d869758a4542b9075 based on current shard version 30595|0||563ba74d869758a4542b9075, current metadata version is 30595|0||563ba74d869758a4542b9075 2016-03-13T09:03:56.292+0000 I SHARDING [conn1584] updating metadata for mydomain.Sessions from shard version 30595|0||563ba74d869758a4542b9075 to shard version 30595|1||563ba74d869758a4542b9075 2016-03-13T09:03:56.292+0000 I SHARDING [conn1584] collection version was loaded at version 30595|1||563ba74d869758a4542b9075, took 125ms 2016-03-13T09:03:56.292+0000 I SHARDING [conn2058] metadata of collection mydomain.Sessions already up to date (shard version : 30595|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:03:56.292+0000 I SHARDING [conn1719] metadata of collection mydomain.Sessions already up to date (shard version : 30595|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:04:00.775+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30595000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:04:01.041+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }) in mydomain.Sessions', ts : 56e52d002848c4eacbd0111d 2016-03-13T09:04:01.041+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30595|1||563ba74d869758a4542b9075, current metadata version is 30595|1||563ba74d869758a4542b9075 2016-03-13T09:04:01.165+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30595|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:04:01.200+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:01.200+0000-56e52d012848c4eacbd0111e", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859841200), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:04:01.216+0000 I SHARDING [conn176] moveChunk request accepted at version 30595|1||563ba74d869758a4542b9075 2016-03-13T09:04:01.322+0000 I SHARDING [conn176] moveChunk number of documents: 5387 2016-03-13T09:04:01.374+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.392+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.413+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.433+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.453+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.493+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.578+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.716+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:01.979+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:02.505+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:03.539+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:04.569+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:05.601+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:06.626+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2148, clonedBytes: 5375998, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:07.651+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5339, clonedBytes: 16695636, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:08.675+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 17010797, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:09.700+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d012848c4eacbd0111f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 17010797, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:09.700+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:04:09.701+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:04:09.704+0000 I SHARDING [conn2095] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:09.704+0000 I SHARDING [conn1749] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:09.819+0000 I SHARDING [conn176] moveChunk setting version to: 30596|0||563ba74d869758a4542b9075 2016-03-13T09:04:09.821+0000 I SHARDING [conn1533] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:09.821+0000 I SHARDING [conn933] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:09.821+0000 I SHARDING [conn1245] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:09.821+0000 I SHARDING [conn2159] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:09.824+0000 I SHARDING [conn441] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:09.856+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 17010797, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:04:09.856+0000 I SHARDING [conn176] moveChunk updating self version to: 30596|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') } for collection 'mydomain.Sessions' 2016-03-13T09:04:09.924+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:09.924+0000-56e52d092848c4eacbd01120", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859849924), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 17010797, catchup: 0, steady: 0 } } 2016-03-13T09:04:09.959+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:04:09.961+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:04:09.963+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:09.963+0000-56e52d092848c4eacbd01121", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859849963), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, step 1 of 6: 0, step 2 of 6: 440, step 3 of 6: 154, step 4 of 6: 8330, step 5 of 6: 260, step 6 of 6: 1, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:04:10.197+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:04:10.197+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634146b7bc3500e945b799c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30595000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4013 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 67738, W: 10891 } } } protocol:op_command 9422ms 2016-03-13T09:04:10.820+0000 I SHARDING [conn1533] remotely refreshing metadata for mydomain.Sessions with requested shard version 30596|1||563ba74d869758a4542b9075 based on current shard version 30596|0||563ba74d869758a4542b9075, current metadata version is 30596|0||563ba74d869758a4542b9075 2016-03-13T09:04:10.820+0000 I SHARDING [conn933] remotely refreshing metadata for mydomain.Sessions with requested shard version 30596|1||563ba74d869758a4542b9075 based on current shard version 30596|0||563ba74d869758a4542b9075, current metadata version is 30596|0||563ba74d869758a4542b9075 2016-03-13T09:04:10.820+0000 I SHARDING [conn849] remotely refreshing metadata for mydomain.Sessions with requested shard version 30596|1||563ba74d869758a4542b9075 based on current shard version 30596|0||563ba74d869758a4542b9075, current metadata version is 30596|0||563ba74d869758a4542b9075 2016-03-13T09:04:10.947+0000 I SHARDING [conn933] updating metadata for mydomain.Sessions from shard version 30596|0||563ba74d869758a4542b9075 to shard version 30596|1||563ba74d869758a4542b9075 2016-03-13T09:04:10.947+0000 I SHARDING [conn1533] metadata of collection mydomain.Sessions already up to date (shard version : 30596|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:04:10.948+0000 I SHARDING [conn933] collection version was loaded at version 30596|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:04:10.947+0000 I SHARDING [conn849] metadata of collection mydomain.Sessions already up to date (shard version : 30596|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:04:15.431+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30596000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:04:15.563+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }) in mydomain.Sessions', ts : 56e52d0f2848c4eacbd01122 2016-03-13T09:04:15.563+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30596|1||563ba74d869758a4542b9075, current metadata version is 30596|1||563ba74d869758a4542b9075 2016-03-13T09:04:15.693+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30596|1||563ba74d869758a4542b9075, took 130ms) 2016-03-13T09:04:15.731+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:15.731+0000-56e52d0f2848c4eacbd01123", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859855731), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:04:15.761+0000 I SHARDING [conn176] moveChunk request accepted at version 30596|1||563ba74d869758a4542b9075 2016-03-13T09:04:15.894+0000 I SHARDING [conn176] moveChunk number of documents: 5388 2016-03-13T09:04:15.944+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:15.950+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:15.966+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:15.987+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:16.006+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:16.047+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:16.128+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:16.210+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:04:16.092+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:04:16.270+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:16.532+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:17.059+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:18.111+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:19.143+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:20.176+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:21.220+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1518, clonedBytes: 3482954, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:22.245+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4987, clonedBytes: 14662031, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:22.313+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888082a8aa33e0316d7d9') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888d82a8aa33e0316e98e') } 2016-03-13T09:04:22.466+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888d82a8aa33e0316e98e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560889a4584ad1621aed54f4') }, with opId: 769195592 2016-03-13T09:04:23.270+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16358884, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:24.295+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d0f2848c4eacbd01124", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16358884, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:24.295+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:04:24.296+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:04:24.297+0000 I SHARDING [conn1760] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:24.297+0000 I SHARDING [conn1944] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:24.297+0000 I SHARDING [conn2637] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:24.405+0000 I SHARDING [conn176] moveChunk setting version to: 30597|0||563ba74d869758a4542b9075 2016-03-13T09:04:24.406+0000 I SHARDING [conn417] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:24.406+0000 I SHARDING [conn823] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:24.407+0000 I SHARDING [conn1014] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:24.407+0000 I SHARDING [conn1627] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:24.438+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16358884, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:04:24.438+0000 I SHARDING [conn176] moveChunk updating self version to: 30597|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') } for collection 'mydomain.Sessions' 2016-03-13T09:04:24.541+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:24.541+0000-56e52d182848c4eacbd01125", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859864541), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16358884, catchup: 0, steady: 0 } } 2016-03-13T09:04:24.574+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:04:24.578+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:04:24.578+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:24.578+0000-56e52d182848c4eacbd01126", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859864578), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, step 1 of 6: 0, step 2 of 6: 330, step 3 of 6: 181, step 4 of 6: 8352, step 5 of 6: 282, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:04:24.880+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:04:24.881+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634157aa2a4330ea41be844') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30596000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 7226 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 1 }, timeAcquiringMicros: { R: 87669, W: 2416 } } } protocol:op_command 9450ms 2016-03-13T09:04:25.406+0000 I SHARDING [conn1189] remotely refreshing metadata for mydomain.Sessions with requested shard version 30597|1||563ba74d869758a4542b9075 based on current shard version 30597|0||563ba74d869758a4542b9075, current metadata version is 30597|0||563ba74d869758a4542b9075 2016-03-13T09:04:25.406+0000 I SHARDING [conn823] remotely refreshing metadata for mydomain.Sessions with requested shard version 30597|1||563ba74d869758a4542b9075 based on current shard version 30597|0||563ba74d869758a4542b9075, current metadata version is 30597|0||563ba74d869758a4542b9075 2016-03-13T09:04:25.406+0000 I SHARDING [conn1944] remotely refreshing metadata for mydomain.Sessions with requested shard version 30597|1||563ba74d869758a4542b9075 based on current shard version 30597|0||563ba74d869758a4542b9075, current metadata version is 30597|0||563ba74d869758a4542b9075 2016-03-13T09:04:25.527+0000 I SHARDING [conn823] updating metadata for mydomain.Sessions from shard version 30597|0||563ba74d869758a4542b9075 to shard version 30597|1||563ba74d869758a4542b9075 2016-03-13T09:04:25.527+0000 I SHARDING [conn823] collection version was loaded at version 30597|1||563ba74d869758a4542b9075, took 121ms 2016-03-13T09:04:25.534+0000 I SHARDING [conn1189] metadata of collection mydomain.Sessions already up to date (shard version : 30597|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:04:25.534+0000 I SHARDING [conn1944] metadata of collection mydomain.Sessions already up to date (shard version : 30597|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:04:30.346+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30597000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:04:30.480+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }) in mydomain.Sessions', ts : 56e52d1e2848c4eacbd01127 2016-03-13T09:04:30.480+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30597|1||563ba74d869758a4542b9075, current metadata version is 30597|1||563ba74d869758a4542b9075 2016-03-13T09:04:30.611+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30597|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:04:30.648+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:30.648+0000-56e52d1e2848c4eacbd01128", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859870648), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:04:30.685+0000 I SHARDING [conn176] moveChunk request accepted at version 30597|1||563ba74d869758a4542b9075 2016-03-13T09:04:30.793+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:04:30.843+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:30.845+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:30.850+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:30.864+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:30.884+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:30.926+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:31.006+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:31.167+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:31.431+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:31.957+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:32.989+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:34.041+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:35.073+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:36.098+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2470, clonedBytes: 6216612, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:37.123+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3403, clonedBytes: 9795411, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:38.148+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4459, clonedBytes: 12567801, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:39.173+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 15743607, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:40.197+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d1e2848c4eacbd01129", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 15743607, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:40.197+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:04:40.198+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:04:40.305+0000 I SHARDING [conn176] moveChunk setting version to: 30598|0||563ba74d869758a4542b9075 2016-03-13T09:04:40.305+0000 I SHARDING [conn1657] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:40.305+0000 I SHARDING [conn2122] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:40.307+0000 I SHARDING [conn2385] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:40.307+0000 I SHARDING [conn2166] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:40.307+0000 I SHARDING [conn1559] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:40.308+0000 I SHARDING [conn106] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:40.309+0000 I SHARDING [conn1788] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:40.333+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 15743607, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:04:40.333+0000 I SHARDING [conn176] moveChunk updating self version to: 30598|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') } for collection 'mydomain.Sessions' 2016-03-13T09:04:40.485+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:40.485+0000-56e52d282848c4eacbd0112a", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859880485), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 15743607, catchup: 0, steady: 0 } } 2016-03-13T09:04:40.519+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:04:40.521+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:04:40.522+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:40.522+0000-56e52d282848c4eacbd0112b", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457859880522), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, step 1 of 6: 0, step 2 of 6: 338, step 3 of 6: 156, step 4 of 6: 9356, step 5 of 6: 324, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:04:40.724+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:04:40.724+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341688a2a4330ea2902e3e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30597000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 6911 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 1 }, timeAcquiringMicros: { R: 68720, W: 2529 } } } protocol:op_command 10378ms 2016-03-13T09:04:41.348+0000 I SHARDING [conn2166] remotely refreshing metadata for mydomain.Sessions with requested shard version 30598|1||563ba74d869758a4542b9075 based on current shard version 30598|0||563ba74d869758a4542b9075, current metadata version is 30598|0||563ba74d869758a4542b9075 2016-03-13T09:04:41.348+0000 I SHARDING [conn778] remotely refreshing metadata for mydomain.Sessions with requested shard version 30598|1||563ba74d869758a4542b9075 based on current shard version 30598|0||563ba74d869758a4542b9075, current metadata version is 30598|0||563ba74d869758a4542b9075 2016-03-13T09:04:41.348+0000 I SHARDING [conn1559] remotely refreshing metadata for mydomain.Sessions with requested shard version 30598|1||563ba74d869758a4542b9075 based on current shard version 30598|0||563ba74d869758a4542b9075, current metadata version is 30598|0||563ba74d869758a4542b9075 2016-03-13T09:04:41.468+0000 I SHARDING [conn1559] updating metadata for mydomain.Sessions from shard version 30598|0||563ba74d869758a4542b9075 to shard version 30598|1||563ba74d869758a4542b9075 2016-03-13T09:04:41.468+0000 I SHARDING [conn1559] collection version was loaded at version 30598|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:04:41.474+0000 I SHARDING [conn778] metadata of collection mydomain.Sessions already up to date (shard version : 30598|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:04:41.474+0000 I SHARDING [conn2166] metadata of collection mydomain.Sessions already up to date (shard version : 30598|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:04:45.121+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30598000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:04:45.310+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }) in mydomain.Sessions', ts : 56e52d2d2848c4eacbd0112c 2016-03-13T09:04:45.310+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30598|1||563ba74d869758a4542b9075, current metadata version is 30598|1||563ba74d869758a4542b9075 2016-03-13T09:04:45.435+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30598|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:04:45.473+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:45.473+0000-56e52d2d2848c4eacbd0112d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859885473), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:04:45.509+0000 I SHARDING [conn152] moveChunk request accepted at version 30598|1||563ba74d869758a4542b9075 2016-03-13T09:04:45.615+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T09:04:45.665+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:45.669+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:45.681+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:45.701+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:45.721+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:45.782+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:45.863+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:46.005+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:46.268+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:46.369+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:04:46.210+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:04:46.814+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:47.867+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:48.898+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:49.930+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:50.955+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2628, clonedBytes: 7479829, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:51.980+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16961954, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:52.603+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560888d82a8aa33e0316e98e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560889a4584ad1621aed54f4') } 2016-03-13T09:04:52.802+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560889a4584ad1621aed54f4') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088a75584ad16218d23fdd') }, with opId: 769244411 2016-03-13T09:04:53.005+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d2d2848c4eacbd0112e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16961954, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:53.005+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:04:53.005+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:04:53.113+0000 I SHARDING [conn152] moveChunk setting version to: 30599|0||563ba74d869758a4542b9075 2016-03-13T09:04:53.114+0000 I SHARDING [conn2587] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:53.115+0000 I SHARDING [conn1891] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:53.115+0000 I SHARDING [conn2341] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:53.115+0000 I SHARDING [conn876] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:53.115+0000 I SHARDING [conn1217] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:53.116+0000 I SHARDING [conn388] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:53.116+0000 I SHARDING [conn2964] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:04:53.136+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16961954, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:04:53.136+0000 I SHARDING [conn152] moveChunk updating self version to: 30599|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') } for collection 'mydomain.Sessions' 2016-03-13T09:04:53.207+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:53.207+0000-56e52d352848c4eacbd0112f", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859893207), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16961954, catchup: 0, steady: 0 } } 2016-03-13T09:04:53.239+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:04:53.239+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:04:53.239+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:53.239+0000-56e52d352848c4eacbd01130", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859893239), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, step 1 of 6: 0, step 2 of 6: 387, step 3 of 6: 154, step 4 of 6: 7341, step 5 of 6: 233, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:04:53.478+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:04:53.478+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341799ce48b40ea36b7657') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30598000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 1082 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 67723, W: 1684 } } } protocol:op_command 8357ms 2016-03-13T09:04:54.069+0000 I SHARDING [conn905] remotely refreshing metadata for mydomain.Sessions with requested shard version 30599|1||563ba74d869758a4542b9075 based on current shard version 30599|0||563ba74d869758a4542b9075, current metadata version is 30599|0||563ba74d869758a4542b9075 2016-03-13T09:04:54.069+0000 I SHARDING [conn1710] remotely refreshing metadata for mydomain.Sessions with requested shard version 30599|1||563ba74d869758a4542b9075 based on current shard version 30599|0||563ba74d869758a4542b9075, current metadata version is 30599|0||563ba74d869758a4542b9075 2016-03-13T09:04:54.069+0000 I SHARDING [conn1003] remotely refreshing metadata for mydomain.Sessions with requested shard version 30599|1||563ba74d869758a4542b9075 based on current shard version 30599|0||563ba74d869758a4542b9075, current metadata version is 30599|0||563ba74d869758a4542b9075 2016-03-13T09:04:54.198+0000 I SHARDING [conn1003] updating metadata for mydomain.Sessions from shard version 30599|0||563ba74d869758a4542b9075 to shard version 30599|1||563ba74d869758a4542b9075 2016-03-13T09:04:54.198+0000 I SHARDING [conn1710] metadata of collection mydomain.Sessions already up to date (shard version : 30599|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:04:54.198+0000 I SHARDING [conn905] metadata of collection mydomain.Sessions already up to date (shard version : 30599|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:04:54.198+0000 I SHARDING [conn1003] collection version was loaded at version 30599|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:04:58.601+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30599000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:04:58.875+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }) in mydomain.Sessions', ts : 56e52d3a2848c4eacbd01131 2016-03-13T09:04:58.875+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30599|1||563ba74d869758a4542b9075, current metadata version is 30599|1||563ba74d869758a4542b9075 2016-03-13T09:04:59.002+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30599|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:04:59.040+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:04:59.040+0000-56e52d3b2848c4eacbd01132", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859899040), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:04:59.058+0000 I SHARDING [conn152] moveChunk request accepted at version 30599|1||563ba74d869758a4542b9075 2016-03-13T09:04:59.171+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:04:59.220+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.222+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.227+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.235+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.263+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.324+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.405+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.547+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:04:59.811+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:00.336+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:01.388+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:02.420+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:03.476+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:04.501+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 833, clonedBytes: 1791456, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:05.525+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4131, clonedBytes: 11706360, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:06.550+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16420961, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:07.575+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d3b2848c4eacbd01133", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16420961, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:07.575+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:05:07.575+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:05:07.683+0000 I SHARDING [conn152] moveChunk setting version to: 30600|0||563ba74d869758a4542b9075 2016-03-13T09:05:07.714+0000 I SHARDING [conn1334] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:07.715+0000 I SHARDING [conn2273] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:07.715+0000 I SHARDING [conn405] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:07.715+0000 I SHARDING [conn249] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:07.715+0000 I SHARDING [conn2442] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:07.716+0000 I SHARDING [conn3114] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:07.717+0000 I SHARDING [conn863] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:07.781+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16420961, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:05:07.781+0000 I SHARDING [conn152] moveChunk updating self version to: 30600|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') } for collection 'mydomain.Sessions' 2016-03-13T09:05:07.902+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:07.902+0000-56e52d432848c4eacbd01134", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859907902), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16420961, catchup: 0, steady: 0 } } 2016-03-13T09:05:07.935+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:05:07.937+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:05:07.939+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:07.939+0000-56e52d432848c4eacbd01135", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859907939), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, step 1 of 6: 0, step 2 of 6: 456, step 3 of 6: 160, step 4 of 6: 8356, step 5 of 6: 362, step 6 of 6: 2, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:05:08.141+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:05:08.141+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563418a4584ad10f21302d09') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30599000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4883 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 71654, W: 1063 } } } protocol:op_command 9540ms 2016-03-13T09:05:08.763+0000 I SHARDING [conn1953] remotely refreshing metadata for mydomain.Sessions with requested shard version 30600|1||563ba74d869758a4542b9075 based on current shard version 30600|0||563ba74d869758a4542b9075, current metadata version is 30600|0||563ba74d869758a4542b9075 2016-03-13T09:05:08.763+0000 I SHARDING [conn1598] remotely refreshing metadata for mydomain.Sessions with requested shard version 30600|1||563ba74d869758a4542b9075 based on current shard version 30600|0||563ba74d869758a4542b9075, current metadata version is 30600|0||563ba74d869758a4542b9075 2016-03-13T09:05:08.801+0000 I SHARDING [conn1395] remotely refreshing metadata for mydomain.Sessions with requested shard version 30600|1||563ba74d869758a4542b9075 based on current shard version 30600|0||563ba74d869758a4542b9075, current metadata version is 30600|0||563ba74d869758a4542b9075 2016-03-13T09:05:08.889+0000 I SHARDING [conn1953] updating metadata for mydomain.Sessions from shard version 30600|0||563ba74d869758a4542b9075 to shard version 30600|1||563ba74d869758a4542b9075 2016-03-13T09:05:08.889+0000 I SHARDING [conn1598] metadata of collection mydomain.Sessions already up to date (shard version : 30600|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:05:08.889+0000 I SHARDING [conn1953] collection version was loaded at version 30600|1||563ba74d869758a4542b9075, took 121ms 2016-03-13T09:05:08.906+0000 I SHARDING [conn1395] metadata of collection mydomain.Sessions already up to date (shard version : 30600|1||563ba74d869758a4542b9075, took 104ms) 2016-03-13T09:05:12.975+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30600000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:05:13.274+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }) in mydomain.Sessions', ts : 56e52d482848c4eacbd01136 2016-03-13T09:05:13.274+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30600|1||563ba74d869758a4542b9075, current metadata version is 30600|1||563ba74d869758a4542b9075 2016-03-13T09:05:13.409+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30600|1||563ba74d869758a4542b9075, took 132ms) 2016-03-13T09:05:13.447+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:13.446+0000-56e52d492848c4eacbd01137", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859913446), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:05:13.469+0000 I SHARDING [conn152] moveChunk request accepted at version 30600|1||563ba74d869758a4542b9075 2016-03-13T09:05:13.580+0000 I SHARDING [conn152] moveChunk number of documents: 5312 2016-03-13T09:05:13.630+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:13.633+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:13.644+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:13.665+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:13.684+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:13.725+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:13.806+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:13.968+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:14.231+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:14.757+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:15.790+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:16.644+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:05:16.369+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:05:16.822+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:17.853+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:18.899+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2101, clonedBytes: 5294901, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:19.940+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3346, clonedBytes: 10472894, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:20.964+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5312, clonedBytes: 16623594, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:21.989+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d492848c4eacbd01138", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5312, clonedBytes: 16623594, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:21.989+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:05:21.996+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:05:21.996+0000 I SHARDING [conn1876] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:22.105+0000 I SHARDING [conn152] moveChunk setting version to: 30601|0||563ba74d869758a4542b9075 2016-03-13T09:05:22.107+0000 I SHARDING [conn2400] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:22.108+0000 I SHARDING [conn964] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:22.108+0000 I SHARDING [conn2653] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:22.108+0000 I SHARDING [conn680] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:22.109+0000 I SHARDING [conn774] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:22.109+0000 I SHARDING [conn1860] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:22.142+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5312, clonedBytes: 16623594, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:05:22.142+0000 I SHARDING [conn152] moveChunk updating self version to: 30601|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') } for collection 'mydomain.Sessions' 2016-03-13T09:05:22.302+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:22.302+0000-56e52d522848c4eacbd01139", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859922302), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, from: "shmydomain1", to: "shmydomain3", cloned: 5312, clonedBytes: 16623594, catchup: 0, steady: 0 } } 2016-03-13T09:05:22.364+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:05:22.364+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:05:22.367+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:22.367+0000-56e52d522848c4eacbd0113a", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859922367), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, step 1 of 6: 0, step 2 of 6: 493, step 3 of 6: 159, step 4 of 6: 8361, step 5 of 6: 374, step 6 of 6: 2, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:05:22.678+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:05:22.678+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563419aea2a4330ea41c4bde') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30600000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:41 reslen:134 locks:{ Global: { acquireCount: { r: 90, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1305 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 43, w: 2 } }, Collection: { acquireCount: { R: 43, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 75908, W: 4287 } } } protocol:op_command 9702ms 2016-03-13T09:05:23.136+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560889a4584ad1621aed54f4') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088a75584ad16218d23fdd') } 2016-03-13T09:05:23.166+0000 I SHARDING [conn982] remotely refreshing metadata for mydomain.Sessions with requested shard version 30601|1||563ba74d869758a4542b9075 based on current shard version 30601|0||563ba74d869758a4542b9075, current metadata version is 30601|0||563ba74d869758a4542b9075 2016-03-13T09:05:23.166+0000 I SHARDING [conn1650] remotely refreshing metadata for mydomain.Sessions with requested shard version 30601|1||563ba74d869758a4542b9075 based on current shard version 30601|0||563ba74d869758a4542b9075, current metadata version is 30601|0||563ba74d869758a4542b9075 2016-03-13T09:05:23.166+0000 I SHARDING [conn964] remotely refreshing metadata for mydomain.Sessions with requested shard version 30601|1||563ba74d869758a4542b9075 based on current shard version 30601|0||563ba74d869758a4542b9075, current metadata version is 30601|0||563ba74d869758a4542b9075 2016-03-13T09:05:23.285+0000 I SHARDING [conn964] updating metadata for mydomain.Sessions from shard version 30601|0||563ba74d869758a4542b9075 to shard version 30601|1||563ba74d869758a4542b9075 2016-03-13T09:05:23.285+0000 I SHARDING [conn982] metadata of collection mydomain.Sessions already up to date (shard version : 30601|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T09:05:23.285+0000 I SHARDING [conn1650] metadata of collection mydomain.Sessions already up to date (shard version : 30601|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T09:05:23.285+0000 I SHARDING [conn964] collection version was loaded at version 30601|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:05:23.683+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088a75584ad16218d23fdd') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088b47e5aec60e6b13209d') }, with opId: 769292624 2016-03-13T09:05:31.271+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30601000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:05:31.563+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }) in mydomain.Sessions', ts : 56e52d5b2848c4eacbd0113b 2016-03-13T09:05:31.563+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30601|1||563ba74d869758a4542b9075, current metadata version is 30601|1||563ba74d869758a4542b9075 2016-03-13T09:05:31.713+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30601|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T09:05:31.754+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:31.754+0000-56e52d5b2848c4eacbd0113c", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859931754), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:05:31.780+0000 I SHARDING [conn152] moveChunk request accepted at version 30601|1||563ba74d869758a4542b9075 2016-03-13T09:05:31.873+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T09:05:31.923+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:31.926+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:31.942+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:31.984+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:32.023+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:32.063+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:32.128+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:32.266+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:32.529+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:33.045+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:34.097+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:35.149+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:36.182+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:37.207+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2036, clonedBytes: 5622136, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:38.231+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5372, clonedBytes: 16247386, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:39.256+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d5b2848c4eacbd0113d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16488667, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:39.256+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:05:39.257+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:05:39.364+0000 I SHARDING [conn152] moveChunk setting version to: 30602|0||563ba74d869758a4542b9075 2016-03-13T09:05:39.365+0000 I SHARDING [conn2548] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:39.366+0000 I SHARDING [conn418] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:39.366+0000 I SHARDING [conn1844] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:39.366+0000 I SHARDING [conn2082] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:39.367+0000 I SHARDING [conn1449] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:39.367+0000 I SHARDING [conn979] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:39.367+0000 I SHARDING [conn2714] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:39.398+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16488667, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:05:39.398+0000 I SHARDING [conn152] moveChunk updating self version to: 30602|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') } for collection 'mydomain.Sessions' 2016-03-13T09:05:39.529+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:39.529+0000-56e52d632848c4eacbd0113e", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859939529), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16488667, catchup: 0, steady: 0 } } 2016-03-13T09:05:39.562+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:05:39.563+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:05:39.563+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:39.563+0000-56e52d632848c4eacbd0113f", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859939563), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, step 1 of 6: 0, step 2 of 6: 509, step 3 of 6: 140, step 4 of 6: 7335, step 5 of 6: 306, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:05:39.767+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:05:39.767+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ab8584ad10f2130622e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30601000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1401 } }, MMAPV1Journal: { acquireCount: { r: 82, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 36, W: 2 }, timeAcquiringMicros: { R: 54094, W: 17850 } } } protocol:op_command 8496ms 2016-03-13T09:05:40.397+0000 I SHARDING [conn395] remotely refreshing metadata for mydomain.Sessions with requested shard version 30602|1||563ba74d869758a4542b9075 based on current shard version 30602|0||563ba74d869758a4542b9075, current metadata version is 30602|0||563ba74d869758a4542b9075 2016-03-13T09:05:40.397+0000 I SHARDING [conn1604] remotely refreshing metadata for mydomain.Sessions with requested shard version 30602|1||563ba74d869758a4542b9075 based on current shard version 30602|0||563ba74d869758a4542b9075, current metadata version is 30602|0||563ba74d869758a4542b9075 2016-03-13T09:05:40.397+0000 I SHARDING [conn3131] remotely refreshing metadata for mydomain.Sessions with requested shard version 30602|1||563ba74d869758a4542b9075 based on current shard version 30602|0||563ba74d869758a4542b9075, current metadata version is 30602|0||563ba74d869758a4542b9075 2016-03-13T09:05:40.597+0000 I SHARDING [conn395] updating metadata for mydomain.Sessions from shard version 30602|0||563ba74d869758a4542b9075 to shard version 30602|1||563ba74d869758a4542b9075 2016-03-13T09:05:40.597+0000 I SHARDING [conn1604] metadata of collection mydomain.Sessions already up to date (shard version : 30602|1||563ba74d869758a4542b9075, took 198ms) 2016-03-13T09:05:40.597+0000 I SHARDING [conn3131] metadata of collection mydomain.Sessions already up to date (shard version : 30602|1||563ba74d869758a4542b9075, took 198ms) 2016-03-13T09:05:40.597+0000 I SHARDING [conn395] collection version was loaded at version 30602|1||563ba74d869758a4542b9075, took 198ms 2016-03-13T09:05:44.947+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30602000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:05:45.208+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }) in mydomain.Sessions', ts : 56e52d682848c4eacbd01140 2016-03-13T09:05:45.208+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30602|1||563ba74d869758a4542b9075, current metadata version is 30602|1||563ba74d869758a4542b9075 2016-03-13T09:05:45.327+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30602|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T09:05:45.362+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:45.362+0000-56e52d692848c4eacbd01141", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859945362), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:05:45.382+0000 I SHARDING [conn152] moveChunk request accepted at version 30602|1||563ba74d869758a4542b9075 2016-03-13T09:05:45.501+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:05:45.550+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:45.552+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:45.557+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:45.574+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:45.594+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:45.635+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:45.716+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:45.878+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:46.164+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:46.708+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:46.779+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:05:46.644+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:05:47.740+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:48.772+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:49.804+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:50.828+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1252, clonedBytes: 2827641, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:51.853+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1648, clonedBytes: 3911834, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:52.878+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3595, clonedBytes: 10795405, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:53.902+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16571427, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:54.877+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088a75584ad16218d23fdd') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088b47e5aec60e6b13209d') } 2016-03-13T09:05:54.927+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d692848c4eacbd01142", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16571427, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:05:54.927+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:05:54.928+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:05:55.036+0000 I SHARDING [conn152] moveChunk setting version to: 30603|0||563ba74d869758a4542b9075 2016-03-13T09:05:55.036+0000 I SHARDING [conn1523] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:55.036+0000 I SHARDING [conn878] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:55.037+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088b47e5aec60e6b13209d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088c16584ad16218d25fdf') }, with opId: 769344974 2016-03-13T09:05:55.037+0000 I SHARDING [conn2298] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:55.037+0000 I SHARDING [conn2458] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:55.037+0000 I SHARDING [conn1765] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:55.037+0000 I SHARDING [conn271] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:55.039+0000 I SHARDING [conn655] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:05:55.066+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16571427, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:05:55.066+0000 I SHARDING [conn152] moveChunk updating self version to: 30603|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') } for collection 'mydomain.Sessions' 2016-03-13T09:05:55.186+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:55.186+0000-56e52d732848c4eacbd01143", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859955186), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16571427, catchup: 0, steady: 0 } } 2016-03-13T09:05:55.221+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:05:55.222+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:05:55.222+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:05:55.222+0000-56e52d732848c4eacbd01144", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859955222), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, step 1 of 6: 0, step 2 of 6: 434, step 3 of 6: 166, step 4 of 6: 9378, step 5 of 6: 295, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:05:55.497+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:05:55.497+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341bca584ad10f1f93550e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30602000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2210 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 1 }, timeAcquiringMicros: { R: 78773, W: 284 } } } protocol:op_command 10550ms 2016-03-13T09:05:56.048+0000 I SHARDING [conn1563] remotely refreshing metadata for mydomain.Sessions with requested shard version 30603|1||563ba74d869758a4542b9075 based on current shard version 30603|0||563ba74d869758a4542b9075, current metadata version is 30603|0||563ba74d869758a4542b9075 2016-03-13T09:05:56.049+0000 I SHARDING [conn271] remotely refreshing metadata for mydomain.Sessions with requested shard version 30603|1||563ba74d869758a4542b9075 based on current shard version 30603|0||563ba74d869758a4542b9075, current metadata version is 30603|0||563ba74d869758a4542b9075 2016-03-13T09:05:56.049+0000 I SHARDING [conn1599] remotely refreshing metadata for mydomain.Sessions with requested shard version 30603|1||563ba74d869758a4542b9075 based on current shard version 30603|0||563ba74d869758a4542b9075, current metadata version is 30603|0||563ba74d869758a4542b9075 2016-03-13T09:05:56.176+0000 I SHARDING [conn271] updating metadata for mydomain.Sessions from shard version 30603|0||563ba74d869758a4542b9075 to shard version 30603|1||563ba74d869758a4542b9075 2016-03-13T09:05:56.176+0000 I SHARDING [conn1563] metadata of collection mydomain.Sessions already up to date (shard version : 30603|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:05:56.176+0000 I SHARDING [conn1599] metadata of collection mydomain.Sessions already up to date (shard version : 30603|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:05:56.176+0000 I SHARDING [conn271] collection version was loaded at version 30603|1||563ba74d869758a4542b9075, took 127ms 2016-03-13T09:06:00.248+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30603000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:06:00.445+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }) in mydomain.Sessions', ts : 56e52d782848c4eacbd01145 2016-03-13T09:06:00.445+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30603|1||563ba74d869758a4542b9075, current metadata version is 30603|1||563ba74d869758a4542b9075 2016-03-13T09:06:00.573+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30603|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:06:00.608+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:00.608+0000-56e52d782848c4eacbd01146", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859960608), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:06:00.626+0000 I SHARDING [conn152] moveChunk request accepted at version 30603|1||563ba74d869758a4542b9075 2016-03-13T09:06:00.736+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:06:00.785+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:00.789+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:00.805+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:00.826+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:00.846+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:00.887+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:00.968+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:01.110+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:01.373+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:01.899+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:02.941+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:03.973+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:05.005+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:06.030+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1491, clonedBytes: 3397267, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:07.055+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4652, clonedBytes: 13145256, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:08.079+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16853341, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:09.104+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d782848c4eacbd01147", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16853341, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:09.104+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:06:09.105+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:06:09.105+0000 I SHARDING [conn1290] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:09.106+0000 I SHARDING [conn1173] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:09.213+0000 I SHARDING [conn152] moveChunk setting version to: 30604|0||563ba74d869758a4542b9075 2016-03-13T09:06:09.215+0000 I SHARDING [conn1598] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:09.216+0000 I SHARDING [conn1953] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:09.216+0000 I SHARDING [conn1005] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:09.216+0000 I SHARDING [conn914] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:09.216+0000 I SHARDING [conn2352] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:09.235+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16853341, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:06:09.235+0000 I SHARDING [conn152] moveChunk updating self version to: 30604|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') } for collection 'mydomain.Sessions' 2016-03-13T09:06:09.320+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:09.320+0000-56e52d812848c4eacbd01148", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859969320), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16853341, catchup: 0, steady: 0 } } 2016-03-13T09:06:09.353+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:06:09.354+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:06:09.354+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:09.354+0000-56e52d812848c4eacbd01149", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859969354), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, step 1 of 6: 0, step 2 of 6: 378, step 3 of 6: 157, step 4 of 6: 8320, step 5 of 6: 250, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:06:09.492+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:06:09.492+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341ce5584ad10f2130994c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30603000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 5088 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 67227, W: 5087 } } } protocol:op_command 9245ms 2016-03-13T09:06:10.195+0000 I SHARDING [conn1779] remotely refreshing metadata for mydomain.Sessions with requested shard version 30604|1||563ba74d869758a4542b9075 based on current shard version 30604|0||563ba74d869758a4542b9075, current metadata version is 30604|0||563ba74d869758a4542b9075 2016-03-13T09:06:10.195+0000 I SHARDING [conn683] remotely refreshing metadata for mydomain.Sessions with requested shard version 30604|1||563ba74d869758a4542b9075 based on current shard version 30604|0||563ba74d869758a4542b9075, current metadata version is 30604|0||563ba74d869758a4542b9075 2016-03-13T09:06:10.195+0000 I SHARDING [conn2095] remotely refreshing metadata for mydomain.Sessions with requested shard version 30604|1||563ba74d869758a4542b9075 based on current shard version 30604|0||563ba74d869758a4542b9075, current metadata version is 30604|0||563ba74d869758a4542b9075 2016-03-13T09:06:10.323+0000 I SHARDING [conn2095] updating metadata for mydomain.Sessions from shard version 30604|0||563ba74d869758a4542b9075 to shard version 30604|1||563ba74d869758a4542b9075 2016-03-13T09:06:10.323+0000 I SHARDING [conn683] metadata of collection mydomain.Sessions already up to date (shard version : 30604|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:06:10.323+0000 I SHARDING [conn2095] collection version was loaded at version 30604|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T09:06:10.323+0000 I SHARDING [conn1779] metadata of collection mydomain.Sessions already up to date (shard version : 30604|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:06:14.344+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30604000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:06:14.482+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }) in mydomain.Sessions', ts : 56e52d862848c4eacbd0114a 2016-03-13T09:06:14.483+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30604|1||563ba74d869758a4542b9075, current metadata version is 30604|1||563ba74d869758a4542b9075 2016-03-13T09:06:14.604+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30604|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T09:06:14.641+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:14.641+0000-56e52d862848c4eacbd0114b", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859974641), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:06:14.666+0000 I SHARDING [conn152] moveChunk request accepted at version 30604|1||563ba74d869758a4542b9075 2016-03-13T09:06:14.773+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:06:14.822+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:14.824+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:14.830+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:14.843+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:14.864+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:14.896+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:14.965+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:15.127+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:15.390+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:15.917+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:16.937+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:06:16.779+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:06:16.948+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:17.980+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:19.013+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:20.037+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 110, clonedBytes: 345287, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:21.062+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 546, clonedBytes: 1282927, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:22.087+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3930, clonedBytes: 11369721, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:23.112+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5310, clonedBytes: 15668130, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:24.137+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16395440, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:25.161+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d862848c4eacbd0114c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16395440, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:25.161+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:06:25.162+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:06:25.270+0000 I SHARDING [conn152] moveChunk setting version to: 30605|0||563ba74d869758a4542b9075 2016-03-13T09:06:25.271+0000 I SHARDING [conn2142] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:25.271+0000 I SHARDING [conn1650] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:25.271+0000 I SHARDING [conn2499] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:25.272+0000 I SHARDING [conn1438] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:25.272+0000 I SHARDING [conn544] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:25.272+0000 I SHARDING [conn2702] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:25.272+0000 I SHARDING [conn1072] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:25.298+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16395440, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:06:25.298+0000 I SHARDING [conn152] moveChunk updating self version to: 30605|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') } for collection 'mydomain.Sessions' 2016-03-13T09:06:25.458+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:25.458+0000-56e52d912848c4eacbd0114d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859985458), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16395440, catchup: 0, steady: 0 } } 2016-03-13T09:06:25.553+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:06:25.554+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:06:25.554+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:25.554+0000-56e52d912848c4eacbd0114e", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859985554), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, step 1 of 6: 0, step 2 of 6: 322, step 3 of 6: 154, step 4 of 6: 10340, step 5 of 6: 392, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:06:25.687+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088b47e5aec60e6b13209d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088c16584ad16218d25fdf') } 2016-03-13T09:06:25.687+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:06:25.687+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341dffa2a4330ea290e0bd') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30604000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 150 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 67730, W: 2457 } } } protocol:op_command 11344ms 2016-03-13T09:06:25.944+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088c16584ad16218d25fdf') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088ce4584ad16218d26dda') }, with opId: 769392952 2016-03-13T09:06:26.325+0000 I SHARDING [conn1946] remotely refreshing metadata for mydomain.Sessions with requested shard version 30605|1||563ba74d869758a4542b9075 based on current shard version 30605|0||563ba74d869758a4542b9075, current metadata version is 30605|0||563ba74d869758a4542b9075 2016-03-13T09:06:26.325+0000 I SHARDING [conn1164] remotely refreshing metadata for mydomain.Sessions with requested shard version 30605|1||563ba74d869758a4542b9075 based on current shard version 30605|0||563ba74d869758a4542b9075, current metadata version is 30605|0||563ba74d869758a4542b9075 2016-03-13T09:06:26.336+0000 I SHARDING [conn1438] remotely refreshing metadata for mydomain.Sessions with requested shard version 30605|1||563ba74d869758a4542b9075 based on current shard version 30605|0||563ba74d869758a4542b9075, current metadata version is 30605|0||563ba74d869758a4542b9075 2016-03-13T09:06:26.451+0000 I SHARDING [conn1164] updating metadata for mydomain.Sessions from shard version 30605|0||563ba74d869758a4542b9075 to shard version 30605|1||563ba74d869758a4542b9075 2016-03-13T09:06:26.451+0000 I SHARDING [conn1946] metadata of collection mydomain.Sessions already up to date (shard version : 30605|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:06:26.451+0000 I SHARDING [conn1438] metadata of collection mydomain.Sessions already up to date (shard version : 30605|1||563ba74d869758a4542b9075, took 113ms) 2016-03-13T09:06:26.451+0000 I SHARDING [conn1164] collection version was loaded at version 30605|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:06:34.336+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30605000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:06:34.593+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }) in mydomain.Sessions', ts : 56e52d9a2848c4eacbd0114f 2016-03-13T09:06:34.593+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30605|1||563ba74d869758a4542b9075, current metadata version is 30605|1||563ba74d869758a4542b9075 2016-03-13T09:06:34.713+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30605|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T09:06:34.748+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:34.748+0000-56e52d9a2848c4eacbd01150", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457859994748), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:06:34.781+0000 I SHARDING [conn152] moveChunk request accepted at version 30605|1||563ba74d869758a4542b9075 2016-03-13T09:06:34.802+0000 I JOURNAL [journal writer] old journal file will be removed: /data/journal/j._1156 2016-03-13T09:06:34.898+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:06:34.951+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:34.954+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:34.963+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:34.984+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:35.005+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:35.044+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:35.126+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:35.267+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:35.530+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:36.056+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:37.089+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:38.121+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:39.153+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:40.197+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1693, clonedBytes: 3852172, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:41.222+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5160, clonedBytes: 14469127, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:42.247+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16659237, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:43.272+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52d9a2848c4eacbd01151", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16659237, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:43.272+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:06:43.272+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:06:43.381+0000 I SHARDING [conn152] moveChunk setting version to: 30606|0||563ba74d869758a4542b9075 2016-03-13T09:06:43.382+0000 I SHARDING [conn445] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:43.382+0000 I SHARDING [conn2511] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:43.383+0000 I SHARDING [conn2714] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:43.383+0000 I SHARDING [conn1869] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:43.384+0000 I SHARDING [conn1979] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:43.384+0000 I SHARDING [conn2742] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:43.384+0000 I SHARDING [conn2548] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:43.407+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16659237, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:06:43.407+0000 I SHARDING [conn152] moveChunk updating self version to: 30606|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') } for collection 'mydomain.Sessions' 2016-03-13T09:06:43.539+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:43.539+0000-56e52da32848c4eacbd01152", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860003539), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16659237, catchup: 0, steady: 0 } } 2016-03-13T09:06:43.632+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:06:43.633+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:06:43.633+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:43.633+0000-56e52da32848c4eacbd01153", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860003633), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, step 1 of 6: 0, step 2 of 6: 444, step 3 of 6: 165, step 4 of 6: 8324, step 5 of 6: 361, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:06:43.903+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:06:43.903+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56341f19a2a4330ea290fb6b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30605000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1231 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 77621, W: 4173 } } } protocol:op_command 9567ms 2016-03-13T09:06:44.397+0000 I SHARDING [conn1856] remotely refreshing metadata for mydomain.Sessions with requested shard version 30606|1||563ba74d869758a4542b9075 based on current shard version 30606|0||563ba74d869758a4542b9075, current metadata version is 30606|0||563ba74d869758a4542b9075 2016-03-13T09:06:44.397+0000 I SHARDING [conn1942] remotely refreshing metadata for mydomain.Sessions with requested shard version 30606|1||563ba74d869758a4542b9075 based on current shard version 30606|0||563ba74d869758a4542b9075, current metadata version is 30606|0||563ba74d869758a4542b9075 2016-03-13T09:06:44.397+0000 I SHARDING [conn1759] remotely refreshing metadata for mydomain.Sessions with requested shard version 30606|1||563ba74d869758a4542b9075 based on current shard version 30606|0||563ba74d869758a4542b9075, current metadata version is 30606|0||563ba74d869758a4542b9075 2016-03-13T09:06:44.518+0000 I SHARDING [conn1942] updating metadata for mydomain.Sessions from shard version 30606|0||563ba74d869758a4542b9075 to shard version 30606|1||563ba74d869758a4542b9075 2016-03-13T09:06:44.518+0000 I SHARDING [conn1856] metadata of collection mydomain.Sessions already up to date (shard version : 30606|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:06:44.518+0000 I SHARDING [conn1942] collection version was loaded at version 30606|1||563ba74d869758a4542b9075, took 120ms 2016-03-13T09:06:44.518+0000 I SHARDING [conn1759] metadata of collection mydomain.Sessions already up to date (shard version : 30606|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:06:47.081+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:06:46.937+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:06:48.690+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30606000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:06:48.825+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }) in mydomain.Sessions', ts : 56e52da82848c4eacbd01154 2016-03-13T09:06:48.825+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30606|1||563ba74d869758a4542b9075, current metadata version is 30606|1||563ba74d869758a4542b9075 2016-03-13T09:06:48.951+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30606|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:06:48.985+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:48.985+0000-56e52da82848c4eacbd01155", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860008985), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:06:49.015+0000 I SHARDING [conn152] moveChunk request accepted at version 30606|1||563ba74d869758a4542b9075 2016-03-13T09:06:49.157+0000 I SHARDING [conn152] moveChunk number of documents: 5391 2016-03-13T09:06:49.207+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.209+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.214+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.234+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.254+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.315+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.396+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.539+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:49.801+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:50.327+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:51.359+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:52.391+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:53.423+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:54.448+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 93, clonedBytes: 479796, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:55.473+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2894, clonedBytes: 8073706, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:56.497+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5391, clonedBytes: 16446947, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:56.613+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088c16584ad16218d25fdf') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088ce4584ad16218d26dda') } 2016-03-13T09:06:56.805+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088ce4584ad16218d26dda') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088dabe5aec60e6b134aa3') }, with opId: 769444667 2016-03-13T09:06:57.522+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52da92848c4eacbd01156", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5391, clonedBytes: 16446947, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:06:57.522+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:06:57.523+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:06:57.524+0000 I SHARDING [conn2230] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:57.524+0000 I SHARDING [conn2164] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:57.525+0000 I SHARDING [conn2458] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:57.525+0000 I SHARDING [conn1550] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:57.632+0000 I SHARDING [conn152] moveChunk setting version to: 30607|0||563ba74d869758a4542b9075 2016-03-13T09:06:57.632+0000 I SHARDING [conn2980] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:57.634+0000 I SHARDING [conn3010] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:57.635+0000 I SHARDING [conn1599] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:06:57.651+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5391, clonedBytes: 16446947, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:06:57.651+0000 I SHARDING [conn152] moveChunk updating self version to: 30607|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') } for collection 'mydomain.Sessions' 2016-03-13T09:06:57.814+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:57.814+0000-56e52db12848c4eacbd01157", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860017814), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, from: "shmydomain1", to: "shmydomain3", cloned: 5391, clonedBytes: 16446947, catchup: 0, steady: 0 } } 2016-03-13T09:06:57.848+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:06:57.850+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:06:57.850+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:06:57.850+0000-56e52db12848c4eacbd01158", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860017850), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, step 1 of 6: 0, step 2 of 6: 324, step 3 of 6: 190, step 4 of 6: 8317, step 5 of 6: 327, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:06:57.984+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:06:57.984+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634202c7bc3500e945c991e') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30606000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 30729 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 73636, W: 2649 } } } protocol:op_command 9294ms 2016-03-13T09:06:58.680+0000 I SHARDING [conn1872] remotely refreshing metadata for mydomain.Sessions with requested shard version 30607|1||563ba74d869758a4542b9075 based on current shard version 30607|0||563ba74d869758a4542b9075, current metadata version is 30607|0||563ba74d869758a4542b9075 2016-03-13T09:06:58.680+0000 I SHARDING [conn674] remotely refreshing metadata for mydomain.Sessions with requested shard version 30607|1||563ba74d869758a4542b9075 based on current shard version 30607|0||563ba74d869758a4542b9075, current metadata version is 30607|0||563ba74d869758a4542b9075 2016-03-13T09:06:58.680+0000 I SHARDING [conn1236] remotely refreshing metadata for mydomain.Sessions with requested shard version 30607|1||563ba74d869758a4542b9075 based on current shard version 30607|0||563ba74d869758a4542b9075, current metadata version is 30607|0||563ba74d869758a4542b9075 2016-03-13T09:06:58.822+0000 I SHARDING [conn674] updating metadata for mydomain.Sessions from shard version 30607|0||563ba74d869758a4542b9075 to shard version 30607|1||563ba74d869758a4542b9075 2016-03-13T09:06:58.822+0000 I SHARDING [conn1872] metadata of collection mydomain.Sessions already up to date (shard version : 30607|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:06:58.822+0000 I SHARDING [conn1236] metadata of collection mydomain.Sessions already up to date (shard version : 30607|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:06:58.822+0000 I SHARDING [conn674] collection version was loaded at version 30607|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:07:02.841+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30607000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:07:03.076+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }) in mydomain.Sessions', ts : 56e52db62848c4eacbd01159 2016-03-13T09:07:03.076+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30607|1||563ba74d869758a4542b9075, current metadata version is 30607|1||563ba74d869758a4542b9075 2016-03-13T09:07:03.207+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30607|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:07:03.246+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:03.246+0000-56e52db72848c4eacbd0115a", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860023246), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:07:03.280+0000 I SHARDING [conn152] moveChunk request accepted at version 30607|1||563ba74d869758a4542b9075 2016-03-13T09:07:03.394+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:07:03.444+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:03.447+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:03.464+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:03.484+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:03.504+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:03.546+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:03.626+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:03.767+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:04.031+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:04.549+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:05.580+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:06.621+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:07.654+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:08.678+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1373, clonedBytes: 3046046, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:09.703+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4753, clonedBytes: 12574973, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:10.728+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16507107, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:11.753+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52db72848c4eacbd0115b", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16507107, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:11.753+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:07:11.754+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:07:11.754+0000 I SHARDING [conn2737] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:11.863+0000 I SHARDING [conn152] moveChunk setting version to: 30608|0||563ba74d869758a4542b9075 2016-03-13T09:07:11.865+0000 I SHARDING [conn3095] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:11.865+0000 I SHARDING [conn2680] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:11.866+0000 I SHARDING [conn1410] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:11.866+0000 I SHARDING [conn1160] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:11.866+0000 I SHARDING [conn185] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:11.866+0000 I SHARDING [conn1819] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:11.891+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16507107, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:07:11.891+0000 I SHARDING [conn152] moveChunk updating self version to: 30608|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') } for collection 'mydomain.Sessions' 2016-03-13T09:07:12.018+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:12.018+0000-56e52dc02848c4eacbd0115c", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860032018), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16507107, catchup: 0, steady: 0 } } 2016-03-13T09:07:12.051+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:07:12.056+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:07:12.056+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:12.056+0000-56e52dc02848c4eacbd0115d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860032056), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, step 1 of 6: 0, step 2 of 6: 439, step 3 of 6: 162, step 4 of 6: 8310, step 5 of 6: 303, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:07:12.294+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:07:12.294+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634214a7bc3500e961ed0f3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30607000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 5315 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 72868, W: 3676 } } } protocol:op_command 9453ms 2016-03-13T09:07:12.878+0000 I SHARDING [conn441] remotely refreshing metadata for mydomain.Sessions with requested shard version 30608|1||563ba74d869758a4542b9075 based on current shard version 30608|0||563ba74d869758a4542b9075, current metadata version is 30608|0||563ba74d869758a4542b9075 2016-03-13T09:07:12.878+0000 I SHARDING [conn2153] remotely refreshing metadata for mydomain.Sessions with requested shard version 30608|1||563ba74d869758a4542b9075 based on current shard version 30608|0||563ba74d869758a4542b9075, current metadata version is 30608|0||563ba74d869758a4542b9075 2016-03-13T09:07:12.878+0000 I SHARDING [conn1598] remotely refreshing metadata for mydomain.Sessions with requested shard version 30608|1||563ba74d869758a4542b9075 based on current shard version 30608|0||563ba74d869758a4542b9075, current metadata version is 30608|0||563ba74d869758a4542b9075 2016-03-13T09:07:13.003+0000 I SHARDING [conn2153] updating metadata for mydomain.Sessions from shard version 30608|0||563ba74d869758a4542b9075 to shard version 30608|1||563ba74d869758a4542b9075 2016-03-13T09:07:13.003+0000 I SHARDING [conn1598] metadata of collection mydomain.Sessions already up to date (shard version : 30608|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:07:13.003+0000 I SHARDING [conn441] metadata of collection mydomain.Sessions already up to date (shard version : 30608|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:07:13.003+0000 I SHARDING [conn2153] collection version was loaded at version 30608|1||563ba74d869758a4542b9075, took 122ms 2016-03-13T09:07:17.093+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30608000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:07:17.211+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:07:17.082+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:07:17.247+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }) in mydomain.Sessions', ts : 56e52dc52848c4eacbd0115e 2016-03-13T09:07:17.247+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30608|1||563ba74d869758a4542b9075, current metadata version is 30608|1||563ba74d869758a4542b9075 2016-03-13T09:07:17.376+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30608|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:07:17.413+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:17.413+0000-56e52dc52848c4eacbd0115f", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860037413), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:07:17.438+0000 I SHARDING [conn176] moveChunk request accepted at version 30608|1||563ba74d869758a4542b9075 2016-03-13T09:07:17.536+0000 I SHARDING [conn176] moveChunk number of documents: 5390 2016-03-13T09:07:17.585+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:17.589+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:17.593+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:17.604+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:17.623+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:17.663+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:17.744+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:17.886+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:18.149+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:18.676+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:19.707+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:20.739+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:21.782+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:22.806+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2099, clonedBytes: 6425672, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:23.831+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4906, clonedBytes: 14393885, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:24.856+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 17067855, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:25.881+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dc52848c4eacbd01160", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5390, clonedBytes: 17067855, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:25.881+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:07:25.882+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:07:25.991+0000 I SHARDING [conn176] moveChunk setting version to: 30609|0||563ba74d869758a4542b9075 2016-03-13T09:07:25.994+0000 I SHARDING [conn1627] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:25.994+0000 I SHARDING [conn1294] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:25.995+0000 I SHARDING [conn1860] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:25.995+0000 I SHARDING [conn2106] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:25.995+0000 I SHARDING [conn2414] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:25.995+0000 I SHARDING [conn2773] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:25.997+0000 I SHARDING [conn1812] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:26.032+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5390, clonedBytes: 17067855, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:07:26.032+0000 I SHARDING [conn176] moveChunk updating self version to: 30609|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') } for collection 'mydomain.Sessions' 2016-03-13T09:07:26.236+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:26.236+0000-56e52dce2848c4eacbd01161", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860046236), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, from: "shmydomain1", to: "shmydomain3", cloned: 5390, clonedBytes: 17067855, catchup: 0, steady: 0 } } 2016-03-13T09:07:26.270+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:07:26.274+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:07:26.277+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:26.277+0000-56e52dce2848c4eacbd01162", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860046277), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, step 1 of 6: 0, step 2 of 6: 344, step 3 of 6: 145, step 4 of 6: 8297, step 5 of 6: 393, step 6 of 6: 2, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:07:26.509+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:07:26.509+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634225d584ad10f21312491') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30608000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 3774 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 62411, W: 2169 } } } protocol:op_command 9416ms 2016-03-13T09:07:27.102+0000 I SHARDING [conn1946] remotely refreshing metadata for mydomain.Sessions with requested shard version 30609|1||563ba74d869758a4542b9075 based on current shard version 30609|0||563ba74d869758a4542b9075, current metadata version is 30609|0||563ba74d869758a4542b9075 2016-03-13T09:07:27.102+0000 I SHARDING [conn1164] remotely refreshing metadata for mydomain.Sessions with requested shard version 30609|1||563ba74d869758a4542b9075 based on current shard version 30609|0||563ba74d869758a4542b9075, current metadata version is 30609|0||563ba74d869758a4542b9075 2016-03-13T09:07:27.104+0000 I SHARDING [conn953] remotely refreshing metadata for mydomain.Sessions with requested shard version 30609|1||563ba74d869758a4542b9075 based on current shard version 30609|0||563ba74d869758a4542b9075, current metadata version is 30609|0||563ba74d869758a4542b9075 2016-03-13T09:07:27.222+0000 I SHARDING [conn1946] updating metadata for mydomain.Sessions from shard version 30609|0||563ba74d869758a4542b9075 to shard version 30609|1||563ba74d869758a4542b9075 2016-03-13T09:07:27.222+0000 I SHARDING [conn953] metadata of collection mydomain.Sessions already up to date (shard version : 30609|1||563ba74d869758a4542b9075, took 115ms) 2016-03-13T09:07:27.222+0000 I SHARDING [conn1164] metadata of collection mydomain.Sessions already up to date (shard version : 30609|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T09:07:27.222+0000 I SHARDING [conn1946] collection version was loaded at version 30609|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:07:27.399+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088ce4584ad16218d26dda') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088dabe5aec60e6b134aa3') } 2016-03-13T09:07:28.015+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088dabe5aec60e6b134aa3') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088e712a8aa33e031755c0') }, with opId: 769492450 2016-03-13T09:07:31.759+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30609000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:07:34.594+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }) in mydomain.Sessions', ts : 56e52dd32848c4eacbd01163 2016-03-13T09:07:34.594+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30609|1||563ba74d869758a4542b9075, current metadata version is 30609|1||563ba74d869758a4542b9075 2016-03-13T09:07:34.727+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30609|1||563ba74d869758a4542b9075, took 132ms) 2016-03-13T09:07:34.764+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:34.764+0000-56e52dd62848c4eacbd01164", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860054764), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:07:35.990+0000 I SHARDING [conn176] moveChunk request accepted at version 30609|1||563ba74d869758a4542b9075 2016-03-13T09:07:36.100+0000 I SHARDING [conn176] moveChunk number of documents: 5388 2016-03-13T09:07:36.149+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.152+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.157+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.186+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.205+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.246+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.327+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.469+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:36.731+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:37.258+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:38.289+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:39.342+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:40.374+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:41.399+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2860, clonedBytes: 8489636, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:42.423+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16009632, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:43.448+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52dd72848c4eacbd01165", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16009632, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:43.448+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:07:43.449+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:07:43.449+0000 I SHARDING [conn275] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:43.450+0000 I SHARDING [conn1431] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:43.451+0000 I SHARDING [conn1345] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:43.451+0000 I SHARDING [conn2873] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:43.558+0000 I SHARDING [conn176] moveChunk setting version to: 30610|0||563ba74d869758a4542b9075 2016-03-13T09:07:43.560+0000 I SHARDING [conn2548] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:43.562+0000 I SHARDING [conn2511] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:43.562+0000 I SHARDING [conn854] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:43.590+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16009632, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:07:43.590+0000 I SHARDING [conn176] moveChunk updating self version to: 30610|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') } for collection 'mydomain.Sessions' 2016-03-13T09:07:43.739+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:43.739+0000-56e52ddf2848c4eacbd01166", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860063739), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16009632, catchup: 0, steady: 0 } } 2016-03-13T09:07:43.848+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:07:43.848+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:07:43.848+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:43.848+0000-56e52ddf2848c4eacbd01167", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860063848), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, step 1 of 6: 0, step 2 of 6: 4230, step 3 of 6: 157, step 4 of 6: 7300, step 5 of 6: 400, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:07:44.088+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:07:44.088+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342377a2a4330ea2916654') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30609000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 831 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 66459, W: 2717 } } } protocol:op_command 12329ms 2016-03-13T09:07:44.635+0000 I SHARDING [conn1345] remotely refreshing metadata for mydomain.Sessions with requested shard version 30610|1||563ba74d869758a4542b9075 based on current shard version 30610|0||563ba74d869758a4542b9075, current metadata version is 30610|0||563ba74d869758a4542b9075 2016-03-13T09:07:44.635+0000 I SHARDING [conn2873] remotely refreshing metadata for mydomain.Sessions with requested shard version 30610|1||563ba74d869758a4542b9075 based on current shard version 30610|0||563ba74d869758a4542b9075, current metadata version is 30610|0||563ba74d869758a4542b9075 2016-03-13T09:07:44.635+0000 I SHARDING [conn1435] remotely refreshing metadata for mydomain.Sessions with requested shard version 30610|1||563ba74d869758a4542b9075 based on current shard version 30610|0||563ba74d869758a4542b9075, current metadata version is 30610|0||563ba74d869758a4542b9075 2016-03-13T09:07:44.761+0000 I SHARDING [conn1435] updating metadata for mydomain.Sessions from shard version 30610|0||563ba74d869758a4542b9075 to shard version 30610|1||563ba74d869758a4542b9075 2016-03-13T09:07:44.761+0000 I SHARDING [conn1345] metadata of collection mydomain.Sessions already up to date (shard version : 30610|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:07:44.761+0000 I SHARDING [conn2873] metadata of collection mydomain.Sessions already up to date (shard version : 30610|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:07:44.761+0000 I SHARDING [conn1435] collection version was loaded at version 30610|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:07:47.474+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:07:47.211+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:07:49.219+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30610000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:07:49.490+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }) in mydomain.Sessions', ts : 56e52de52848c4eacbd01168 2016-03-13T09:07:49.491+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30610|1||563ba74d869758a4542b9075, current metadata version is 30610|1||563ba74d869758a4542b9075 2016-03-13T09:07:49.622+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30610|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:07:49.658+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:49.658+0000-56e52de52848c4eacbd01169", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860069658), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:07:49.684+0000 I SHARDING [conn176] moveChunk request accepted at version 30610|1||563ba74d869758a4542b9075 2016-03-13T09:07:49.786+0000 I SHARDING [conn176] moveChunk number of documents: 5390 2016-03-13T09:07:49.835+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:49.840+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:49.844+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:49.857+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:49.878+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:49.938+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:50.019+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:50.162+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:50.425+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:50.952+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:52.003+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:53.035+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:54.067+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:55.092+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2303, clonedBytes: 6774486, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:56.117+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5242, clonedBytes: 15143826, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:57.141+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 16645778, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:58.166+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52de52848c4eacbd0116a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5390, clonedBytes: 16645778, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:07:58.166+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:07:58.167+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:07:58.169+0000 I SHARDING [conn1843] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:58.276+0000 I SHARDING [conn176] moveChunk setting version to: 30611|0||563ba74d869758a4542b9075 2016-03-13T09:07:58.278+0000 I SHARDING [conn684] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:58.279+0000 I SHARDING [conn2180] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:58.279+0000 I SHARDING [conn3010] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:58.279+0000 I SHARDING [conn2298] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:58.280+0000 I SHARDING [conn915] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:58.280+0000 I SHARDING [conn388] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:07:58.282+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5390, clonedBytes: 16645778, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:07:58.282+0000 I SHARDING [conn176] moveChunk updating self version to: 30611|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') } for collection 'mydomain.Sessions' 2016-03-13T09:07:58.489+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:58.489+0000-56e52dee2848c4eacbd0116b", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860078489), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, from: "shmydomain1", to: "shmydomain3", cloned: 5390, clonedBytes: 16645778, catchup: 0, steady: 0 } } 2016-03-13T09:07:58.525+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:07:58.528+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:07:58.531+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:07:58.531+0000-56e52dee2848c4eacbd0116c", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860078531), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, step 1 of 6: 0, step 2 of 6: 465, step 3 of 6: 149, step 4 of 6: 8332, step 5 of 6: 362, step 6 of 6: 2, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:07:58.742+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:07:58.742+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342490584ad10f1f9434fc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30610000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4078 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 62925, W: 6834 } } } protocol:op_command 9524ms 2016-03-13T09:07:58.753+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088dabe5aec60e6b134aa3') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088e712a8aa33e031755c0') } 2016-03-13T09:07:58.884+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088e712a8aa33e031755c0') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088f3c5366dd0e48f6923f') }, with opId: 769543334 2016-03-13T09:07:59.353+0000 I SHARDING [conn1737] remotely refreshing metadata for mydomain.Sessions with requested shard version 30611|1||563ba74d869758a4542b9075 based on current shard version 30611|0||563ba74d869758a4542b9075, current metadata version is 30611|0||563ba74d869758a4542b9075 2016-03-13T09:07:59.353+0000 I SHARDING [conn1843] remotely refreshing metadata for mydomain.Sessions with requested shard version 30611|1||563ba74d869758a4542b9075 based on current shard version 30611|0||563ba74d869758a4542b9075, current metadata version is 30611|0||563ba74d869758a4542b9075 2016-03-13T09:07:59.372+0000 I SHARDING [conn1348] remotely refreshing metadata for mydomain.Sessions with requested shard version 30611|1||563ba74d869758a4542b9075 based on current shard version 30611|0||563ba74d869758a4542b9075, current metadata version is 30611|0||563ba74d869758a4542b9075 2016-03-13T09:07:59.480+0000 I SHARDING [conn1348] updating metadata for mydomain.Sessions from shard version 30611|0||563ba74d869758a4542b9075 to shard version 30611|1||563ba74d869758a4542b9075 2016-03-13T09:07:59.480+0000 I SHARDING [conn1843] metadata of collection mydomain.Sessions already up to date (shard version : 30611|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:07:59.480+0000 I SHARDING [conn1737] metadata of collection mydomain.Sessions already up to date (shard version : 30611|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:07:59.480+0000 I SHARDING [conn1348] collection version was loaded at version 30611|1||563ba74d869758a4542b9075, took 105ms 2016-03-13T09:08:03.990+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30611000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:08:04.275+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }) in mydomain.Sessions', ts : 56e52df32848c4eacbd0116d 2016-03-13T09:08:04.275+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30611|1||563ba74d869758a4542b9075, current metadata version is 30611|1||563ba74d869758a4542b9075 2016-03-13T09:08:04.391+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30611|1||563ba74d869758a4542b9075, took 116ms) 2016-03-13T09:08:04.427+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:04.427+0000-56e52df42848c4eacbd0116e", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860084427), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:08:04.455+0000 I SHARDING [conn176] moveChunk request accepted at version 30611|1||563ba74d869758a4542b9075 2016-03-13T09:08:04.565+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:08:04.615+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:04.618+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:04.622+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:04.634+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:04.653+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:04.694+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:04.775+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:04.917+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:05.200+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:05.726+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:06.758+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:07.790+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:08.822+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:09.847+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1117, clonedBytes: 2609210, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:10.872+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4625, clonedBytes: 12213458, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:11.896+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5313, clonedBytes: 15097172, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:12.921+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5371, clonedBytes: 16003355, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:13.946+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16329368, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:14.971+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52df42848c4eacbd0116f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16329368, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:14.971+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:08:14.971+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:08:14.974+0000 I SHARDING [conn572] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:14.974+0000 I SHARDING [conn2076] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:15.080+0000 I SHARDING [conn176] moveChunk setting version to: 30612|0||563ba74d869758a4542b9075 2016-03-13T09:08:15.080+0000 I SHARDING [conn405] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:15.080+0000 I SHARDING [conn913] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:15.080+0000 I SHARDING [conn1810] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:15.080+0000 I SHARDING [conn531] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:15.082+0000 I SHARDING [conn1372] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:15.112+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16329368, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:08:15.112+0000 I SHARDING [conn176] moveChunk updating self version to: 30612|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') } for collection 'mydomain.Sessions' 2016-03-13T09:08:15.270+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:15.270+0000-56e52dff2848c4eacbd01170", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860095270), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16329368, catchup: 0, steady: 0 } } 2016-03-13T09:08:15.301+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:08:15.301+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:08:15.301+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:15.301+0000-56e52dff2848c4eacbd01171", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860095301), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, step 1 of 6: 0, step 2 of 6: 464, step 3 of 6: 158, step 4 of 6: 10357, step 5 of 6: 330, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:08:15.507+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:08:15.507+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634259ea2a4330ea2919985') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30611000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 1365 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 70089, W: 3359 } } } protocol:op_command 11516ms 2016-03-13T09:08:16.130+0000 I SHARDING [conn392] remotely refreshing metadata for mydomain.Sessions with requested shard version 30612|1||563ba74d869758a4542b9075 based on current shard version 30612|0||563ba74d869758a4542b9075, current metadata version is 30612|0||563ba74d869758a4542b9075 2016-03-13T09:08:16.130+0000 I SHARDING [conn1531] remotely refreshing metadata for mydomain.Sessions with requested shard version 30612|1||563ba74d869758a4542b9075 based on current shard version 30612|0||563ba74d869758a4542b9075, current metadata version is 30612|0||563ba74d869758a4542b9075 2016-03-13T09:08:16.130+0000 I SHARDING [conn835] remotely refreshing metadata for mydomain.Sessions with requested shard version 30612|1||563ba74d869758a4542b9075 based on current shard version 30612|0||563ba74d869758a4542b9075, current metadata version is 30612|0||563ba74d869758a4542b9075 2016-03-13T09:08:16.266+0000 I SHARDING [conn835] updating metadata for mydomain.Sessions from shard version 30612|0||563ba74d869758a4542b9075 to shard version 30612|1||563ba74d869758a4542b9075 2016-03-13T09:08:16.266+0000 I SHARDING [conn835] collection version was loaded at version 30612|1||563ba74d869758a4542b9075, took 136ms 2016-03-13T09:08:16.286+0000 I SHARDING [conn392] metadata of collection mydomain.Sessions already up to date (shard version : 30612|1||563ba74d869758a4542b9075, took 147ms) 2016-03-13T09:08:16.286+0000 I SHARDING [conn1531] metadata of collection mydomain.Sessions already up to date (shard version : 30612|1||563ba74d869758a4542b9075, took 146ms) 2016-03-13T09:08:17.728+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:08:17.474+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:08:20.912+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30612000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:08:21.174+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }) in mydomain.Sessions', ts : 56e52e042848c4eacbd01172 2016-03-13T09:08:21.174+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30612|1||563ba74d869758a4542b9075, current metadata version is 30612|1||563ba74d869758a4542b9075 2016-03-13T09:08:21.295+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30612|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T09:08:21.331+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:21.331+0000-56e52e052848c4eacbd01173", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860101331), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:08:21.362+0000 I SHARDING [conn176] moveChunk request accepted at version 30612|1||563ba74d869758a4542b9075 2016-03-13T09:08:21.506+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:08:21.555+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:21.576+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:21.597+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:21.616+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:21.657+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:21.697+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:21.778+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:21.920+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:22.183+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:22.709+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:23.741+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:24.773+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:25.818+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:26.845+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2274, clonedBytes: 5695765, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:27.869+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5377, clonedBytes: 16800039, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:28.894+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e052848c4eacbd01174", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16928599, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:28.894+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:08:28.895+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:08:28.895+0000 I SHARDING [conn953] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:29.003+0000 I SHARDING [conn176] moveChunk setting version to: 30613|0||563ba74d869758a4542b9075 2016-03-13T09:08:29.003+0000 I SHARDING [conn1743] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:29.003+0000 I SHARDING [conn681] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:29.005+0000 I SHARDING [conn806] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:29.006+0000 I SHARDING [conn1889] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:29.006+0000 I SHARDING [conn695] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:29.042+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16928599, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:08:29.042+0000 I SHARDING [conn176] moveChunk updating self version to: 30613|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') } for collection 'mydomain.Sessions' 2016-03-13T09:08:29.208+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:29.208+0000-56e52e0d2848c4eacbd01175", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860109208), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16928599, catchup: 0, steady: 0 } } 2016-03-13T09:08:29.243+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:08:29.245+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:08:29.245+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:29.245+0000-56e52e0d2848c4eacbd01176", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860109245), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, step 1 of 6: 0, step 2 of 6: 449, step 3 of 6: 192, step 4 of 6: 7340, step 5 of 6: 350, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:08:29.279+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5318 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088e712a8aa33e031755c0') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088f3c5366dd0e48f6923f') } 2016-03-13T09:08:29.448+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:08:29.448+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563426b1ce48b40ea36cd6d3') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30612000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1463 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 100797, W: 2659 } } } protocol:op_command 8536ms 2016-03-13T09:08:29.575+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088f3c5366dd0e48f6923f') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088fff584ad1621aedc9a6') }, with opId: 769593307 2016-03-13T09:08:30.075+0000 I SHARDING [conn272] remotely refreshing metadata for mydomain.Sessions with requested shard version 30613|1||563ba74d869758a4542b9075 based on current shard version 30613|0||563ba74d869758a4542b9075, current metadata version is 30613|0||563ba74d869758a4542b9075 2016-03-13T09:08:30.076+0000 I SHARDING [conn637] remotely refreshing metadata for mydomain.Sessions with requested shard version 30613|1||563ba74d869758a4542b9075 based on current shard version 30613|0||563ba74d869758a4542b9075, current metadata version is 30613|0||563ba74d869758a4542b9075 2016-03-13T09:08:30.076+0000 I SHARDING [conn953] remotely refreshing metadata for mydomain.Sessions with requested shard version 30613|1||563ba74d869758a4542b9075 based on current shard version 30613|0||563ba74d869758a4542b9075, current metadata version is 30613|0||563ba74d869758a4542b9075 2016-03-13T09:08:30.207+0000 I SHARDING [conn953] updating metadata for mydomain.Sessions from shard version 30613|0||563ba74d869758a4542b9075 to shard version 30613|1||563ba74d869758a4542b9075 2016-03-13T09:08:30.207+0000 I SHARDING [conn637] metadata of collection mydomain.Sessions already up to date (shard version : 30613|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T09:08:30.207+0000 I SHARDING [conn272] metadata of collection mydomain.Sessions already up to date (shard version : 30613|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T09:08:30.207+0000 I SHARDING [conn953] collection version was loaded at version 30613|1||563ba74d869758a4542b9075, took 131ms 2016-03-13T09:08:34.851+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30613000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:08:35.102+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }) in mydomain.Sessions', ts : 56e52e122848c4eacbd01177 2016-03-13T09:08:35.102+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30613|1||563ba74d869758a4542b9075, current metadata version is 30613|1||563ba74d869758a4542b9075 2016-03-13T09:08:35.229+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30613|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:08:35.266+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:35.266+0000-56e52e132848c4eacbd01178", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860115266), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:08:35.311+0000 I SHARDING [conn176] moveChunk request accepted at version 30613|1||563ba74d869758a4542b9075 2016-03-13T09:08:35.426+0000 I SHARDING [conn176] moveChunk number of documents: 5391 2016-03-13T09:08:35.475+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:35.478+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:35.483+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:35.491+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:35.522+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:35.562+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:35.644+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:35.785+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:36.048+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:36.574+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:37.626+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:38.659+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:39.711+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:40.736+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2120, clonedBytes: 4824348, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:41.760+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5369, clonedBytes: 16103612, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:42.785+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5391, clonedBytes: 16612335, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:43.810+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e132848c4eacbd01179", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5391, clonedBytes: 16612335, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:43.810+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:08:43.810+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:08:43.813+0000 I SHARDING [conn3117] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:43.920+0000 I SHARDING [conn176] moveChunk setting version to: 30614|0||563ba74d869758a4542b9075 2016-03-13T09:08:43.922+0000 I SHARDING [conn1869] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:43.922+0000 I SHARDING [conn2882] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:43.922+0000 I SHARDING [conn1575] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:43.922+0000 I SHARDING [conn3131] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:43.922+0000 I SHARDING [conn696] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:43.923+0000 I SHARDING [conn2528] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:43.948+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5391, clonedBytes: 16612335, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:08:43.948+0000 I SHARDING [conn176] moveChunk updating self version to: 30614|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') } for collection 'mydomain.Sessions' 2016-03-13T09:08:44.081+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:44.081+0000-56e52e1c2848c4eacbd0117a", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860124081), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, from: "shmydomain1", to: "shmydomain3", cloned: 5391, clonedBytes: 16612335, catchup: 0, steady: 0 } } 2016-03-13T09:08:44.166+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:08:44.167+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:08:44.167+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:44.167+0000-56e52e1c2848c4eacbd0117b", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860124167), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, step 1 of 6: 0, step 2 of 6: 459, step 3 of 6: 161, step 4 of 6: 8336, step 5 of 6: 357, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:08:44.354+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:08:44.354+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563427c5a2a4330ea41da16f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30613000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 1754 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 75126, W: 4460 } } } protocol:op_command 9503ms 2016-03-13T09:08:44.941+0000 I SHARDING [conn3117] remotely refreshing metadata for mydomain.Sessions with requested shard version 30614|1||563ba74d869758a4542b9075 based on current shard version 30614|0||563ba74d869758a4542b9075, current metadata version is 30614|0||563ba74d869758a4542b9075 2016-03-13T09:08:44.941+0000 I SHARDING [conn2882] remotely refreshing metadata for mydomain.Sessions with requested shard version 30614|1||563ba74d869758a4542b9075 based on current shard version 30614|0||563ba74d869758a4542b9075, current metadata version is 30614|0||563ba74d869758a4542b9075 2016-03-13T09:08:44.941+0000 I SHARDING [conn1575] remotely refreshing metadata for mydomain.Sessions with requested shard version 30614|1||563ba74d869758a4542b9075 based on current shard version 30614|0||563ba74d869758a4542b9075, current metadata version is 30614|0||563ba74d869758a4542b9075 2016-03-13T09:08:45.077+0000 I SHARDING [conn1575] updating metadata for mydomain.Sessions from shard version 30614|0||563ba74d869758a4542b9075 to shard version 30614|1||563ba74d869758a4542b9075 2016-03-13T09:08:45.077+0000 I SHARDING [conn3117] metadata of collection mydomain.Sessions already up to date (shard version : 30614|1||563ba74d869758a4542b9075, took 132ms) 2016-03-13T09:08:45.077+0000 I SHARDING [conn2882] metadata of collection mydomain.Sessions already up to date (shard version : 30614|1||563ba74d869758a4542b9075, took 132ms) 2016-03-13T09:08:45.077+0000 I SHARDING [conn1575] collection version was loaded at version 30614|1||563ba74d869758a4542b9075, took 132ms 2016-03-13T09:08:47.961+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:08:47.728+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:08:49.346+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30614000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:08:49.602+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }) in mydomain.Sessions', ts : 56e52e212848c4eacbd0117c 2016-03-13T09:08:49.602+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30614|1||563ba74d869758a4542b9075, current metadata version is 30614|1||563ba74d869758a4542b9075 2016-03-13T09:08:49.735+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30614|1||563ba74d869758a4542b9075, took 131ms) 2016-03-13T09:08:49.773+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:49.773+0000-56e52e212848c4eacbd0117d", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860129773), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:08:49.808+0000 I SHARDING [conn176] moveChunk request accepted at version 30614|1||563ba74d869758a4542b9075 2016-03-13T09:08:49.917+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:08:49.967+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:49.970+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:49.985+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:50.005+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:50.026+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:50.066+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:50.147+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:50.289+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:50.552+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:51.078+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:52.110+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:53.153+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:54.185+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:55.229+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2533, clonedBytes: 6762515, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:56.254+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16298984, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:57.278+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e212848c4eacbd0117e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16298984, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:08:57.278+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:08:57.279+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:08:57.391+0000 I SHARDING [conn176] moveChunk setting version to: 30615|0||563ba74d869758a4542b9075 2016-03-13T09:08:57.391+0000 I SHARDING [conn1891] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:57.392+0000 I SHARDING [conn1982] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:57.392+0000 I SHARDING [conn621] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:57.392+0000 I SHARDING [conn1523] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:57.393+0000 I SHARDING [conn1786] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:57.393+0000 I SHARDING [conn118] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:57.394+0000 I SHARDING [conn1396] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:08:57.443+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16298984, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:08:57.443+0000 I SHARDING [conn176] moveChunk updating self version to: 30615|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') } for collection 'mydomain.Sessions' 2016-03-13T09:08:57.565+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:57.565+0000-56e52e292848c4eacbd0117f", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860137565), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16298984, catchup: 0, steady: 0 } } 2016-03-13T09:08:57.598+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:08:57.598+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:08:57.598+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:08:57.598+0000-56e52e292848c4eacbd01180", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860137598), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, step 1 of 6: 0, step 2 of 6: 462, step 3 of 6: 156, step 4 of 6: 7313, step 5 of 6: 319, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:08:57.803+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:08:57.803+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563428e1a2a4330ea41dbb62') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30614000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 3154 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 64502, W: 2604 } } } protocol:op_command 8457ms 2016-03-13T09:08:58.428+0000 I SHARDING [conn2058] remotely refreshing metadata for mydomain.Sessions with requested shard version 30615|1||563ba74d869758a4542b9075 based on current shard version 30615|0||563ba74d869758a4542b9075, current metadata version is 30615|0||563ba74d869758a4542b9075 2016-03-13T09:08:58.428+0000 I SHARDING [conn1550] remotely refreshing metadata for mydomain.Sessions with requested shard version 30615|1||563ba74d869758a4542b9075 based on current shard version 30615|0||563ba74d869758a4542b9075, current metadata version is 30615|0||563ba74d869758a4542b9075 2016-03-13T09:08:58.428+0000 I SHARDING [conn821] remotely refreshing metadata for mydomain.Sessions with requested shard version 30615|1||563ba74d869758a4542b9075 based on current shard version 30615|0||563ba74d869758a4542b9075, current metadata version is 30615|0||563ba74d869758a4542b9075 2016-03-13T09:08:58.548+0000 I SHARDING [conn2058] updating metadata for mydomain.Sessions from shard version 30615|0||563ba74d869758a4542b9075 to shard version 30615|1||563ba74d869758a4542b9075 2016-03-13T09:08:58.548+0000 I SHARDING [conn2058] collection version was loaded at version 30615|1||563ba74d869758a4542b9075, took 119ms 2016-03-13T09:08:58.550+0000 I SHARDING [conn1550] metadata of collection mydomain.Sessions already up to date (shard version : 30615|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:08:58.550+0000 I SHARDING [conn821] metadata of collection mydomain.Sessions already up to date (shard version : 30615|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:08:59.854+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5385 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088f3c5366dd0e48f6923f') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088fff584ad1621aedc9a6') } 2016-03-13T09:09:00.178+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088fff584ad1621aedc9a6') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560890c7e5aec60e69cc0f6b') }, with opId: 769641660 2016-03-13T09:09:02.651+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30615000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:09:02.902+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }) in mydomain.Sessions', ts : 56e52e2e2848c4eacbd01181 2016-03-13T09:09:02.902+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30615|1||563ba74d869758a4542b9075, current metadata version is 30615|1||563ba74d869758a4542b9075 2016-03-13T09:09:03.026+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30615|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:09:03.060+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:03.060+0000-56e52e2f2848c4eacbd01182", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860143060), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:09:03.096+0000 I SHARDING [conn152] moveChunk request accepted at version 30615|1||563ba74d869758a4542b9075 2016-03-13T09:09:03.220+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:09:03.270+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.273+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.294+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.314+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.334+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.396+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.476+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.618+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:03.921+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:04.434+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:05.470+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:06.522+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:07.554+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:08.579+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2395, clonedBytes: 5869430, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:09.603+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16071390, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:10.628+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e2f2848c4eacbd01183", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16071390, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:10.628+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:09:10.629+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:09:10.630+0000 I SHARDING [conn1334] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:10.630+0000 I SHARDING [conn3015] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:10.630+0000 I SHARDING [conn3114] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:10.630+0000 I SHARDING [conn2335] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:10.738+0000 I SHARDING [conn152] moveChunk setting version to: 30616|0||563ba74d869758a4542b9075 2016-03-13T09:09:10.740+0000 I SHARDING [conn1656] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:10.740+0000 I SHARDING [conn2210] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:10.740+0000 I SHARDING [conn2559] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:10.754+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16071390, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:09:10.754+0000 I SHARDING [conn152] moveChunk updating self version to: 30616|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') } for collection 'mydomain.Sessions' 2016-03-13T09:09:10.889+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:10.889+0000-56e52e362848c4eacbd01184", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860150889), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16071390, catchup: 0, steady: 0 } } 2016-03-13T09:09:10.925+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:09:10.928+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:09:10.929+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:10.929+0000-56e52e362848c4eacbd01185", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860150929), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, step 1 of 6: 0, step 2 of 6: 445, step 3 of 6: 172, step 4 of 6: 7359, step 5 of 6: 299, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:09:11.132+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:09:11.132+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563429ffa2a4330ea291fecc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30615000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4550 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 84631, W: 3294 } } } protocol:op_command 8482ms 2016-03-13T09:09:11.751+0000 I SHARDING [conn683] remotely refreshing metadata for mydomain.Sessions with requested shard version 30616|1||563ba74d869758a4542b9075 based on current shard version 30616|0||563ba74d869758a4542b9075, current metadata version is 30616|0||563ba74d869758a4542b9075 2016-03-13T09:09:11.751+0000 I SHARDING [conn439] remotely refreshing metadata for mydomain.Sessions with requested shard version 30616|1||563ba74d869758a4542b9075 based on current shard version 30616|0||563ba74d869758a4542b9075, current metadata version is 30616|0||563ba74d869758a4542b9075 2016-03-13T09:09:11.751+0000 I SHARDING [conn1888] remotely refreshing metadata for mydomain.Sessions with requested shard version 30616|1||563ba74d869758a4542b9075 based on current shard version 30616|0||563ba74d869758a4542b9075, current metadata version is 30616|0||563ba74d869758a4542b9075 2016-03-13T09:09:11.878+0000 I SHARDING [conn1888] updating metadata for mydomain.Sessions from shard version 30616|0||563ba74d869758a4542b9075 to shard version 30616|1||563ba74d869758a4542b9075 2016-03-13T09:09:11.878+0000 I SHARDING [conn439] metadata of collection mydomain.Sessions already up to date (shard version : 30616|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:09:11.878+0000 I SHARDING [conn683] metadata of collection mydomain.Sessions already up to date (shard version : 30616|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:09:11.878+0000 I SHARDING [conn1888] collection version was loaded at version 30616|1||563ba74d869758a4542b9075, took 125ms 2016-03-13T09:09:15.954+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30616000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:09:16.218+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }) in mydomain.Sessions', ts : 56e52e3b2848c4eacbd01186 2016-03-13T09:09:16.218+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30616|1||563ba74d869758a4542b9075, current metadata version is 30616|1||563ba74d869758a4542b9075 2016-03-13T09:09:16.369+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30616|1||563ba74d869758a4542b9075, took 147ms) 2016-03-13T09:09:16.410+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:16.410+0000-56e52e3c2848c4eacbd01187", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860156410), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:09:16.427+0000 I SHARDING [conn152] moveChunk request accepted at version 30616|1||563ba74d869758a4542b9075 2016-03-13T09:09:16.570+0000 I SHARDING [conn152] moveChunk number of documents: 5291 2016-03-13T09:09:16.623+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:16.625+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:16.643+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:16.664+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:16.683+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:16.724+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:16.805+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:16.947+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:17.210+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:17.736+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:18.233+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:09:17.961+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:09:18.768+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:19.800+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:20.832+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:21.877+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2626, clonedBytes: 6314949, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:22.902+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5291, clonedBytes: 16247992, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:23.926+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e3c2848c4eacbd01188", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5291, clonedBytes: 16247992, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:23.927+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:09:23.927+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:09:23.928+0000 I SHARDING [conn2377] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:24.035+0000 I SHARDING [conn152] moveChunk setting version to: 30617|0||563ba74d869758a4542b9075 2016-03-13T09:09:24.035+0000 I SHARDING [conn1740] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:24.036+0000 I SHARDING [conn1447] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:24.037+0000 I SHARDING [conn2549] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:24.039+0000 I SHARDING [conn2815] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:24.039+0000 I SHARDING [conn2009] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:24.039+0000 I SHARDING [conn2469] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:24.072+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5291, clonedBytes: 16247992, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:09:24.072+0000 I SHARDING [conn152] moveChunk updating self version to: 30617|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') } for collection 'mydomain.Sessions' 2016-03-13T09:09:24.217+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:24.217+0000-56e52e442848c4eacbd01189", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860164217), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, from: "shmydomain1", to: "shmydomain3", cloned: 5291, clonedBytes: 16247992, catchup: 0, steady: 0 } } 2016-03-13T09:09:24.248+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:09:24.254+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:09:24.254+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:24.254+0000-56e52e442848c4eacbd0118a", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860164254), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, step 1 of 6: 0, step 2 of 6: 473, step 3 of 6: 190, step 4 of 6: 7308, step 5 of 6: 327, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:09:24.487+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:09:24.487+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342b257bc3500e945d9d20') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30616000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:41 reslen:134 locks:{ Global: { acquireCount: { r: 90, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 7553 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 4 } }, Database: { acquireCount: { r: 43, w: 2 } }, Collection: { acquireCount: { R: 43, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 76948, W: 3492 } } } protocol:op_command 8534ms 2016-03-13T09:09:25.114+0000 I SHARDING [conn2040] remotely refreshing metadata for mydomain.Sessions with requested shard version 30617|1||563ba74d869758a4542b9075 based on current shard version 30617|0||563ba74d869758a4542b9075, current metadata version is 30617|0||563ba74d869758a4542b9075 2016-03-13T09:09:25.114+0000 I SHARDING [conn1878] remotely refreshing metadata for mydomain.Sessions with requested shard version 30617|1||563ba74d869758a4542b9075 based on current shard version 30617|0||563ba74d869758a4542b9075, current metadata version is 30617|0||563ba74d869758a4542b9075 2016-03-13T09:09:25.131+0000 I SHARDING [conn960] remotely refreshing metadata for mydomain.Sessions with requested shard version 30617|1||563ba74d869758a4542b9075 based on current shard version 30617|0||563ba74d869758a4542b9075, current metadata version is 30617|0||563ba74d869758a4542b9075 2016-03-13T09:09:25.241+0000 I SHARDING [conn1878] updating metadata for mydomain.Sessions from shard version 30617|0||563ba74d869758a4542b9075 to shard version 30617|1||563ba74d869758a4542b9075 2016-03-13T09:09:25.241+0000 I SHARDING [conn960] metadata of collection mydomain.Sessions already up to date (shard version : 30617|1||563ba74d869758a4542b9075, took 107ms) 2016-03-13T09:09:25.241+0000 I SHARDING [conn1878] collection version was loaded at version 30617|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:09:25.241+0000 I SHARDING [conn2040] metadata of collection mydomain.Sessions already up to date (shard version : 30617|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:09:29.414+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30617000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:09:29.704+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }) in mydomain.Sessions', ts : 56e52e492848c4eacbd0118b 2016-03-13T09:09:29.704+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30617|1||563ba74d869758a4542b9075, current metadata version is 30617|1||563ba74d869758a4542b9075 2016-03-13T09:09:29.829+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30617|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:09:29.866+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:29.866+0000-56e52e492848c4eacbd0118c", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860169866), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:09:29.891+0000 I SHARDING [conn152] moveChunk request accepted at version 30617|1||563ba74d869758a4542b9075 2016-03-13T09:09:30.006+0000 I SHARDING [conn152] moveChunk number of documents: 5387 2016-03-13T09:09:30.056+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.061+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.066+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.083+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.104+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.145+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.225+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.367+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:30.650+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:31.176+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:32.209+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:33.261+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:34.293+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:34.579+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56088fff584ad1621aedc9a6') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560890c7e5aec60e69cc0f6b') } 2016-03-13T09:09:34.639+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560890c7e5aec60e69cc0f6b') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608918de5aec60e69cc1cc5') }, with opId: 769693262 2016-03-13T09:09:35.317+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2613, clonedBytes: 6899117, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:36.342+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5387, clonedBytes: 16557367, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:37.367+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e492848c4eacbd0118d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5387, clonedBytes: 16557367, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:37.367+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:09:37.368+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:09:37.368+0000 I SHARDING [conn805] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:37.369+0000 I SHARDING [conn877] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:37.369+0000 I SHARDING [conn1096] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:37.477+0000 I SHARDING [conn152] moveChunk setting version to: 30618|0||563ba74d869758a4542b9075 2016-03-13T09:09:37.479+0000 I SHARDING [conn875] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:37.479+0000 I SHARDING [conn2532] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:37.480+0000 I SHARDING [conn609] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:37.480+0000 I SHARDING [conn653] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:37.505+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5387, clonedBytes: 16557367, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:09:37.505+0000 I SHARDING [conn152] moveChunk updating self version to: 30618|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') } for collection 'mydomain.Sessions' 2016-03-13T09:09:37.676+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:37.676+0000-56e52e512848c4eacbd0118e", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860177676), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, from: "shmydomain1", to: "shmydomain3", cloned: 5387, clonedBytes: 16557367, catchup: 0, steady: 0 } } 2016-03-13T09:09:37.710+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:09:37.710+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:09:37.710+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:37.710+0000-56e52e512848c4eacbd0118f", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860177710), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, step 1 of 6: 0, step 2 of 6: 476, step 3 of 6: 163, step 4 of 6: 7312, step 5 of 6: 342, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:09:37.949+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:09:37.950+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342c4d584ad10f1f94f292') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30617000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 237 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 75082, W: 3449 } } } protocol:op_command 8535ms 2016-03-13T09:09:38.538+0000 I SHARDING [conn1973] remotely refreshing metadata for mydomain.Sessions with requested shard version 30618|1||563ba74d869758a4542b9075 based on current shard version 30618|0||563ba74d869758a4542b9075, current metadata version is 30618|0||563ba74d869758a4542b9075 2016-03-13T09:09:38.538+0000 I SHARDING [conn2886] remotely refreshing metadata for mydomain.Sessions with requested shard version 30618|1||563ba74d869758a4542b9075 based on current shard version 30618|0||563ba74d869758a4542b9075, current metadata version is 30618|0||563ba74d869758a4542b9075 2016-03-13T09:09:38.538+0000 I SHARDING [conn3119] remotely refreshing metadata for mydomain.Sessions with requested shard version 30618|1||563ba74d869758a4542b9075 based on current shard version 30618|0||563ba74d869758a4542b9075, current metadata version is 30618|0||563ba74d869758a4542b9075 2016-03-13T09:09:38.687+0000 I SHARDING [conn2886] updating metadata for mydomain.Sessions from shard version 30618|0||563ba74d869758a4542b9075 to shard version 30618|1||563ba74d869758a4542b9075 2016-03-13T09:09:38.687+0000 I SHARDING [conn3119] metadata of collection mydomain.Sessions already up to date (shard version : 30618|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:09:38.687+0000 I SHARDING [conn1973] metadata of collection mydomain.Sessions already up to date (shard version : 30618|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:09:38.687+0000 I SHARDING [conn2886] collection version was loaded at version 30618|1||563ba74d869758a4542b9075, took 128ms 2016-03-13T09:09:43.628+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30618000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:09:44.987+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }) in mydomain.Sessions', ts : 56e52e572848c4eacbd01190 2016-03-13T09:09:44.987+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30618|1||563ba74d869758a4542b9075, current metadata version is 30618|1||563ba74d869758a4542b9075 2016-03-13T09:09:45.117+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30618|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T09:09:45.153+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:45.153+0000-56e52e592848c4eacbd01191", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860185153), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:09:45.178+0000 I SHARDING [conn152] moveChunk request accepted at version 30618|1||563ba74d869758a4542b9075 2016-03-13T09:09:45.289+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:09:45.338+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.342+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.355+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.375+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.395+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.436+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.517+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.658+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:45.941+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:46.467+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:47.500+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:48.500+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:09:48.233+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:09:48.532+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:49.574+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:50.619+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2531, clonedBytes: 6314698, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:51.644+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16613411, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:52.669+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e592848c4eacbd01192", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16613411, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:52.669+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:09:52.670+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:09:52.671+0000 I SHARDING [conn675] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:52.672+0000 I SHARDING [conn1558] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:52.672+0000 I SHARDING [conn613] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:52.672+0000 I SHARDING [conn1840] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:52.673+0000 I SHARDING [conn2636] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:52.673+0000 I SHARDING [conn300] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:52.780+0000 I SHARDING [conn152] moveChunk setting version to: 30619|0||563ba74d869758a4542b9075 2016-03-13T09:09:52.783+0000 I SHARDING [conn2108] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:09:52.811+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16613411, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:09:52.811+0000 I SHARDING [conn152] moveChunk updating self version to: 30619|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') } for collection 'mydomain.Sessions' 2016-03-13T09:09:52.957+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:52.957+0000-56e52e602848c4eacbd01193", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860192957), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16613411, catchup: 0, steady: 0 } } 2016-03-13T09:09:52.991+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:09:52.991+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:09:52.991+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:52.991+0000-56e52e602848c4eacbd01194", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860192991), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, step 1 of 6: 0, step 2 of 6: 1549, step 3 of 6: 159, step 4 of 6: 7331, step 5 of 6: 321, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:09:53.196+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:09:53.196+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342d69584ad10f1f950b2b') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30618000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 593 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 77637, W: 4022 } } } protocol:op_command 9568ms 2016-03-13T09:09:53.819+0000 I SHARDING [conn675] remotely refreshing metadata for mydomain.Sessions with requested shard version 30619|1||563ba74d869758a4542b9075 based on current shard version 30619|0||563ba74d869758a4542b9075, current metadata version is 30619|0||563ba74d869758a4542b9075 2016-03-13T09:09:53.819+0000 I SHARDING [conn2108] remotely refreshing metadata for mydomain.Sessions with requested shard version 30619|1||563ba74d869758a4542b9075 based on current shard version 30619|0||563ba74d869758a4542b9075, current metadata version is 30619|0||563ba74d869758a4542b9075 2016-03-13T09:09:53.819+0000 I SHARDING [conn710] remotely refreshing metadata for mydomain.Sessions with requested shard version 30619|1||563ba74d869758a4542b9075 based on current shard version 30619|0||563ba74d869758a4542b9075, current metadata version is 30619|0||563ba74d869758a4542b9075 2016-03-13T09:09:53.945+0000 I SHARDING [conn2108] updating metadata for mydomain.Sessions from shard version 30619|0||563ba74d869758a4542b9075 to shard version 30619|1||563ba74d869758a4542b9075 2016-03-13T09:09:53.945+0000 I SHARDING [conn675] metadata of collection mydomain.Sessions already up to date (shard version : 30619|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:09:53.945+0000 I SHARDING [conn710] metadata of collection mydomain.Sessions already up to date (shard version : 30619|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:09:53.945+0000 I SHARDING [conn2108] collection version was loaded at version 30619|1||563ba74d869758a4542b9075, took 125ms 2016-03-13T09:09:58.312+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30619000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:09:58.587+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }) in mydomain.Sessions', ts : 56e52e662848c4eacbd01195 2016-03-13T09:09:58.587+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30619|1||563ba74d869758a4542b9075, current metadata version is 30619|1||563ba74d869758a4542b9075 2016-03-13T09:09:58.719+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30619|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:09:58.755+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:09:58.755+0000-56e52e662848c4eacbd01196", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860198755), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:09:58.791+0000 I SHARDING [conn152] moveChunk request accepted at version 30619|1||563ba74d869758a4542b9075 2016-03-13T09:09:58.918+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:09:58.967+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:58.972+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:58.988+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:59.008+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:59.049+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:59.089+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:59.170+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:59.311+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:09:59.574+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:00.101+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:01.133+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:02.185+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:03.210+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:04.235+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1698, clonedBytes: 3621140, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:04.742+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560890c7e5aec60e69cc0f6b') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608918de5aec60e69cc1cc5') } 2016-03-13T09:10:04.872+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608918de5aec60e69cc1cc5') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608925a584ad1621aedf325') }, with opId: 769742630 2016-03-13T09:10:05.260+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4898, clonedBytes: 13337487, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:06.284+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16755966, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:07.309+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e662848c4eacbd01197", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16755966, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:07.309+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:10:07.310+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:10:07.310+0000 I SHARDING [conn426] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:07.422+0000 I SHARDING [conn152] moveChunk setting version to: 30620|0||563ba74d869758a4542b9075 2016-03-13T09:10:07.422+0000 I SHARDING [conn1203] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:07.422+0000 I SHARDING [conn2356] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:07.422+0000 I SHARDING [conn3100] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:07.422+0000 I SHARDING [conn2368] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:07.422+0000 I SHARDING [conn3104] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:07.426+0000 I SHARDING [conn2789] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:07.448+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16755966, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:10:07.448+0000 I SHARDING [conn152] moveChunk updating self version to: 30620|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') } for collection 'mydomain.Sessions' 2016-03-13T09:10:07.585+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:07.585+0000-56e52e6f2848c4eacbd01198", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860207585), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16755966, catchup: 0, steady: 0 } } 2016-03-13T09:10:07.618+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:10:07.619+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:10:07.619+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:07.619+0000-56e52e6f2848c4eacbd01199", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860207619), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, step 1 of 6: 0, step 2 of 6: 478, step 3 of 6: 174, step 4 of 6: 8343, step 5 of 6: 309, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:10:07.824+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:10:07.824+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342e90ce48b40ea36d8e59') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30619000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 923 } }, MMAPV1Journal: { acquireCount: { r: 88, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 42, W: 2 }, timeAcquiringMicros: { R: 88588, W: 7092 } } } protocol:op_command 9512ms 2016-03-13T09:10:08.444+0000 I SHARDING [conn1822] remotely refreshing metadata for mydomain.Sessions with requested shard version 30620|1||563ba74d869758a4542b9075 based on current shard version 30620|0||563ba74d869758a4542b9075, current metadata version is 30620|0||563ba74d869758a4542b9075 2016-03-13T09:10:08.477+0000 I SHARDING [conn2777] remotely refreshing metadata for mydomain.Sessions with requested shard version 30620|1||563ba74d869758a4542b9075 based on current shard version 30620|0||563ba74d869758a4542b9075, current metadata version is 30620|0||563ba74d869758a4542b9075 2016-03-13T09:10:08.477+0000 I SHARDING [conn2516] remotely refreshing metadata for mydomain.Sessions with requested shard version 30620|1||563ba74d869758a4542b9075 based on current shard version 30620|0||563ba74d869758a4542b9075, current metadata version is 30620|0||563ba74d869758a4542b9075 2016-03-13T09:10:08.571+0000 I SHARDING [conn1822] updating metadata for mydomain.Sessions from shard version 30620|0||563ba74d869758a4542b9075 to shard version 30620|1||563ba74d869758a4542b9075 2016-03-13T09:10:08.571+0000 I SHARDING [conn1822] collection version was loaded at version 30620|1||563ba74d869758a4542b9075, took 120ms 2016-03-13T09:10:08.597+0000 I SHARDING [conn2516] metadata of collection mydomain.Sessions already up to date (shard version : 30620|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T09:10:08.597+0000 I SHARDING [conn2777] metadata of collection mydomain.Sessions already up to date (shard version : 30620|1||563ba74d869758a4542b9075, took 117ms) 2016-03-13T09:10:13.150+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30620000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:10:13.424+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }) in mydomain.Sessions', ts : 56e52e752848c4eacbd0119a 2016-03-13T09:10:13.424+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30620|1||563ba74d869758a4542b9075, current metadata version is 30620|1||563ba74d869758a4542b9075 2016-03-13T09:10:13.548+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30620|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:10:13.583+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:13.583+0000-56e52e752848c4eacbd0119b", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860213583), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:10:13.605+0000 I SHARDING [conn152] moveChunk request accepted at version 30620|1||563ba74d869758a4542b9075 2016-03-13T09:10:13.721+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:10:13.774+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:13.777+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:13.781+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:13.789+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:13.814+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:13.855+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:13.937+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:14.077+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:14.341+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:14.867+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:15.910+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:16.941+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:17.995+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:18.747+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:10:18.500+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:10:19.020+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1053, clonedBytes: 2279851, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:20.045+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4361, clonedBytes: 12396968, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:21.069+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16879885, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:22.094+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e752848c4eacbd0119c", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16879885, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:22.094+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:10:22.095+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:10:22.096+0000 I SHARDING [conn995] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:22.096+0000 I SHARDING [conn2804] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:22.206+0000 I SHARDING [conn152] moveChunk setting version to: 30621|0||563ba74d869758a4542b9075 2016-03-13T09:10:22.206+0000 I SHARDING [conn2393] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:22.235+0000 I SHARDING [conn699] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:22.236+0000 I SHARDING [conn1997] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:22.236+0000 I SHARDING [conn2147] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:22.236+0000 I SHARDING [conn2583] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:22.265+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16879885, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:10:22.265+0000 I SHARDING [conn152] moveChunk updating self version to: 30621|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') } for collection 'mydomain.Sessions' 2016-03-13T09:10:22.401+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:22.401+0000-56e52e7e2848c4eacbd0119d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860222401), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, from: "shmydomain1", to: "shmydomain2", cloned: 5389, clonedBytes: 16879885, catchup: 0, steady: 0 } } 2016-03-13T09:10:22.435+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:10:22.435+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:10:22.435+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:22.435+0000-56e52e7e2848c4eacbd0119e", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860222435), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, step 1 of 6: 0, step 2 of 6: 454, step 3 of 6: 167, step 4 of 6: 8321, step 5 of 6: 340, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:10:22.606+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:10:22.606+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56342fbc7bc3500e96202352') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30620000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2490 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 74200, W: 3071 } } } protocol:op_command 9456ms 2016-03-13T09:10:23.261+0000 I SHARDING [conn1787] remotely refreshing metadata for mydomain.Sessions with requested shard version 30621|1||563ba74d869758a4542b9075 based on current shard version 30621|0||563ba74d869758a4542b9075, current metadata version is 30621|0||563ba74d869758a4542b9075 2016-03-13T09:10:23.264+0000 I SHARDING [conn3127] remotely refreshing metadata for mydomain.Sessions with requested shard version 30621|1||563ba74d869758a4542b9075 based on current shard version 30621|0||563ba74d869758a4542b9075, current metadata version is 30621|0||563ba74d869758a4542b9075 2016-03-13T09:10:23.280+0000 I SHARDING [conn699] remotely refreshing metadata for mydomain.Sessions with requested shard version 30621|1||563ba74d869758a4542b9075 based on current shard version 30621|0||563ba74d869758a4542b9075, current metadata version is 30621|0||563ba74d869758a4542b9075 2016-03-13T09:10:23.378+0000 I SHARDING [conn3127] updating metadata for mydomain.Sessions from shard version 30621|0||563ba74d869758a4542b9075 to shard version 30621|1||563ba74d869758a4542b9075 2016-03-13T09:10:23.378+0000 I SHARDING [conn3127] collection version was loaded at version 30621|1||563ba74d869758a4542b9075, took 112ms 2016-03-13T09:10:23.398+0000 I SHARDING [conn1787] metadata of collection mydomain.Sessions already up to date (shard version : 30621|1||563ba74d869758a4542b9075, took 134ms) 2016-03-13T09:10:23.424+0000 I SHARDING [conn699] metadata of collection mydomain.Sessions already up to date (shard version : 30621|1||563ba74d869758a4542b9075, took 144ms) 2016-03-13T09:10:27.810+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30621000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:10:28.083+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }) in mydomain.Sessions', ts : 56e52e832848c4eacbd0119f 2016-03-13T09:10:28.083+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30621|1||563ba74d869758a4542b9075, current metadata version is 30621|1||563ba74d869758a4542b9075 2016-03-13T09:10:28.208+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30621|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:10:28.243+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:28.243+0000-56e52e842848c4eacbd011a0", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860228243), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:10:28.256+0000 I SHARDING [conn152] moveChunk request accepted at version 30621|1||563ba74d869758a4542b9075 2016-03-13T09:10:28.375+0000 I SHARDING [conn152] moveChunk number of documents: 5392 2016-03-13T09:10:28.427+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.430+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.439+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.459+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.479+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.520+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.584+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.722+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:28.985+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:29.531+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:30.564+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:31.596+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:32.628+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:33.652+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2548, clonedBytes: 5844693, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:34.677+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5372, clonedBytes: 17078411, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:35.085+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608918de5aec60e69cc1cc5') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608925a584ad1621aedf325') } 2016-03-13T09:10:35.230+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608925a584ad1621aedf325') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089320c5ab960e4d3e9a41') }, with opId: 769791879 2016-03-13T09:10:35.702+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52e842848c4eacbd011a1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5392, clonedBytes: 17511737, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:35.702+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:10:35.703+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:10:35.704+0000 I SHARDING [conn1072] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:35.704+0000 I SHARDING [conn659] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:35.704+0000 I SHARDING [conn2354] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:35.704+0000 I SHARDING [conn2406] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:35.704+0000 I SHARDING [conn1110] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:35.705+0000 I SHARDING [conn1205] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:35.705+0000 I SHARDING [conn1248] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:35.814+0000 I SHARDING [conn152] moveChunk setting version to: 30622|0||563ba74d869758a4542b9075 2016-03-13T09:10:35.836+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5392, clonedBytes: 17511737, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:10:35.836+0000 I SHARDING [conn152] moveChunk updating self version to: 30622|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') } for collection 'mydomain.Sessions' 2016-03-13T09:10:36.004+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:36.004+0000-56e52e8c2848c4eacbd011a2", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860236004), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, from: "shmydomain1", to: "shmydomain3", cloned: 5392, clonedBytes: 17511737, catchup: 0, steady: 0 } } 2016-03-13T09:10:36.047+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:10:36.059+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:10:36.059+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:36.059+0000-56e52e8c2848c4eacbd011a3", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860236059), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, step 1 of 6: 0, step 2 of 6: 445, step 3 of 6: 167, step 4 of 6: 7279, step 5 of 6: 357, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:10:36.353+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:10:36.353+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563430eea2a4330ea41e7d4d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30621000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 13842 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 78204, W: 6561 } } } protocol:op_command 8544ms 2016-03-13T09:10:36.871+0000 I SHARDING [conn383] remotely refreshing metadata for mydomain.Sessions with requested shard version 30622|1||563ba74d869758a4542b9075 based on current shard version 30622|0||563ba74d869758a4542b9075, current metadata version is 30622|0||563ba74d869758a4542b9075 2016-03-13T09:10:36.901+0000 I SHARDING [conn2793] remotely refreshing metadata for mydomain.Sessions with requested shard version 30622|1||563ba74d869758a4542b9075 based on current shard version 30622|0||563ba74d869758a4542b9075, current metadata version is 30622|0||563ba74d869758a4542b9075 2016-03-13T09:10:36.901+0000 I SHARDING [conn2445] remotely refreshing metadata for mydomain.Sessions with requested shard version 30622|1||563ba74d869758a4542b9075 based on current shard version 30622|0||563ba74d869758a4542b9075, current metadata version is 30622|0||563ba74d869758a4542b9075 2016-03-13T09:10:36.997+0000 I SHARDING [conn383] updating metadata for mydomain.Sessions from shard version 30622|0||563ba74d869758a4542b9075 to shard version 30622|1||563ba74d869758a4542b9075 2016-03-13T09:10:36.997+0000 I SHARDING [conn383] collection version was loaded at version 30622|1||563ba74d869758a4542b9075, took 121ms 2016-03-13T09:10:37.026+0000 I SHARDING [conn2793] metadata of collection mydomain.Sessions already up to date (shard version : 30622|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:10:37.026+0000 I SHARDING [conn2445] metadata of collection mydomain.Sessions already up to date (shard version : 30622|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:10:41.140+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30622000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:10:41.418+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }) in mydomain.Sessions', ts : 56e52e912848c4eacbd011a4 2016-03-13T09:10:41.418+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30622|1||563ba74d869758a4542b9075, current metadata version is 30622|1||563ba74d869758a4542b9075 2016-03-13T09:10:41.544+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30622|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:10:41.580+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:41.579+0000-56e52e912848c4eacbd011a5", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860241579), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:10:41.587+0000 I SHARDING [conn152] moveChunk request accepted at version 30622|1||563ba74d869758a4542b9075 2016-03-13T09:10:41.694+0000 I SHARDING [conn152] moveChunk number of documents: 5391 2016-03-13T09:10:41.745+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:41.750+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:41.767+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:41.787+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:41.807+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:41.848+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:41.929+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:42.070+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:42.333+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:42.860+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:43.893+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:44.965+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:45.991+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:47.016+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1357, clonedBytes: 2781500, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:48.040+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4395, clonedBytes: 12982709, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:49.044+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:10:48.748+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:10:49.065+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5391, clonedBytes: 17477729, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:50.090+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52e912848c4eacbd011a6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5391, clonedBytes: 17477729, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:50.090+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:10:50.091+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:10:50.092+0000 I SHARDING [conn2524] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:50.092+0000 I SHARDING [conn1443] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:50.093+0000 I SHARDING [conn285] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:50.202+0000 I SHARDING [conn152] moveChunk setting version to: 30623|0||563ba74d869758a4542b9075 2016-03-13T09:10:50.202+0000 I SHARDING [conn3007] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:50.202+0000 I SHARDING [conn2655] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:50.202+0000 I SHARDING [conn727] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:50.204+0000 I SHARDING [conn1154] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:10:50.240+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5391, clonedBytes: 17477729, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:10:50.240+0000 I SHARDING [conn152] moveChunk updating self version to: 30623|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') } for collection 'mydomain.Sessions' 2016-03-13T09:10:50.377+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:50.377+0000-56e52e9a2848c4eacbd011a7", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860250377), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, from: "shmydomain1", to: "shmydomain2", cloned: 5391, clonedBytes: 17477729, catchup: 0, steady: 0 } } 2016-03-13T09:10:50.410+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:10:50.412+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:10:50.412+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:50.412+0000-56e52e9a2848c4eacbd011a8", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860250412), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, step 1 of 6: 0, step 2 of 6: 447, step 3 of 6: 156, step 4 of 6: 8346, step 5 of 6: 322, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:10:50.615+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:10:50.615+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343221a2a4330ea41ea076') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30622000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3018 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 69216, W: 6295 } } } protocol:op_command 9476ms 2016-03-13T09:10:51.239+0000 I SHARDING [conn1855] remotely refreshing metadata for mydomain.Sessions with requested shard version 30623|1||563ba74d869758a4542b9075 based on current shard version 30623|0||563ba74d869758a4542b9075, current metadata version is 30623|0||563ba74d869758a4542b9075 2016-03-13T09:10:51.239+0000 I SHARDING [conn2062] remotely refreshing metadata for mydomain.Sessions with requested shard version 30623|1||563ba74d869758a4542b9075 based on current shard version 30623|0||563ba74d869758a4542b9075, current metadata version is 30623|0||563ba74d869758a4542b9075 2016-03-13T09:10:51.257+0000 I SHARDING [conn2687] remotely refreshing metadata for mydomain.Sessions with requested shard version 30623|1||563ba74d869758a4542b9075 based on current shard version 30623|0||563ba74d869758a4542b9075, current metadata version is 30623|0||563ba74d869758a4542b9075 2016-03-13T09:10:51.362+0000 I SHARDING [conn2687] updating metadata for mydomain.Sessions from shard version 30623|0||563ba74d869758a4542b9075 to shard version 30623|1||563ba74d869758a4542b9075 2016-03-13T09:10:51.362+0000 I SHARDING [conn2687] collection version was loaded at version 30623|1||563ba74d869758a4542b9075, took 103ms 2016-03-13T09:10:51.367+0000 I SHARDING [conn2062] metadata of collection mydomain.Sessions already up to date (shard version : 30623|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:10:51.367+0000 I SHARDING [conn1855] metadata of collection mydomain.Sessions already up to date (shard version : 30623|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:10:55.684+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30623000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:10:55.931+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }) in mydomain.Sessions', ts : 56e52e9f2848c4eacbd011a9 2016-03-13T09:10:55.931+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30623|1||563ba74d869758a4542b9075, current metadata version is 30623|1||563ba74d869758a4542b9075 2016-03-13T09:10:56.061+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30623|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:10:56.098+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:10:56.098+0000-56e52ea02848c4eacbd011aa", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860256098), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:10:56.134+0000 I SHARDING [conn152] moveChunk request accepted at version 30623|1||563ba74d869758a4542b9075 2016-03-13T09:10:56.368+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:10:56.417+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:56.421+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:56.442+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:56.450+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:56.467+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:56.512+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:56.594+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:56.735+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:57.018+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:57.565+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:58.617+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:10:59.649+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:00.682+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:01.707+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2366, clonedBytes: 5117785, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:02.731+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5386, clonedBytes: 16730066, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:03.756+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16768329, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:04.781+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ea02848c4eacbd011ab", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16768329, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:04.781+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:11:04.782+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:11:04.783+0000 I SHARDING [conn2183] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:04.783+0000 I SHARDING [conn1586] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:04.784+0000 I SHARDING [conn436] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:04.784+0000 I SHARDING [conn1383] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:04.785+0000 I SHARDING [conn435] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:04.891+0000 I SHARDING [conn152] moveChunk setting version to: 30624|0||563ba74d869758a4542b9075 2016-03-13T09:11:04.891+0000 I SHARDING [conn2171] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:04.922+0000 I SHARDING [conn1190] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:04.967+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16768329, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:11:04.967+0000 I SHARDING [conn152] moveChunk updating self version to: 30624|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') } for collection 'mydomain.Sessions' 2016-03-13T09:11:05.113+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:05.113+0000-56e52ea92848c4eacbd011ac", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860265113), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16768329, catchup: 0, steady: 0 } } 2016-03-13T09:11:05.156+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:11:05.157+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:11:05.158+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:05.158+0000-56e52ea92848c4eacbd011ad", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860265158), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, step 1 of 6: 0, step 2 of 6: 450, step 3 of 6: 281, step 4 of 6: 8365, step 5 of 6: 375, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:11:05.491+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:11:05.491+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343351a2a4330ea41ebb08') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30623000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1423 } }, MMAPV1Journal: { acquireCount: { r: 80, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 34, W: 2 }, timeAcquiringMicros: { R: 185367, W: 5197 } } } protocol:op_command 9808ms 2016-03-13T09:11:05.738+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608925a584ad1621aedf325') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089320c5ab960e4d3e9a41') } 2016-03-13T09:11:05.975+0000 I SHARDING [conn1686] remotely refreshing metadata for mydomain.Sessions with requested shard version 30624|1||563ba74d869758a4542b9075 based on current shard version 30624|0||563ba74d869758a4542b9075, current metadata version is 30624|0||563ba74d869758a4542b9075 2016-03-13T09:11:05.975+0000 I SHARDING [conn761] remotely refreshing metadata for mydomain.Sessions with requested shard version 30624|1||563ba74d869758a4542b9075 based on current shard version 30624|0||563ba74d869758a4542b9075, current metadata version is 30624|0||563ba74d869758a4542b9075 2016-03-13T09:11:05.975+0000 I SHARDING [conn1960] remotely refreshing metadata for mydomain.Sessions with requested shard version 30624|1||563ba74d869758a4542b9075 based on current shard version 30624|0||563ba74d869758a4542b9075, current metadata version is 30624|0||563ba74d869758a4542b9075 2016-03-13T09:11:06.008+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089320c5ab960e4d3e9a41') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560893e6e5aec60e69cc47d2') }, with opId: 769836600 2016-03-13T09:11:06.096+0000 I SHARDING [conn1686] updating metadata for mydomain.Sessions from shard version 30624|0||563ba74d869758a4542b9075 to shard version 30624|1||563ba74d869758a4542b9075 2016-03-13T09:11:06.096+0000 I SHARDING [conn1686] collection version was loaded at version 30624|1||563ba74d869758a4542b9075, took 120ms 2016-03-13T09:11:06.100+0000 I SHARDING [conn761] metadata of collection mydomain.Sessions already up to date (shard version : 30624|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:11:06.100+0000 I SHARDING [conn1960] metadata of collection mydomain.Sessions already up to date (shard version : 30624|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:11:10.239+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30624000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:11:10.388+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }) in mydomain.Sessions', ts : 56e52eae2848c4eacbd011ae 2016-03-13T09:11:10.388+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30624|1||563ba74d869758a4542b9075, current metadata version is 30624|1||563ba74d869758a4542b9075 2016-03-13T09:11:10.512+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30624|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:11:10.548+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:10.548+0000-56e52eae2848c4eacbd011af", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860270548), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:11:10.583+0000 I SHARDING [conn152] moveChunk request accepted at version 30624|1||563ba74d869758a4542b9075 2016-03-13T09:11:10.677+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:11:10.732+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:10.735+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:10.739+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:10.752+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:10.792+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:10.853+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:10.934+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:11.076+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:11.339+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:11.852+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:12.907+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:13.940+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:14.992+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:16.017+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1812, clonedBytes: 4113976, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:17.041+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4685, clonedBytes: 13324471, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:18.066+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 17217218, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:18.402+0000 I JOURNAL [journal writer] old journal file will be removed: /data/journal/j._1157 2016-03-13T09:11:19.091+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eae2848c4eacbd011b0", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 17217218, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:19.091+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:11:19.091+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:11:19.091+0000 I SHARDING [conn377] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:19.092+0000 I SHARDING [conn1276] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:19.092+0000 I SHARDING [conn2370] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:19.092+0000 I SHARDING [conn2558] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:19.201+0000 I SHARDING [conn152] moveChunk setting version to: 30625|0||563ba74d869758a4542b9075 2016-03-13T09:11:19.203+0000 I SHARDING [conn912] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:19.204+0000 I SHARDING [conn531] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:19.204+0000 I SHARDING [conn3120] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:19.298+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 17217218, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:11:19.298+0000 I SHARDING [conn152] moveChunk updating self version to: 30625|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') } for collection 'mydomain.Sessions' 2016-03-13T09:11:19.315+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:11:19.044+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:11:19.468+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:19.468+0000-56e52eb72848c4eacbd011b1", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860279468), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, from: "shmydomain1", to: "shmydomain2", cloned: 5388, clonedBytes: 17217218, catchup: 0, steady: 0 } } 2016-03-13T09:11:19.487+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:11:19.489+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:11:19.489+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:19.489+0000-56e52eb72848c4eacbd011b2", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860279489), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, step 1 of 6: 0, step 2 of 6: 343, step 3 of 6: 143, step 4 of 6: 8363, step 5 of 6: 397, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:11:19.692+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:11:19.692+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563434917bc3500e945e8073') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30624000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 6416 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 2 }, timeAcquiringMicros: { R: 54195, W: 5304 } } } protocol:op_command 9453ms 2016-03-13T09:11:20.335+0000 I SHARDING [conn1610] remotely refreshing metadata for mydomain.Sessions with requested shard version 30625|1||563ba74d869758a4542b9075 based on current shard version 30625|0||563ba74d869758a4542b9075, current metadata version is 30625|0||563ba74d869758a4542b9075 2016-03-13T09:11:20.335+0000 I SHARDING [conn258] remotely refreshing metadata for mydomain.Sessions with requested shard version 30625|1||563ba74d869758a4542b9075 based on current shard version 30625|0||563ba74d869758a4542b9075, current metadata version is 30625|0||563ba74d869758a4542b9075 2016-03-13T09:11:20.335+0000 I SHARDING [conn1722] remotely refreshing metadata for mydomain.Sessions with requested shard version 30625|1||563ba74d869758a4542b9075 based on current shard version 30625|0||563ba74d869758a4542b9075, current metadata version is 30625|0||563ba74d869758a4542b9075 2016-03-13T09:11:20.461+0000 I SHARDING [conn258] updating metadata for mydomain.Sessions from shard version 30625|0||563ba74d869758a4542b9075 to shard version 30625|1||563ba74d869758a4542b9075 2016-03-13T09:11:20.461+0000 I SHARDING [conn258] collection version was loaded at version 30625|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T09:11:20.463+0000 I SHARDING [conn1722] metadata of collection mydomain.Sessions already up to date (shard version : 30625|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:11:20.463+0000 I SHARDING [conn1610] metadata of collection mydomain.Sessions already up to date (shard version : 30625|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:11:23.913+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30625000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:11:24.190+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }) in mydomain.Sessions', ts : 56e52ebb2848c4eacbd011b3 2016-03-13T09:11:24.190+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30625|1||563ba74d869758a4542b9075, current metadata version is 30625|1||563ba74d869758a4542b9075 2016-03-13T09:11:24.317+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30625|1||563ba74d869758a4542b9075, took 118ms) 2016-03-13T09:11:24.354+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:24.354+0000-56e52ebc2848c4eacbd011b4", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860284354), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:11:24.386+0000 I SHARDING [conn176] moveChunk request accepted at version 30625|1||563ba74d869758a4542b9075 2016-03-13T09:11:24.494+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:11:24.543+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:24.546+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:24.551+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:24.566+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:24.587+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:24.648+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:24.748+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:24.891+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:25.154+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:25.680+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:26.712+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:27.764+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:28.797+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:29.822+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2801, clonedBytes: 7317965, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:30.847+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16788524, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:31.871+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52ebc2848c4eacbd011b5", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16788524, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:31.871+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:11:31.872+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:11:31.981+0000 I SHARDING [conn176] moveChunk setting version to: 30626|0||563ba74d869758a4542b9075 2016-03-13T09:11:31.984+0000 I SHARDING [conn417] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:31.984+0000 I SHARDING [conn3001] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:31.984+0000 I SHARDING [conn773] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:31.984+0000 I SHARDING [conn806] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:31.984+0000 I SHARDING [conn1715] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:31.984+0000 I SHARDING [conn2783] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:31.984+0000 I SHARDING [conn2657] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:32.016+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16788524, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:11:32.016+0000 I SHARDING [conn176] moveChunk updating self version to: 30626|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') } for collection 'mydomain.Sessions' 2016-03-13T09:11:32.141+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:32.141+0000-56e52ec42848c4eacbd011b6", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860292141), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16788524, catchup: 0, steady: 0 } } 2016-03-13T09:11:32.203+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:11:32.203+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:11:32.203+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:32.203+0000-56e52ec42848c4eacbd011b7", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860292203), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, step 1 of 6: 0, step 2 of 6: 472, step 3 of 6: 155, step 4 of 6: 7329, step 5 of 6: 331, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:11:32.418+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:11:32.418+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563435d855418c0ec3f49c0d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30625000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 2022 } }, MMAPV1Journal: { acquireCount: { r: 86, w: 4 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 6315 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 40, W: 2 }, timeAcquiringMicros: { R: 65560, W: 4126 } } } protocol:op_command 8504ms 2016-03-13T09:11:33.025+0000 I SHARDING [conn3129] remotely refreshing metadata for mydomain.Sessions with requested shard version 30626|1||563ba74d869758a4542b9075 based on current shard version 30626|0||563ba74d869758a4542b9075, current metadata version is 30626|0||563ba74d869758a4542b9075 2016-03-13T09:11:33.025+0000 I SHARDING [conn645] remotely refreshing metadata for mydomain.Sessions with requested shard version 30626|1||563ba74d869758a4542b9075 based on current shard version 30626|0||563ba74d869758a4542b9075, current metadata version is 30626|0||563ba74d869758a4542b9075 2016-03-13T09:11:33.025+0000 I SHARDING [conn964] remotely refreshing metadata for mydomain.Sessions with requested shard version 30626|1||563ba74d869758a4542b9075 based on current shard version 30626|0||563ba74d869758a4542b9075, current metadata version is 30626|0||563ba74d869758a4542b9075 2016-03-13T09:11:33.151+0000 I SHARDING [conn964] updating metadata for mydomain.Sessions from shard version 30626|0||563ba74d869758a4542b9075 to shard version 30626|1||563ba74d869758a4542b9075 2016-03-13T09:11:33.151+0000 I SHARDING [conn645] metadata of collection mydomain.Sessions already up to date (shard version : 30626|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:11:33.152+0000 I SHARDING [conn3129] metadata of collection mydomain.Sessions already up to date (shard version : 30626|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:11:33.152+0000 I SHARDING [conn964] collection version was loaded at version 30626|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:11:36.063+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089320c5ab960e4d3e9a41') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560893e6e5aec60e69cc47d2') } 2016-03-13T09:11:36.345+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560893e6e5aec60e69cc47d2') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560894aac5ab960e4d3eb7b5') }, with opId: 769886319 2016-03-13T09:11:37.466+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30626000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:11:37.764+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }) in mydomain.Sessions', ts : 56e52ec92848c4eacbd011b8 2016-03-13T09:11:37.764+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30626|1||563ba74d869758a4542b9075, current metadata version is 30626|1||563ba74d869758a4542b9075 2016-03-13T09:11:37.886+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30626|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:11:37.921+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:37.921+0000-56e52ec92848c4eacbd011b9", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860297921), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:11:37.958+0000 I SHARDING [conn176] moveChunk request accepted at version 30626|1||563ba74d869758a4542b9075 2016-03-13T09:11:38.067+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:11:38.119+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.124+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.140+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.160+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.200+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.240+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.325+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.463+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:38.746+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:39.272+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:40.305+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:41.337+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:42.368+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:43.393+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 485, clonedBytes: 1191942, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:44.418+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3674, clonedBytes: 10272058, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:45.442+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 17004110, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:46.467+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ec92848c4eacbd011ba", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 17004110, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:46.467+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:11:46.468+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:11:46.469+0000 I SHARDING [conn1345] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:46.469+0000 I SHARDING [conn936] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:46.469+0000 I SHARDING [conn2543] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:46.470+0000 I SHARDING [conn2882] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:46.470+0000 I SHARDING [conn1449] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:46.581+0000 I SHARDING [conn176] moveChunk setting version to: 30627|0||563ba74d869758a4542b9075 2016-03-13T09:11:46.581+0000 I SHARDING [conn1575] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:46.581+0000 I SHARDING [conn679] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:11:46.622+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 17004110, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:11:46.622+0000 I SHARDING [conn176] moveChunk updating self version to: 30627|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') } for collection 'mydomain.Sessions' 2016-03-13T09:11:46.725+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:46.725+0000-56e52ed22848c4eacbd011bb", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860306725), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, from: "shmydomain1", to: "shmydomain2", cloned: 5389, clonedBytes: 17004110, catchup: 0, steady: 0 } } 2016-03-13T09:11:46.758+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:11:46.760+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:11:46.760+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:46.760+0000-56e52ed22848c4eacbd011bc", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860306760), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, step 1 of 6: 0, step 2 of 6: 491, step 3 of 6: 159, step 4 of 6: 8349, step 5 of 6: 292, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:11:47.044+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:11:47.044+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634371a7bc3500e945eb4e6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30626000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 1985 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 70482, W: 3982 } } } protocol:op_command 9578ms 2016-03-13T09:11:47.586+0000 I SHARDING [conn440] remotely refreshing metadata for mydomain.Sessions with requested shard version 30627|1||563ba74d869758a4542b9075 based on current shard version 30627|0||563ba74d869758a4542b9075, current metadata version is 30627|0||563ba74d869758a4542b9075 2016-03-13T09:11:47.606+0000 I SHARDING [conn2749] remotely refreshing metadata for mydomain.Sessions with requested shard version 30627|1||563ba74d869758a4542b9075 based on current shard version 30627|0||563ba74d869758a4542b9075, current metadata version is 30627|0||563ba74d869758a4542b9075 2016-03-13T09:11:47.607+0000 I SHARDING [conn2543] remotely refreshing metadata for mydomain.Sessions with requested shard version 30627|1||563ba74d869758a4542b9075 based on current shard version 30627|0||563ba74d869758a4542b9075, current metadata version is 30627|0||563ba74d869758a4542b9075 2016-03-13T09:11:47.721+0000 I SHARDING [conn2749] updating metadata for mydomain.Sessions from shard version 30627|0||563ba74d869758a4542b9075 to shard version 30627|1||563ba74d869758a4542b9075 2016-03-13T09:11:47.721+0000 I SHARDING [conn2543] metadata of collection mydomain.Sessions already up to date (shard version : 30627|1||563ba74d869758a4542b9075, took 112ms) 2016-03-13T09:11:47.721+0000 I SHARDING [conn2749] collection version was loaded at version 30627|1||563ba74d869758a4542b9075, took 112ms 2016-03-13T09:11:47.722+0000 I SHARDING [conn440] metadata of collection mydomain.Sessions already up to date (shard version : 30627|1||563ba74d869758a4542b9075, took 134ms) 2016-03-13T09:11:51.392+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:11:49.316+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:11:53.141+0000 I NETWORK [initandlisten] connection accepted from 10.0.231.121:46372 #3340 (3058 connections now open) 2016-03-13T09:11:55.966+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30627000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:11:56.254+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }) in mydomain.Sessions', ts : 56e52edb2848c4eacbd011bd 2016-03-13T09:11:56.255+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30627|1||563ba74d869758a4542b9075, current metadata version is 30627|1||563ba74d869758a4542b9075 2016-03-13T09:11:56.388+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30627|1||563ba74d869758a4542b9075, took 132ms) 2016-03-13T09:11:56.425+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:11:56.425+0000-56e52edc2848c4eacbd011be", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860316425), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:11:56.459+0000 I SHARDING [conn176] moveChunk request accepted at version 30627|1||563ba74d869758a4542b9075 2016-03-13T09:11:56.596+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:11:56.648+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:56.668+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:56.688+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:56.708+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:56.729+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:56.769+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:56.870+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:57.012+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:57.275+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:57.801+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:58.833+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:11:59.885+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:00.938+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:01.983+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 703, clonedBytes: 1653198, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:03.008+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4056, clonedBytes: 11146037, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:04.033+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16939002, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:05.057+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52edc2848c4eacbd011bf", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16939002, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:05.057+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:12:05.058+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:12:05.058+0000 I SHARDING [conn2877] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:05.059+0000 I SHARDING [conn1712] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:05.059+0000 I SHARDING [conn1753] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:05.060+0000 I SHARDING [conn766] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:05.171+0000 I SHARDING [conn176] moveChunk setting version to: 30628|0||563ba74d869758a4542b9075 2016-03-13T09:12:05.173+0000 I SHARDING [conn2171] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:05.173+0000 I SHARDING [conn1586] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:05.173+0000 I SHARDING [conn2647] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:05.212+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16939002, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:12:05.212+0000 I SHARDING [conn176] moveChunk updating self version to: 30628|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') } for collection 'mydomain.Sessions' 2016-03-13T09:12:05.303+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:05.303+0000-56e52ee52848c4eacbd011c0", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860325303), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16939002, catchup: 0, steady: 0 } } 2016-03-13T09:12:05.392+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:12:05.396+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:12:05.399+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:05.399+0000-56e52ee52848c4eacbd011c1", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860325399), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, step 1 of 6: 0, step 2 of 6: 493, step 3 of 6: 184, step 4 of 6: 8413, step 5 of 6: 338, step 6 of 6: 2, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:12:05.597+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:12:05.597+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634386555418c0ec5956101') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30627000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4757 } }, MMAPV1Journal: { acquireCount: { r: 87, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 41, W: 2 }, timeAcquiringMicros: { R: 103236, W: 5816 } } } protocol:op_command 9631ms 2016-03-13T09:12:06.165+0000 I SHARDING [conn1712] remotely refreshing metadata for mydomain.Sessions with requested shard version 30628|1||563ba74d869758a4542b9075 based on current shard version 30628|0||563ba74d869758a4542b9075, current metadata version is 30628|0||563ba74d869758a4542b9075 2016-03-13T09:12:06.165+0000 I SHARDING [conn1753] remotely refreshing metadata for mydomain.Sessions with requested shard version 30628|1||563ba74d869758a4542b9075 based on current shard version 30628|0||563ba74d869758a4542b9075, current metadata version is 30628|0||563ba74d869758a4542b9075 2016-03-13T09:12:06.165+0000 I SHARDING [conn2877] remotely refreshing metadata for mydomain.Sessions with requested shard version 30628|1||563ba74d869758a4542b9075 based on current shard version 30628|0||563ba74d869758a4542b9075, current metadata version is 30628|0||563ba74d869758a4542b9075 2016-03-13T09:12:06.286+0000 I SHARDING [conn1753] updating metadata for mydomain.Sessions from shard version 30628|0||563ba74d869758a4542b9075 to shard version 30628|1||563ba74d869758a4542b9075 2016-03-13T09:12:06.286+0000 I SHARDING [conn1753] collection version was loaded at version 30628|1||563ba74d869758a4542b9075, took 119ms 2016-03-13T09:12:06.290+0000 I SHARDING [conn1712] metadata of collection mydomain.Sessions already up to date (shard version : 30628|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:12:06.290+0000 I SHARDING [conn2877] metadata of collection mydomain.Sessions already up to date (shard version : 30628|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:12:06.980+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560893e6e5aec60e69cc47d2') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560894aac5ab960e4d3eb7b5') } 2016-03-13T09:12:07.362+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560894aac5ab960e4d3eb7b5') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608956f584ad1621aee28a8') }, with opId: 769936765 2016-03-13T09:12:10.739+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30628000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:12:10.975+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }) in mydomain.Sessions', ts : 56e52eea2848c4eacbd011c2 2016-03-13T09:12:10.975+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30628|1||563ba74d869758a4542b9075, current metadata version is 30628|1||563ba74d869758a4542b9075 2016-03-13T09:12:11.105+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30628|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:12:11.142+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:11.142+0000-56e52eeb2848c4eacbd011c3", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860331142), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:12:11.164+0000 I SHARDING [conn176] moveChunk request accepted at version 30628|1||563ba74d869758a4542b9075 2016-03-13T09:12:11.266+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:12:11.317+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.322+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.333+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.354+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.394+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.435+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.515+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.657+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:11.920+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:12.446+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:13.478+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:14.521+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:15.553+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:16.578+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 637, clonedBytes: 1582055, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:17.603+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3565, clonedBytes: 10815881, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:18.627+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 17688559, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:19.652+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52eeb2848c4eacbd011c4", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 17688559, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:19.652+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:12:19.653+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:12:19.653+0000 I SHARDING [conn2362] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:19.653+0000 I SHARDING [conn528] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:19.654+0000 I SHARDING [conn813] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:19.657+0000 I SHARDING [conn1039] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:19.766+0000 I SHARDING [conn176] moveChunk setting version to: 30629|0||563ba74d869758a4542b9075 2016-03-13T09:12:19.768+0000 I SHARDING [conn2134] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:19.768+0000 I SHARDING [conn2370] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:19.768+0000 I SHARDING [conn742] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:19.797+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 17688559, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:12:19.797+0000 I SHARDING [conn176] moveChunk updating self version to: 30629|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') } for collection 'mydomain.Sessions' 2016-03-13T09:12:19.997+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:19.997+0000-56e52ef32848c4eacbd011c5", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860339997), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, from: "shmydomain1", to: "shmydomain2", cloned: 5389, clonedBytes: 17688559, catchup: 0, steady: 0 } } 2016-03-13T09:12:20.032+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:12:20.032+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:12:20.034+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:20.034+0000-56e52ef42848c4eacbd011c6", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860340034), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, step 1 of 6: 0, step 2 of 6: 425, step 3 of 6: 151, step 4 of 6: 8336, step 5 of 6: 379, step 6 of 6: 1, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:12:20.280+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:12:20.280+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563439b8584ad10f21336dad') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30628000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 180 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 2 }, timeAcquiringMicros: { R: 72324, W: 9289 } } } protocol:op_command 9541ms 2016-03-13T09:12:20.867+0000 I SHARDING [conn2006] remotely refreshing metadata for mydomain.Sessions with requested shard version 30629|1||563ba74d869758a4542b9075 based on current shard version 30629|0||563ba74d869758a4542b9075, current metadata version is 30629|0||563ba74d869758a4542b9075 2016-03-13T09:12:20.886+0000 I SHARDING [conn2361] remotely refreshing metadata for mydomain.Sessions with requested shard version 30629|1||563ba74d869758a4542b9075 based on current shard version 30629|0||563ba74d869758a4542b9075, current metadata version is 30629|0||563ba74d869758a4542b9075 2016-03-13T09:12:20.886+0000 I SHARDING [conn2801] remotely refreshing metadata for mydomain.Sessions with requested shard version 30629|1||563ba74d869758a4542b9075 based on current shard version 30629|0||563ba74d869758a4542b9075, current metadata version is 30629|0||563ba74d869758a4542b9075 2016-03-13T09:12:21.002+0000 I SHARDING [conn2361] updating metadata for mydomain.Sessions from shard version 30629|0||563ba74d869758a4542b9075 to shard version 30629|1||563ba74d869758a4542b9075 2016-03-13T09:12:21.002+0000 I SHARDING [conn2801] metadata of collection mydomain.Sessions already up to date (shard version : 30629|1||563ba74d869758a4542b9075, took 114ms) 2016-03-13T09:12:21.002+0000 I SHARDING [conn2361] collection version was loaded at version 30629|1||563ba74d869758a4542b9075, took 113ms 2016-03-13T09:12:21.003+0000 I SHARDING [conn2006] metadata of collection mydomain.Sessions already up to date (shard version : 30629|1||563ba74d869758a4542b9075, took 135ms) 2016-03-13T09:12:21.715+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:12:21.392+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:12:25.556+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30629000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:12:25.839+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }) in mydomain.Sessions', ts : 56e52ef92848c4eacbd011c7 2016-03-13T09:12:25.839+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30629|1||563ba74d869758a4542b9075, current metadata version is 30629|1||563ba74d869758a4542b9075 2016-03-13T09:12:25.968+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30629|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:12:26.007+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:26.007+0000-56e52efa2848c4eacbd011c8", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860346007), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:12:26.037+0000 I SHARDING [conn176] moveChunk request accepted at version 30629|1||563ba74d869758a4542b9075 2016-03-13T09:12:26.125+0000 I SHARDING [conn176] moveChunk number of documents: 5388 2016-03-13T09:12:26.175+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.179+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.191+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.211+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.232+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.292+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.373+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.505+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:26.768+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:27.294+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:28.326+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:29.358+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:30.390+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:31.415+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2552, clonedBytes: 5837272, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:32.440+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4183, clonedBytes: 11024053, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:33.465+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16067651, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:34.489+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52efa2848c4eacbd011c9", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16067651, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:34.489+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:12:34.490+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:12:34.491+0000 I SHARDING [conn3017] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:34.491+0000 I SHARDING [conn3129] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:34.491+0000 I SHARDING [conn2294] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:34.602+0000 I SHARDING [conn176] moveChunk setting version to: 30630|0||563ba74d869758a4542b9075 2016-03-13T09:12:34.602+0000 I SHARDING [conn1251] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:34.603+0000 I SHARDING [conn2594] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:34.604+0000 I SHARDING [conn1224] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:34.604+0000 I SHARDING [conn2399] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:34.624+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16067651, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:12:34.624+0000 I SHARDING [conn176] moveChunk updating self version to: 30630|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') } for collection 'mydomain.Sessions' 2016-03-13T09:12:34.763+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:34.763+0000-56e52f022848c4eacbd011ca", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860354763), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16067651, catchup: 0, steady: 0 } } 2016-03-13T09:12:34.794+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:12:34.796+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:12:34.796+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:34.796+0000-56e52f022848c4eacbd011cb", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860354796), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, step 1 of 6: 0, step 2 of 6: 480, step 3 of 6: 135, step 4 of 6: 8316, step 5 of 6: 306, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:12:34.999+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:12:34.999+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343b1455418c0ec3f53019') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30629000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3374 } }, MMAPV1Journal: { acquireCount: { r: 80, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 34, W: 2 }, timeAcquiringMicros: { R: 54534, W: 5170 } } } protocol:op_command 9443ms 2016-03-13T09:12:35.629+0000 I SHARDING [conn2038] remotely refreshing metadata for mydomain.Sessions with requested shard version 30630|1||563ba74d869758a4542b9075 based on current shard version 30630|0||563ba74d869758a4542b9075, current metadata version is 30630|0||563ba74d869758a4542b9075 2016-03-13T09:12:35.657+0000 I SHARDING [conn2598] remotely refreshing metadata for mydomain.Sessions with requested shard version 30630|1||563ba74d869758a4542b9075 based on current shard version 30630|0||563ba74d869758a4542b9075, current metadata version is 30630|0||563ba74d869758a4542b9075 2016-03-13T09:12:35.657+0000 I SHARDING [conn1393] remotely refreshing metadata for mydomain.Sessions with requested shard version 30630|1||563ba74d869758a4542b9075 based on current shard version 30630|0||563ba74d869758a4542b9075, current metadata version is 30630|0||563ba74d869758a4542b9075 2016-03-13T09:12:35.747+0000 I SHARDING [conn2038] updating metadata for mydomain.Sessions from shard version 30630|0||563ba74d869758a4542b9075 to shard version 30630|1||563ba74d869758a4542b9075 2016-03-13T09:12:35.747+0000 I SHARDING [conn2038] collection version was loaded at version 30630|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:12:35.782+0000 I SHARDING [conn2598] metadata of collection mydomain.Sessions already up to date (shard version : 30630|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:12:35.782+0000 I SHARDING [conn1393] metadata of collection mydomain.Sessions already up to date (shard version : 30630|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:12:37.386+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560894aac5ab960e4d3eb7b5') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608956f584ad1621aee28a8') } 2016-03-13T09:12:37.831+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608956f584ad1621aee28a8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896315366dd0e48f713fe') }, with opId: 769985391 2016-03-13T09:12:40.546+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30630000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:12:40.866+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }) in mydomain.Sessions', ts : 56e52f082848c4eacbd011cc 2016-03-13T09:12:40.866+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30630|1||563ba74d869758a4542b9075, current metadata version is 30630|1||563ba74d869758a4542b9075 2016-03-13T09:12:40.994+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30630|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:12:41.029+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:41.029+0000-56e52f092848c4eacbd011cd", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860361029), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:12:41.062+0000 I SHARDING [conn176] moveChunk request accepted at version 30630|1||563ba74d869758a4542b9075 2016-03-13T09:12:41.168+0000 I SHARDING [conn176] moveChunk number of documents: 5390 2016-03-13T09:12:41.223+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.225+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.241+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.260+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.281+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.321+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.402+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.544+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:41.807+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:42.353+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:43.388+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:44.418+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:45.450+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:46.475+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1402, clonedBytes: 3185779, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:47.499+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3408, clonedBytes: 9452904, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:48.524+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 16252361, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:49.549+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 16252361, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:50.574+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f092848c4eacbd011ce", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5390, clonedBytes: 16252361, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:50.574+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:12:50.574+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:12:50.684+0000 I SHARDING [conn176] moveChunk setting version to: 30631|0||563ba74d869758a4542b9075 2016-03-13T09:12:50.684+0000 I SHARDING [conn2486] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:50.686+0000 I SHARDING [conn2546] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:50.687+0000 I SHARDING [conn1856] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:50.687+0000 I SHARDING [conn759] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:50.687+0000 I SHARDING [conn1228] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:50.688+0000 I SHARDING [conn2282] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:50.689+0000 I SHARDING [conn730] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:12:50.717+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5390, clonedBytes: 16252361, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:12:50.717+0000 I SHARDING [conn176] moveChunk updating self version to: 30631|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') } for collection 'mydomain.Sessions' 2016-03-13T09:12:50.840+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:50.839+0000-56e52f122848c4eacbd011cf", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860370839), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, from: "shmydomain1", to: "shmydomain2", cloned: 5390, clonedBytes: 16252361, catchup: 0, steady: 0 } } 2016-03-13T09:12:50.875+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:12:50.876+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:12:50.879+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:50.879+0000-56e52f122848c4eacbd011d0", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860370879), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, step 1 of 6: 0, step 2 of 6: 515, step 3 of 6: 155, step 4 of 6: 9355, step 5 of 6: 302, step 6 of 6: 2, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:12:51.080+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:12:51.080+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343c70a2a4330ea293d314') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30630000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3419 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 38, W: 2 }, timeAcquiringMicros: { R: 67758, W: 2954 } } } protocol:op_command 10534ms 2016-03-13T09:12:51.705+0000 I SHARDING [conn2117] remotely refreshing metadata for mydomain.Sessions with requested shard version 30631|1||563ba74d869758a4542b9075 based on current shard version 30631|0||563ba74d869758a4542b9075, current metadata version is 30631|0||563ba74d869758a4542b9075 2016-03-13T09:12:51.720+0000 I SHARDING [conn1228] remotely refreshing metadata for mydomain.Sessions with requested shard version 30631|1||563ba74d869758a4542b9075 based on current shard version 30631|0||563ba74d869758a4542b9075, current metadata version is 30631|0||563ba74d869758a4542b9075 2016-03-13T09:12:51.720+0000 I SHARDING [conn759] remotely refreshing metadata for mydomain.Sessions with requested shard version 30631|1||563ba74d869758a4542b9075 based on current shard version 30631|0||563ba74d869758a4542b9075, current metadata version is 30631|0||563ba74d869758a4542b9075 2016-03-13T09:12:51.825+0000 I SHARDING [conn2117] updating metadata for mydomain.Sessions from shard version 30631|0||563ba74d869758a4542b9075 to shard version 30631|1||563ba74d869758a4542b9075 2016-03-13T09:12:51.825+0000 I SHARDING [conn2117] collection version was loaded at version 30631|1||563ba74d869758a4542b9075, took 117ms 2016-03-13T09:12:51.844+0000 I SHARDING [conn759] metadata of collection mydomain.Sessions already up to date (shard version : 30631|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:12:51.844+0000 I SHARDING [conn1228] metadata of collection mydomain.Sessions already up to date (shard version : 30631|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:12:52.001+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:12:51.715+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:12:57.115+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30631000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:12:57.390+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }) in mydomain.Sessions', ts : 56e52f192848c4eacbd011d1 2016-03-13T09:12:57.390+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30631|1||563ba74d869758a4542b9075, current metadata version is 30631|1||563ba74d869758a4542b9075 2016-03-13T09:12:57.511+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30631|1||563ba74d869758a4542b9075, took 120ms) 2016-03-13T09:12:57.545+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:12:57.545+0000-56e52f192848c4eacbd011d2", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860377545), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:12:57.581+0000 I SHARDING [conn176] moveChunk request accepted at version 30631|1||563ba74d869758a4542b9075 2016-03-13T09:12:57.680+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:12:57.729+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:57.747+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:57.752+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:57.768+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:57.789+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:57.828+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:57.910+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:58.051+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:58.314+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:58.840+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:12:59.872+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:00.897+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:01.927+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:02.952+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1701, clonedBytes: 3773444, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:03.976+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3349, clonedBytes: 8863663, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:05.001+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 16545051, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:06.026+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f192848c4eacbd011d3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 16545051, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:06.026+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:13:06.026+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:13:06.135+0000 I SHARDING [conn176] moveChunk setting version to: 30632|0||563ba74d869758a4542b9075 2016-03-13T09:13:06.138+0000 I SHARDING [conn938] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:06.138+0000 I SHARDING [conn1567] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:06.138+0000 I SHARDING [conn2629] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:06.139+0000 I SHARDING [conn1654] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:06.139+0000 I SHARDING [conn2974] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:06.139+0000 I SHARDING [conn2226] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:06.139+0000 I SHARDING [conn3021] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:06.171+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 16545051, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:13:06.171+0000 I SHARDING [conn176] moveChunk updating self version to: 30632|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') } for collection 'mydomain.Sessions' 2016-03-13T09:13:06.289+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:06.289+0000-56e52f222848c4eacbd011d4", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860386289), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 16545051, catchup: 0, steady: 0 } } 2016-03-13T09:13:06.321+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:13:06.321+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:13:06.321+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:06.321+0000-56e52f222848c4eacbd011d5", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860386321), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, step 1 of 6: 0, step 2 of 6: 466, step 3 of 6: 147, step 4 of 6: 8297, step 5 of 6: 295, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:13:06.459+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:13:06.459+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343de255418c0ec5960271') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30631000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 711 } }, MMAPV1Journal: { acquireCount: { r: 82, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 36, W: 2 }, timeAcquiringMicros: { R: 65979, W: 1753 } } } protocol:op_command 9344ms 2016-03-13T09:13:07.150+0000 I SHARDING [conn1753] remotely refreshing metadata for mydomain.Sessions with requested shard version 30632|1||563ba74d869758a4542b9075 based on current shard version 30632|0||563ba74d869758a4542b9075, current metadata version is 30632|0||563ba74d869758a4542b9075 2016-03-13T09:13:07.150+0000 I SHARDING [conn3326] remotely refreshing metadata for mydomain.Sessions with requested shard version 30632|1||563ba74d869758a4542b9075 based on current shard version 30632|0||563ba74d869758a4542b9075, current metadata version is 30632|0||563ba74d869758a4542b9075 2016-03-13T09:13:07.152+0000 I SHARDING [conn2049] remotely refreshing metadata for mydomain.Sessions with requested shard version 30632|1||563ba74d869758a4542b9075 based on current shard version 30632|0||563ba74d869758a4542b9075, current metadata version is 30632|0||563ba74d869758a4542b9075 2016-03-13T09:13:07.278+0000 I SHARDING [conn2049] updating metadata for mydomain.Sessions from shard version 30632|0||563ba74d869758a4542b9075 to shard version 30632|1||563ba74d869758a4542b9075 2016-03-13T09:13:07.278+0000 I SHARDING [conn1753] metadata of collection mydomain.Sessions already up to date (shard version : 30632|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:13:07.278+0000 I SHARDING [conn2049] collection version was loaded at version 30632|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T09:13:07.278+0000 I SHARDING [conn3326] metadata of collection mydomain.Sessions already up to date (shard version : 30632|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:13:07.884+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608956f584ad1621aee28a8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896315366dd0e48f713fe') } 2016-03-13T09:13:08.210+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896315366dd0e48f713fe') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896f8584ad16218d31b40') }, with opId: 770034613 2016-03-13T09:13:11.779+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30632000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:13:11.906+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }) in mydomain.Sessions', ts : 56e52f272848c4eacbd011d6 2016-03-13T09:13:11.906+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30632|1||563ba74d869758a4542b9075, current metadata version is 30632|1||563ba74d869758a4542b9075 2016-03-13T09:13:12.029+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30632|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T09:13:12.063+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:12.063+0000-56e52f282848c4eacbd011d7", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860392063), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:13:12.091+0000 I SHARDING [conn176] moveChunk request accepted at version 30632|1||563ba74d869758a4542b9075 2016-03-13T09:13:12.184+0000 I SHARDING [conn176] moveChunk number of documents: 5296 2016-03-13T09:13:12.236+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.239+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.251+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.271+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.291+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.332+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.413+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.554+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:12.818+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:13.343+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:14.376+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:15.428+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:16.453+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:17.478+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1497, clonedBytes: 3078029, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:18.503+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2909, clonedBytes: 7367765, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:19.527+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4339, clonedBytes: 12272891, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:20.552+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5296, clonedBytes: 17719351, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:21.577+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f282848c4eacbd011d8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5296, clonedBytes: 17719351, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:21.577+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:13:21.578+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:13:21.579+0000 I SHARDING [conn850] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:21.687+0000 I SHARDING [conn176] moveChunk setting version to: 30633|0||563ba74d869758a4542b9075 2016-03-13T09:13:21.689+0000 I SHARDING [conn1549] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:21.689+0000 I SHARDING [conn1875] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:21.689+0000 I SHARDING [conn2134] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:21.689+0000 I SHARDING [conn1039] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:21.689+0000 I SHARDING [conn772] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:21.690+0000 I SHARDING [conn1678] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:21.719+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5296, clonedBytes: 17719351, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:13:21.719+0000 I SHARDING [conn176] moveChunk updating self version to: 30633|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') } for collection 'mydomain.Sessions' 2016-03-13T09:13:21.856+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:21.856+0000-56e52f312848c4eacbd011d9", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860401856), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, from: "shmydomain1", to: "shmydomain2", cloned: 5296, clonedBytes: 17719351, catchup: 0, steady: 0 } } 2016-03-13T09:13:21.890+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:13:21.890+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:13:21.890+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:21.890+0000-56e52f312848c4eacbd011da", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860401890), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, step 1 of 6: 0, step 2 of 6: 311, step 3 of 6: 143, step 4 of 6: 9342, step 5 of 6: 312, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:13:22.103+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:13:22.103+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56343f36584ad10f21340232') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30632000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:41 reslen:134 locks:{ Global: { acquireCount: { r: 90, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 946 } }, MMAPV1Journal: { acquireCount: { r: 78, w: 4 } }, Database: { acquireCount: { r: 43, w: 2 } }, Collection: { acquireCount: { R: 43, W: 2 }, acquireWaitCount: { R: 33, W: 2 }, timeAcquiringMicros: { R: 59937, W: 5185 } } } protocol:op_command 10323ms 2016-03-13T09:13:22.277+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:13:22.002+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:13:22.718+0000 I SHARDING [conn1959] remotely refreshing metadata for mydomain.Sessions with requested shard version 30633|1||563ba74d869758a4542b9075 based on current shard version 30633|0||563ba74d869758a4542b9075, current metadata version is 30633|0||563ba74d869758a4542b9075 2016-03-13T09:13:22.718+0000 I SHARDING [conn1714] remotely refreshing metadata for mydomain.Sessions with requested shard version 30633|1||563ba74d869758a4542b9075 based on current shard version 30633|0||563ba74d869758a4542b9075, current metadata version is 30633|0||563ba74d869758a4542b9075 2016-03-13T09:13:22.720+0000 I SHARDING [conn1628] remotely refreshing metadata for mydomain.Sessions with requested shard version 30633|1||563ba74d869758a4542b9075 based on current shard version 30633|0||563ba74d869758a4542b9075, current metadata version is 30633|0||563ba74d869758a4542b9075 2016-03-13T09:13:22.844+0000 I SHARDING [conn1628] updating metadata for mydomain.Sessions from shard version 30633|0||563ba74d869758a4542b9075 to shard version 30633|1||563ba74d869758a4542b9075 2016-03-13T09:13:22.844+0000 I SHARDING [conn1959] metadata of collection mydomain.Sessions already up to date (shard version : 30633|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:13:22.844+0000 I SHARDING [conn1714] metadata of collection mydomain.Sessions already up to date (shard version : 30633|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:13:22.844+0000 I SHARDING [conn1628] collection version was loaded at version 30633|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T09:13:27.428+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30633000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:13:27.639+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }) in mydomain.Sessions', ts : 56e52f372848c4eacbd011db 2016-03-13T09:13:27.639+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30633|1||563ba74d869758a4542b9075, current metadata version is 30633|1||563ba74d869758a4542b9075 2016-03-13T09:13:27.767+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30633|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:13:27.805+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:27.805+0000-56e52f372848c4eacbd011dc", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860407805), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:13:27.823+0000 I SHARDING [conn176] moveChunk request accepted at version 30633|1||563ba74d869758a4542b9075 2016-03-13T09:13:27.925+0000 I SHARDING [conn176] moveChunk number of documents: 5388 2016-03-13T09:13:27.975+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:27.978+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:27.999+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:28.018+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:28.039+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:28.119+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:28.201+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:28.362+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:28.626+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:29.172+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:30.204+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:31.237+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:32.268+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:33.293+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1890, clonedBytes: 3939019, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:34.318+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3309, clonedBytes: 9136006, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:35.343+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16530533, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:36.367+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f372848c4eacbd011dd", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16530533, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:36.367+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:13:36.368+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:13:36.368+0000 I SHARDING [conn267] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:36.368+0000 I SHARDING [conn2277] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:36.369+0000 I SHARDING [conn1849] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:36.369+0000 I SHARDING [conn918] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:36.370+0000 I SHARDING [conn2660] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:36.477+0000 I SHARDING [conn176] moveChunk setting version to: 30634|0||563ba74d869758a4542b9075 2016-03-13T09:13:36.479+0000 I SHARDING [conn886] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:36.479+0000 I SHARDING [conn406] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:36.521+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16530533, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:13:36.521+0000 I SHARDING [conn176] moveChunk updating self version to: 30634|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') } for collection 'mydomain.Sessions' 2016-03-13T09:13:36.617+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:36.617+0000-56e52f402848c4eacbd011de", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860416617), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 16530533, catchup: 0, steady: 0 } } 2016-03-13T09:13:36.650+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:13:36.654+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:13:36.654+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:36.654+0000-56e52f402848c4eacbd011df", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860416654), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, step 1 of 6: 0, step 2 of 6: 394, step 3 of 6: 149, step 4 of 6: 8394, step 5 of 6: 286, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:13:36.856+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:13:36.856+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563440a555418c0ec3f5d0e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30633000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 5790 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 2 }, timeAcquiringMicros: { R: 64020, W: 3618 } } } protocol:op_command 9427ms 2016-03-13T09:13:37.478+0000 I SHARDING [conn2188] remotely refreshing metadata for mydomain.Sessions with requested shard version 30634|1||563ba74d869758a4542b9075 based on current shard version 30634|0||563ba74d869758a4542b9075, current metadata version is 30634|0||563ba74d869758a4542b9075 2016-03-13T09:13:37.478+0000 I SHARDING [conn1849] remotely refreshing metadata for mydomain.Sessions with requested shard version 30634|1||563ba74d869758a4542b9075 based on current shard version 30634|0||563ba74d869758a4542b9075, current metadata version is 30634|0||563ba74d869758a4542b9075 2016-03-13T09:13:37.478+0000 I SHARDING [conn296] remotely refreshing metadata for mydomain.Sessions with requested shard version 30634|1||563ba74d869758a4542b9075 based on current shard version 30634|0||563ba74d869758a4542b9075, current metadata version is 30634|0||563ba74d869758a4542b9075 2016-03-13T09:13:37.597+0000 I SHARDING [conn1849] updating metadata for mydomain.Sessions from shard version 30634|0||563ba74d869758a4542b9075 to shard version 30634|1||563ba74d869758a4542b9075 2016-03-13T09:13:37.597+0000 I SHARDING [conn1849] collection version was loaded at version 30634|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:13:37.602+0000 I SHARDING [conn296] metadata of collection mydomain.Sessions already up to date (shard version : 30634|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:13:37.602+0000 I SHARDING [conn2188] metadata of collection mydomain.Sessions already up to date (shard version : 30634|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:13:37.875+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896315366dd0e48f713fe') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896f8584ad16218d31b40') } 2016-03-13T09:13:38.372+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896f8584ad16218d31b40') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560897bd584ad16218d32805') }, with opId: 770083388 2016-03-13T09:13:41.979+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30634000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:13:42.254+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }) in mydomain.Sessions', ts : 56e52f452848c4eacbd011e0 2016-03-13T09:13:42.254+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30634|1||563ba74d869758a4542b9075, current metadata version is 30634|1||563ba74d869758a4542b9075 2016-03-13T09:13:42.386+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30634|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:13:42.422+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:42.422+0000-56e52f462848c4eacbd011e1", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860422422), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:13:42.458+0000 I SHARDING [conn176] moveChunk request accepted at version 30634|1||563ba74d869758a4542b9075 2016-03-13T09:13:42.568+0000 I SHARDING [conn176] moveChunk number of documents: 5388 2016-03-13T09:13:42.619+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:42.625+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:42.629+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:42.643+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:42.663+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:42.724+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:42.806+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:42.947+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:43.210+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:43.736+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:44.768+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:45.800+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:46.834+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:47.859+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 961, clonedBytes: 1949020, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:48.884+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4164, clonedBytes: 11207480, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:49.909+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5049, clonedBytes: 14183895, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:50.933+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16641136, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:51.958+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f462848c4eacbd011e2", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16641136, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:13:51.958+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:13:51.959+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:13:52.077+0000 I SHARDING [conn176] moveChunk setting version to: 30635|0||563ba74d869758a4542b9075 2016-03-13T09:13:52.079+0000 I SHARDING [conn1856] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:52.079+0000 I SHARDING [conn730] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:52.080+0000 I SHARDING [conn1575] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:52.081+0000 I SHARDING [conn2388] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:52.081+0000 I SHARDING [conn1104] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:52.081+0000 I SHARDING [conn638] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:52.081+0000 I SHARDING [conn384] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:13:52.118+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16641136, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:13:52.118+0000 I SHARDING [conn176] moveChunk updating self version to: 30635|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') } for collection 'mydomain.Sessions' 2016-03-13T09:13:52.255+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:52.255+0000-56e52f502848c4eacbd011e3", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860432255), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, from: "shmydomain1", to: "shmydomain2", cloned: 5388, clonedBytes: 16641136, catchup: 0, steady: 0 } } 2016-03-13T09:13:52.288+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:13:52.292+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:13:52.292+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:52.292+0000-56e52f502848c4eacbd011e4", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860432292), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, step 1 of 6: 0, step 2 of 6: 478, step 3 of 6: 160, step 4 of 6: 9340, step 5 of 6: 333, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:13:52.510+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:13:52.510+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:13:52.277+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:13:52.510+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344228a2a4330ea2946fcc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30634000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 5648 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 3 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 2048 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 1 }, timeAcquiringMicros: { R: 77458, W: 965 } } } protocol:op_command 10531ms 2016-03-13T09:13:53.118+0000 I SHARDING [conn1575] remotely refreshing metadata for mydomain.Sessions with requested shard version 30635|1||563ba74d869758a4542b9075 based on current shard version 30635|0||563ba74d869758a4542b9075, current metadata version is 30635|0||563ba74d869758a4542b9075 2016-03-13T09:13:53.118+0000 I SHARDING [conn727] remotely refreshing metadata for mydomain.Sessions with requested shard version 30635|1||563ba74d869758a4542b9075 based on current shard version 30635|0||563ba74d869758a4542b9075, current metadata version is 30635|0||563ba74d869758a4542b9075 2016-03-13T09:13:53.118+0000 I SHARDING [conn2178] remotely refreshing metadata for mydomain.Sessions with requested shard version 30635|1||563ba74d869758a4542b9075 based on current shard version 30635|0||563ba74d869758a4542b9075, current metadata version is 30635|0||563ba74d869758a4542b9075 2016-03-13T09:13:53.248+0000 I SHARDING [conn1575] updating metadata for mydomain.Sessions from shard version 30635|0||563ba74d869758a4542b9075 to shard version 30635|1||563ba74d869758a4542b9075 2016-03-13T09:13:53.248+0000 I SHARDING [conn2178] metadata of collection mydomain.Sessions already up to date (shard version : 30635|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:13:53.248+0000 I SHARDING [conn727] metadata of collection mydomain.Sessions already up to date (shard version : 30635|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:13:53.248+0000 I SHARDING [conn1575] collection version was loaded at version 30635|1||563ba74d869758a4542b9075, took 127ms 2016-03-13T09:13:57.857+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30635000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:13:59.544+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }) in mydomain.Sessions', ts : 56e52f552848c4eacbd011e5 2016-03-13T09:13:59.544+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30635|1||563ba74d869758a4542b9075, current metadata version is 30635|1||563ba74d869758a4542b9075 2016-03-13T09:13:59.669+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30635|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:13:59.706+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:13:59.706+0000-56e52f572848c4eacbd011e6", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860439706), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:14:00.927+0000 I SHARDING [conn176] moveChunk request accepted at version 30635|1||563ba74d869758a4542b9075 2016-03-13T09:14:01.025+0000 I SHARDING [conn176] moveChunk number of documents: 5391 2016-03-13T09:14:01.075+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.077+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.094+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.115+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.154+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.195+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.276+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.417+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:01.701+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:02.247+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:03.280+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:04.311+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:05.344+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:06.389+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2639, clonedBytes: 6371703, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:07.419+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5351, clonedBytes: 16743233, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:08.444+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5391, clonedBytes: 17538632, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:09.158+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560896f8584ad16218d31b40') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560897bd584ad16218d32805') } 2016-03-13T09:14:09.299+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560897bd584ad16218d32805') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089884584ad1621aee5e1c') }, with opId: 770136084 2016-03-13T09:14:09.469+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f582848c4eacbd011e7", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5391, clonedBytes: 17538632, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:09.469+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:14:09.469+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:14:09.469+0000 I SHARDING [conn1367] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:09.470+0000 I SHARDING [conn2803] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:09.470+0000 I SHARDING [conn1821] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:09.470+0000 I SHARDING [conn2430] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:09.578+0000 I SHARDING [conn176] moveChunk setting version to: 30636|0||563ba74d869758a4542b9075 2016-03-13T09:14:09.580+0000 I SHARDING [conn1753] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:09.584+0000 I SHARDING [conn1854] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:09.584+0000 I SHARDING [conn266] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:09.620+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5391, clonedBytes: 17538632, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:14:09.620+0000 I SHARDING [conn176] moveChunk updating self version to: 30636|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') } for collection 'mydomain.Sessions' 2016-03-13T09:14:09.743+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:09.743+0000-56e52f612848c4eacbd011e8", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860449743), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, from: "shmydomain1", to: "shmydomain3", cloned: 5391, clonedBytes: 17538632, catchup: 0, steady: 0 } } 2016-03-13T09:14:09.777+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:14:09.779+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:14:09.779+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:09.779+0000-56e52f612848c4eacbd011e9", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860449779), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, step 1 of 6: 0, step 2 of 6: 3070, step 3 of 6: 145, step 4 of 6: 8395, step 5 of 6: 309, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:14:10.042+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:14:10.042+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563443b6a2a4330ea29499ae') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30635000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3146 } }, MMAPV1Journal: { acquireCount: { r: 79, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 33, W: 2 }, timeAcquiringMicros: { R: 65423, W: 3384 } } } protocol:op_command 12185ms 2016-03-13T09:14:10.641+0000 I SHARDING [conn2273] remotely refreshing metadata for mydomain.Sessions with requested shard version 30636|1||563ba74d869758a4542b9075 based on current shard version 30636|0||563ba74d869758a4542b9075, current metadata version is 30636|0||563ba74d869758a4542b9075 2016-03-13T09:14:10.641+0000 I SHARDING [conn2825] remotely refreshing metadata for mydomain.Sessions with requested shard version 30636|1||563ba74d869758a4542b9075 based on current shard version 30636|0||563ba74d869758a4542b9075, current metadata version is 30636|0||563ba74d869758a4542b9075 2016-03-13T09:14:10.641+0000 I SHARDING [conn688] remotely refreshing metadata for mydomain.Sessions with requested shard version 30636|1||563ba74d869758a4542b9075 based on current shard version 30636|0||563ba74d869758a4542b9075, current metadata version is 30636|0||563ba74d869758a4542b9075 2016-03-13T09:14:10.761+0000 I SHARDING [conn2825] updating metadata for mydomain.Sessions from shard version 30636|0||563ba74d869758a4542b9075 to shard version 30636|1||563ba74d869758a4542b9075 2016-03-13T09:14:10.761+0000 I SHARDING [conn2825] collection version was loaded at version 30636|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:14:10.767+0000 I SHARDING [conn688] metadata of collection mydomain.Sessions already up to date (shard version : 30636|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:14:10.767+0000 I SHARDING [conn2273] metadata of collection mydomain.Sessions already up to date (shard version : 30636|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:14:15.699+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30636000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:14:15.864+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }) in mydomain.Sessions', ts : 56e52f672848c4eacbd011ea 2016-03-13T09:14:15.865+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30636|1||563ba74d869758a4542b9075, current metadata version is 30636|1||563ba74d869758a4542b9075 2016-03-13T09:14:16.029+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30636|1||563ba74d869758a4542b9075, took 153ms) 2016-03-13T09:14:16.070+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:16.070+0000-56e52f682848c4eacbd011eb", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860456070), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:14:16.103+0000 I SHARDING [conn176] moveChunk request accepted at version 30636|1||563ba74d869758a4542b9075 2016-03-13T09:14:16.236+0000 I SHARDING [conn176] moveChunk number of documents: 5391 2016-03-13T09:14:16.298+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.303+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.316+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.336+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.356+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.398+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.481+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.619+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:16.882+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:17.410+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:18.441+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:19.472+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:20.504+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:21.529+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1799, clonedBytes: 4364066, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:22.554+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4526, clonedBytes: 13716868, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:22.790+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:14:22.510+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:14:23.579+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5391, clonedBytes: 17410928, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:24.603+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f682848c4eacbd011ec", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5391, clonedBytes: 17410928, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:24.603+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:14:24.604+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:14:24.604+0000 I SHARDING [conn3005] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:24.606+0000 I SHARDING [conn769] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:24.606+0000 I SHARDING [conn1936] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:24.714+0000 I SHARDING [conn176] moveChunk setting version to: 30637|0||563ba74d869758a4542b9075 2016-03-13T09:14:24.716+0000 I SHARDING [conn2326] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:24.717+0000 I SHARDING [conn2233] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:24.718+0000 I SHARDING [conn2008] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:24.718+0000 I SHARDING [conn2658] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:24.752+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5391, clonedBytes: 17410928, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:14:24.752+0000 I SHARDING [conn176] moveChunk updating self version to: 30637|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') } for collection 'mydomain.Sessions' 2016-03-13T09:14:24.879+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:24.879+0000-56e52f702848c4eacbd011ed", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860464879), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, from: "shmydomain1", to: "shmydomain2", cloned: 5391, clonedBytes: 17410928, catchup: 0, steady: 0 } } 2016-03-13T09:14:24.922+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:14:24.952+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:14:24.953+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:24.953+0000-56e52f702848c4eacbd011ee", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860464953), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, step 1 of 6: 0, step 2 of 6: 403, step 3 of 6: 193, step 4 of 6: 8306, step 5 of 6: 348, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:14:25.196+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:14:25.196+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634454855418c0ec3f64c1c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30636000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 32355 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 2 }, timeAcquiringMicros: { R: 89911, W: 13450 } } } protocol:op_command 9497ms 2016-03-13T09:14:25.742+0000 I SHARDING [conn1823] remotely refreshing metadata for mydomain.Sessions with requested shard version 30637|1||563ba74d869758a4542b9075 based on current shard version 30637|0||563ba74d869758a4542b9075, current metadata version is 30637|0||563ba74d869758a4542b9075 2016-03-13T09:14:25.742+0000 I SHARDING [conn2063] remotely refreshing metadata for mydomain.Sessions with requested shard version 30637|1||563ba74d869758a4542b9075 based on current shard version 30637|0||563ba74d869758a4542b9075, current metadata version is 30637|0||563ba74d869758a4542b9075 2016-03-13T09:14:25.744+0000 I SHARDING [conn3137] remotely refreshing metadata for mydomain.Sessions with requested shard version 30637|1||563ba74d869758a4542b9075 based on current shard version 30637|0||563ba74d869758a4542b9075, current metadata version is 30637|0||563ba74d869758a4542b9075 2016-03-13T09:14:25.869+0000 I SHARDING [conn1823] updating metadata for mydomain.Sessions from shard version 30637|0||563ba74d869758a4542b9075 to shard version 30637|1||563ba74d869758a4542b9075 2016-03-13T09:14:25.869+0000 I SHARDING [conn2063] metadata of collection mydomain.Sessions already up to date (shard version : 30637|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:14:25.869+0000 I SHARDING [conn3137] metadata of collection mydomain.Sessions already up to date (shard version : 30637|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:14:25.869+0000 I SHARDING [conn1823] collection version was loaded at version 30637|1||563ba74d869758a4542b9075, took 123ms 2016-03-13T09:14:29.332+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30637000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:14:29.484+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }) in mydomain.Sessions', ts : 56e52f752848c4eacbd011ef 2016-03-13T09:14:29.484+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30637|1||563ba74d869758a4542b9075, current metadata version is 30637|1||563ba74d869758a4542b9075 2016-03-13T09:14:29.610+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30637|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:14:29.648+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:29.648+0000-56e52f752848c4eacbd011f0", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860469648), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:14:29.673+0000 I SHARDING [conn152] moveChunk request accepted at version 30637|1||563ba74d869758a4542b9075 2016-03-13T09:14:29.774+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:14:29.847+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:29.867+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:29.888+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:29.907+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:29.948+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:29.989+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:30.069+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:30.211+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:30.475+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:31.000+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:32.032+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:33.064+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:34.096+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:35.121+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2661, clonedBytes: 7056778, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:36.146+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 17221947, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:37.171+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f752848c4eacbd011f1", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 17221947, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:37.171+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:14:37.171+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:14:37.283+0000 I SHARDING [conn152] moveChunk setting version to: 30638|0||563ba74d869758a4542b9075 2016-03-13T09:14:37.285+0000 I SHARDING [conn1548] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:37.285+0000 I SHARDING [conn545] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:37.288+0000 I SHARDING [conn1162] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:37.288+0000 I SHARDING [conn1215] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:37.289+0000 I SHARDING [conn959] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:37.289+0000 I SHARDING [conn754] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:37.289+0000 I SHARDING [conn2499] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:37.321+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 17221947, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:14:37.321+0000 I SHARDING [conn152] moveChunk updating self version to: 30638|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') } for collection 'mydomain.Sessions' 2016-03-13T09:14:37.493+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:37.493+0000-56e52f7d2848c4eacbd011f2", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860477493), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, from: "shmydomain1", to: "shmydomain3", cloned: 5388, clonedBytes: 17221947, catchup: 0, steady: 0 } } 2016-03-13T09:14:37.528+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:14:37.528+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:14:37.529+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:37.529+0000-56e52f7d2848c4eacbd011f3", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860477529), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, step 1 of 6: 0, step 2 of 6: 340, step 3 of 6: 149, step 4 of 6: 7347, step 5 of 6: 357, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:14:37.736+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:14:37.736+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563446f855418c0ec3f67ffc') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30637000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2558 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 2 }, timeAcquiringMicros: { R: 66031, W: 4186 } } } protocol:op_command 8404ms 2016-03-13T09:14:38.355+0000 I SHARDING [conn1849] remotely refreshing metadata for mydomain.Sessions with requested shard version 30638|1||563ba74d869758a4542b9075 based on current shard version 30638|0||563ba74d869758a4542b9075, current metadata version is 30638|0||563ba74d869758a4542b9075 2016-03-13T09:14:38.356+0000 I SHARDING [conn1947] remotely refreshing metadata for mydomain.Sessions with requested shard version 30638|1||563ba74d869758a4542b9075 based on current shard version 30638|0||563ba74d869758a4542b9075, current metadata version is 30638|0||563ba74d869758a4542b9075 2016-03-13T09:14:38.356+0000 I SHARDING [conn1975] remotely refreshing metadata for mydomain.Sessions with requested shard version 30638|1||563ba74d869758a4542b9075 based on current shard version 30638|0||563ba74d869758a4542b9075, current metadata version is 30638|0||563ba74d869758a4542b9075 2016-03-13T09:14:38.482+0000 I SHARDING [conn1975] updating metadata for mydomain.Sessions from shard version 30638|0||563ba74d869758a4542b9075 to shard version 30638|1||563ba74d869758a4542b9075 2016-03-13T09:14:38.482+0000 I SHARDING [conn1849] metadata of collection mydomain.Sessions already up to date (shard version : 30638|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:14:38.482+0000 I SHARDING [conn1947] metadata of collection mydomain.Sessions already up to date (shard version : 30638|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:14:38.482+0000 I SHARDING [conn1975] collection version was loaded at version 30638|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:14:39.171+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560897bd584ad16218d32805') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089884584ad1621aee5e1c') } 2016-03-13T09:14:39.672+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089884584ad1621aee5e1c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560899482a8aa33e057c0bf7') }, with opId: 770183632 2016-03-13T09:14:42.590+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30638000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:14:42.876+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }) in mydomain.Sessions', ts : 56e52f822848c4eacbd011f4 2016-03-13T09:14:42.876+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30638|1||563ba74d869758a4542b9075, current metadata version is 30638|1||563ba74d869758a4542b9075 2016-03-13T09:14:43.008+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30638|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T09:14:43.044+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:43.044+0000-56e52f832848c4eacbd011f5", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860483044), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:14:43.080+0000 I SHARDING [conn152] moveChunk request accepted at version 30638|1||563ba74d869758a4542b9075 2016-03-13T09:14:43.175+0000 I SHARDING [conn152] moveChunk number of documents: 5388 2016-03-13T09:14:43.227+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.231+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.246+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.267+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.287+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.327+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.408+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.549+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:43.812+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:44.339+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:45.372+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:46.403+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:47.475+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:48.500+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2513, clonedBytes: 5868257, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:49.525+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5334, clonedBytes: 16179367, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:50.549+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 16992882, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:51.574+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f832848c4eacbd011f6", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 16992882, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:51.574+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:14:51.575+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:14:51.686+0000 I SHARDING [conn152] moveChunk setting version to: 30639|0||563ba74d869758a4542b9075 2016-03-13T09:14:51.688+0000 I SHARDING [conn2340] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:51.688+0000 I SHARDING [conn793] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:51.689+0000 I SHARDING [conn151] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:51.691+0000 I SHARDING [conn2475] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:51.691+0000 I SHARDING [conn275] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:51.691+0000 I SHARDING [conn957] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:51.691+0000 I SHARDING [conn2742] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:14:51.723+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 16992882, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:14:51.723+0000 I SHARDING [conn152] moveChunk updating self version to: 30639|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') } for collection 'mydomain.Sessions' 2016-03-13T09:14:51.861+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:51.861+0000-56e52f8b2848c4eacbd011f7", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860491861), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, from: "shmydomain1", to: "shmydomain2", cloned: 5388, clonedBytes: 16992882, catchup: 0, steady: 0 } } 2016-03-13T09:14:51.897+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:14:51.899+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:14:51.899+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:51.899+0000-56e52f8b2848c4eacbd011f8", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860491899), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, step 1 of 6: 0, step 2 of 6: 490, step 3 of 6: 145, step 4 of 6: 8348, step 5 of 6: 325, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:14:52.143+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:14:52.143+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('563448a3a2a4330ea420ec84') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30638000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 7144 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 2 }, timeAcquiringMicros: { R: 61048, W: 5846 } } } protocol:op_command 9553ms 2016-03-13T09:14:52.729+0000 I SHARDING [conn1595] remotely refreshing metadata for mydomain.Sessions with requested shard version 30639|1||563ba74d869758a4542b9075 based on current shard version 30639|0||563ba74d869758a4542b9075, current metadata version is 30639|0||563ba74d869758a4542b9075 2016-03-13T09:14:52.729+0000 I SHARDING [conn384] remotely refreshing metadata for mydomain.Sessions with requested shard version 30639|1||563ba74d869758a4542b9075 based on current shard version 30639|0||563ba74d869758a4542b9075, current metadata version is 30639|0||563ba74d869758a4542b9075 2016-03-13T09:14:52.729+0000 I SHARDING [conn1526] remotely refreshing metadata for mydomain.Sessions with requested shard version 30639|1||563ba74d869758a4542b9075 based on current shard version 30639|0||563ba74d869758a4542b9075, current metadata version is 30639|0||563ba74d869758a4542b9075 2016-03-13T09:14:52.858+0000 I SHARDING [conn384] updating metadata for mydomain.Sessions from shard version 30639|0||563ba74d869758a4542b9075 to shard version 30639|1||563ba74d869758a4542b9075 2016-03-13T09:14:52.858+0000 I SHARDING [conn1595] metadata of collection mydomain.Sessions already up to date (shard version : 30639|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:14:52.858+0000 I SHARDING [conn1526] metadata of collection mydomain.Sessions already up to date (shard version : 30639|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:14:52.858+0000 I SHARDING [conn384] collection version was loaded at version 30639|1||563ba74d869758a4542b9075, took 128ms 2016-03-13T09:14:53.052+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:14:52.790+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:14:56.945+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30639000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:14:57.224+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }) in mydomain.Sessions', ts : 56e52f902848c4eacbd011f9 2016-03-13T09:14:57.224+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30639|1||563ba74d869758a4542b9075, current metadata version is 30639|1||563ba74d869758a4542b9075 2016-03-13T09:14:57.348+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30639|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T09:14:57.383+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:14:57.382+0000-56e52f912848c4eacbd011fa", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860497382), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:14:57.417+0000 I SHARDING [conn152] moveChunk request accepted at version 30639|1||563ba74d869758a4542b9075 2016-03-13T09:14:57.512+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:14:57.564+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:57.567+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:57.576+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:57.617+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:57.637+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:57.698+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:57.781+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:57.921+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:58.207+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:58.730+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:14:59.783+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:00.815+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:01.847+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:02.872+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1315, clonedBytes: 2842931, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:03.897+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4632, clonedBytes: 12229527, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:04.922+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 17437861, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:05.946+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52f912848c4eacbd011fb", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 17437861, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:05.946+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:15:05.947+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:15:05.949+0000 I SHARDING [conn712] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:05.949+0000 I SHARDING [conn1874] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:06.058+0000 I SHARDING [conn152] moveChunk setting version to: 30640|0||563ba74d869758a4542b9075 2016-03-13T09:15:06.059+0000 I SHARDING [conn271] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:06.060+0000 I SHARDING [conn2090] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:06.060+0000 I SHARDING [conn1037] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:06.060+0000 I SHARDING [conn610] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:06.061+0000 I SHARDING [conn2563] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:06.093+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 17437861, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:15:06.093+0000 I SHARDING [conn152] moveChunk updating self version to: 30640|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') } for collection 'mydomain.Sessions' 2016-03-13T09:15:06.206+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:06.206+0000-56e52f9a2848c4eacbd011fc", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860506206), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 17437861, catchup: 0, steady: 0 } } 2016-03-13T09:15:06.240+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:15:06.240+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:15:06.240+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:06.240+0000-56e52f9a2848c4eacbd011fd", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860506240), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, step 1 of 6: 0, step 2 of 6: 471, step 3 of 6: 143, step 4 of 6: 8386, step 5 of 6: 293, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:15:06.451+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:15:06.451+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344a6a584ad10f2135352d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30639000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 1166 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 2 }, timeAcquiringMicros: { R: 66959, W: 6903 } } } protocol:op_command 9506ms 2016-03-13T09:15:07.067+0000 I SHARDING [conn1712] remotely refreshing metadata for mydomain.Sessions with requested shard version 30640|1||563ba74d869758a4542b9075 based on current shard version 30640|0||563ba74d869758a4542b9075, current metadata version is 30640|0||563ba74d869758a4542b9075 2016-03-13T09:15:07.067+0000 I SHARDING [conn2226] remotely refreshing metadata for mydomain.Sessions with requested shard version 30640|1||563ba74d869758a4542b9075 based on current shard version 30640|0||563ba74d869758a4542b9075, current metadata version is 30640|0||563ba74d869758a4542b9075 2016-03-13T09:15:07.067+0000 I SHARDING [conn435] remotely refreshing metadata for mydomain.Sessions with requested shard version 30640|1||563ba74d869758a4542b9075 based on current shard version 30640|0||563ba74d869758a4542b9075, current metadata version is 30640|0||563ba74d869758a4542b9075 2016-03-13T09:15:07.198+0000 I SHARDING [conn435] updating metadata for mydomain.Sessions from shard version 30640|0||563ba74d869758a4542b9075 to shard version 30640|1||563ba74d869758a4542b9075 2016-03-13T09:15:07.198+0000 I SHARDING [conn2226] metadata of collection mydomain.Sessions already up to date (shard version : 30640|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:15:07.198+0000 I SHARDING [conn435] collection version was loaded at version 30640|1||563ba74d869758a4542b9075, took 127ms 2016-03-13T09:15:07.198+0000 I SHARDING [conn1712] metadata of collection mydomain.Sessions already up to date (shard version : 30640|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:15:10.433+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089884584ad1621aee5e1c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560899482a8aa33e057c0bf7') } 2016-03-13T09:15:10.587+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30640000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:15:10.740+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }) in mydomain.Sessions', ts : 56e52f9e2848c4eacbd011fe 2016-03-13T09:15:10.740+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30640|1||563ba74d869758a4542b9075, current metadata version is 30640|1||563ba74d869758a4542b9075 2016-03-13T09:15:10.835+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560899482a8aa33e057c0bf7') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089a10e5aec60e69ccbae5') }, with opId: 770233363 2016-03-13T09:15:10.867+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30640|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:15:10.904+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:10.904+0000-56e52f9e2848c4eacbd011ff", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860510904), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:15:10.921+0000 I SHARDING [conn176] moveChunk request accepted at version 30640|1||563ba74d869758a4542b9075 2016-03-13T09:15:11.015+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:15:11.070+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.088+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.108+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.128+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.189+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.230+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.310+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.452+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:11.715+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:12.242+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:13.274+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:14.306+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:15.339+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:16.365+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1699, clonedBytes: 3781261, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:17.390+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5148, clonedBytes: 14849485, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:18.415+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 17389134, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:19.439+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52f9e2848c4eacbd01200", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 17389134, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:19.439+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:15:19.440+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:15:19.440+0000 I SHARDING [conn398] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:19.441+0000 I SHARDING [conn2124] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:19.441+0000 I SHARDING [conn2502] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:19.442+0000 I SHARDING [conn1531] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:19.442+0000 I SHARDING [conn1387] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:19.443+0000 I SHARDING [conn1779] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:19.551+0000 I SHARDING [conn176] moveChunk setting version to: 30641|0||563ba74d869758a4542b9075 2016-03-13T09:15:19.551+0000 I SHARDING [conn2716] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:19.583+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 17389134, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:15:19.583+0000 I SHARDING [conn176] moveChunk updating self version to: 30641|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') } for collection 'mydomain.Sessions' 2016-03-13T09:15:19.717+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:19.717+0000-56e52fa72848c4eacbd01201", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860519717), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, from: "shmydomain1", to: "shmydomain2", cloned: 5389, clonedBytes: 17389134, catchup: 0, steady: 0 } } 2016-03-13T09:15:19.752+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:15:19.754+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:15:19.756+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:19.756+0000-56e52fa72848c4eacbd01202", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860519756), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, step 1 of 6: 0, step 2 of 6: 333, step 3 of 6: 144, step 4 of 6: 8373, step 5 of 6: 314, step 6 of 6: 2, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:15:19.958+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:15:19.958+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344c42a2a4330ea29576e8') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30640000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 2219 } }, MMAPV1Journal: { acquireCount: { r: 83, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 37, W: 2 }, timeAcquiringMicros: { R: 68787, W: 4308 } } } protocol:op_command 9379ms 2016-03-13T09:15:20.579+0000 I SHARDING [conn398] remotely refreshing metadata for mydomain.Sessions with requested shard version 30641|1||563ba74d869758a4542b9075 based on current shard version 30641|0||563ba74d869758a4542b9075, current metadata version is 30641|0||563ba74d869758a4542b9075 2016-03-13T09:15:20.579+0000 I SHARDING [conn2124] remotely refreshing metadata for mydomain.Sessions with requested shard version 30641|1||563ba74d869758a4542b9075 based on current shard version 30641|0||563ba74d869758a4542b9075, current metadata version is 30641|0||563ba74d869758a4542b9075 2016-03-13T09:15:20.579+0000 I SHARDING [conn1531] remotely refreshing metadata for mydomain.Sessions with requested shard version 30641|1||563ba74d869758a4542b9075 based on current shard version 30641|0||563ba74d869758a4542b9075, current metadata version is 30641|0||563ba74d869758a4542b9075 2016-03-13T09:15:20.708+0000 I SHARDING [conn398] updating metadata for mydomain.Sessions from shard version 30641|0||563ba74d869758a4542b9075 to shard version 30641|1||563ba74d869758a4542b9075 2016-03-13T09:15:20.708+0000 I SHARDING [conn1531] metadata of collection mydomain.Sessions already up to date (shard version : 30641|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:15:20.708+0000 I SHARDING [conn2124] metadata of collection mydomain.Sessions already up to date (shard version : 30641|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:15:20.708+0000 I SHARDING [conn398] collection version was loaded at version 30641|1||563ba74d869758a4542b9075, took 127ms 2016-03-13T09:15:23.349+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:15:23.052+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:15:25.350+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30641000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:15:25.675+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }) in mydomain.Sessions', ts : 56e52fad2848c4eacbd01203 2016-03-13T09:15:25.675+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30641|1||563ba74d869758a4542b9075, current metadata version is 30641|1||563ba74d869758a4542b9075 2016-03-13T09:15:25.804+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30641|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:15:25.840+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:25.840+0000-56e52fad2848c4eacbd01204", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860525840), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:15:25.876+0000 I SHARDING [conn176] moveChunk request accepted at version 30641|1||563ba74d869758a4542b9075 2016-03-13T09:15:25.964+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:15:26.014+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.016+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.021+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.037+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.057+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.098+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.198+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.340+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:26.605+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:27.149+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:28.182+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:29.224+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:30.255+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:31.280+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2555, clonedBytes: 7579760, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:32.305+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5349, clonedBytes: 17298291, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:33.329+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 18206015, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:34.354+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fad2848c4eacbd01205", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 18206015, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:34.354+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:15:34.355+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:15:34.463+0000 I SHARDING [conn176] moveChunk setting version to: 30642|0||563ba74d869758a4542b9075 2016-03-13T09:15:34.465+0000 I SHARDING [conn1835] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:34.465+0000 I SHARDING [conn1381] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:34.466+0000 I SHARDING [conn1896] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:34.466+0000 I SHARDING [conn2332] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:34.468+0000 I SHARDING [conn773] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:34.469+0000 I SHARDING [conn806] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:34.469+0000 I SHARDING [conn1715] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:34.483+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 18206015, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:15:34.483+0000 I SHARDING [conn176] moveChunk updating self version to: 30642|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') } for collection 'mydomain.Sessions' 2016-03-13T09:15:34.618+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:34.618+0000-56e52fb62848c4eacbd01206", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860534618), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 18206015, catchup: 0, steady: 0 } } 2016-03-13T09:15:34.654+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:15:34.655+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:15:34.655+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:34.655+0000-56e52fb62848c4eacbd01207", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860534655), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, step 1 of 6: 0, step 2 of 6: 526, step 3 of 6: 136, step 4 of 6: 8341, step 5 of 6: 300, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:15:34.861+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:15:34.861+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56344e1255418c0ec3f745c2') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30641000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 1010 } }, MMAPV1Journal: { acquireCount: { r: 82, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 36, W: 2 }, timeAcquiringMicros: { R: 60009, W: 4286 } } } protocol:op_command 9512ms 2016-03-13T09:15:35.483+0000 I SHARDING [conn1164] remotely refreshing metadata for mydomain.Sessions with requested shard version 30642|1||563ba74d869758a4542b9075 based on current shard version 30642|0||563ba74d869758a4542b9075, current metadata version is 30642|0||563ba74d869758a4542b9075 2016-03-13T09:15:35.484+0000 I SHARDING [conn2176] remotely refreshing metadata for mydomain.Sessions with requested shard version 30642|1||563ba74d869758a4542b9075 based on current shard version 30642|0||563ba74d869758a4542b9075, current metadata version is 30642|0||563ba74d869758a4542b9075 2016-03-13T09:15:35.484+0000 I SHARDING [conn433] remotely refreshing metadata for mydomain.Sessions with requested shard version 30642|1||563ba74d869758a4542b9075 based on current shard version 30642|0||563ba74d869758a4542b9075, current metadata version is 30642|0||563ba74d869758a4542b9075 2016-03-13T09:15:35.609+0000 I SHARDING [conn2176] updating metadata for mydomain.Sessions from shard version 30642|0||563ba74d869758a4542b9075 to shard version 30642|1||563ba74d869758a4542b9075 2016-03-13T09:15:35.609+0000 I SHARDING [conn433] metadata of collection mydomain.Sessions already up to date (shard version : 30642|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:15:35.609+0000 I SHARDING [conn1164] metadata of collection mydomain.Sessions already up to date (shard version : 30642|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:15:35.609+0000 I SHARDING [conn2176] collection version was loaded at version 30642|1||563ba74d869758a4542b9075, took 124ms 2016-03-13T09:15:40.267+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30642000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:15:40.564+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }) in mydomain.Sessions', ts : 56e52fbc2848c4eacbd01208 2016-03-13T09:15:40.564+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30642|1||563ba74d869758a4542b9075, current metadata version is 30642|1||563ba74d869758a4542b9075 2016-03-13T09:15:40.692+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30642|1||563ba74d869758a4542b9075, took 122ms) 2016-03-13T09:15:40.728+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:40.728+0000-56e52fbc2848c4eacbd01209", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860540728), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:15:40.749+0000 I SHARDING [conn176] moveChunk request accepted at version 30642|1||563ba74d869758a4542b9075 2016-03-13T09:15:40.852+0000 I SHARDING [conn176] moveChunk number of documents: 5388 2016-03-13T09:15:40.877+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('560899482a8aa33e057c0bf7') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089a10e5aec60e69ccbae5') } 2016-03-13T09:15:40.924+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.365+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089a10e5aec60e69ccbae5') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ad92a8aa33e03183070') }, with opId: 770282333 2016-03-13T09:15:41.369+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.394+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.430+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.450+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.511+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.592+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.734+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:41.996+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:42.522+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:43.575+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:44.608+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:45.633+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 328, clonedBytes: 1036685, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:46.658+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3198, clonedBytes: 9103810, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:47.683+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4382, clonedBytes: 12684192, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:48.707+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5388, clonedBytes: 18333192, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:49.732+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fbc2848c4eacbd0120a", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5388, clonedBytes: 18333192, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:49.732+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:15:49.733+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:15:49.743+0000 I SHARDING [conn1292] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:49.745+0000 I SHARDING [conn689] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:49.745+0000 I SHARDING [conn1973] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:49.894+0000 I SHARDING [conn176] moveChunk setting version to: 30643|0||563ba74d869758a4542b9075 2016-03-13T09:15:49.896+0000 I SHARDING [conn1559] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:49.896+0000 I SHARDING [conn2532] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:49.896+0000 I SHARDING [conn2807] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:49.896+0000 I SHARDING [conn672] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:15:49.923+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5388, clonedBytes: 18333192, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:15:49.923+0000 I SHARDING [conn176] moveChunk updating self version to: 30643|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') } for collection 'mydomain.Sessions' 2016-03-13T09:15:50.044+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:50.044+0000-56e52fc62848c4eacbd0120b", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860550044), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, from: "shmydomain1", to: "shmydomain2", cloned: 5388, clonedBytes: 18333192, catchup: 0, steady: 0 } } 2016-03-13T09:15:50.077+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:15:50.077+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:15:50.079+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:50.079+0000-56e52fc62848c4eacbd0120c", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860550079), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, step 1 of 6: 0, step 2 of 6: 482, step 3 of 6: 153, step 4 of 6: 8830, step 5 of 6: 344, step 6 of 6: 2, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:15:50.331+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:15:50.331+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634500555418c0ec3f7765c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30642000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 2419 } }, MMAPV1Journal: { acquireCount: { r: 80, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 34, W: 2 }, timeAcquiringMicros: { R: 74023, W: 45938 } } } protocol:op_command 10064ms 2016-03-13T09:15:50.908+0000 I SHARDING [conn2172] remotely refreshing metadata for mydomain.Sessions with requested shard version 30643|1||563ba74d869758a4542b9075 based on current shard version 30643|0||563ba74d869758a4542b9075, current metadata version is 30643|0||563ba74d869758a4542b9075 2016-03-13T09:15:50.908+0000 I SHARDING [conn419] remotely refreshing metadata for mydomain.Sessions with requested shard version 30643|1||563ba74d869758a4542b9075 based on current shard version 30643|0||563ba74d869758a4542b9075, current metadata version is 30643|0||563ba74d869758a4542b9075 2016-03-13T09:15:50.927+0000 I SHARDING [conn838] remotely refreshing metadata for mydomain.Sessions with requested shard version 30643|1||563ba74d869758a4542b9075 based on current shard version 30643|0||563ba74d869758a4542b9075, current metadata version is 30643|0||563ba74d869758a4542b9075 2016-03-13T09:15:51.035+0000 I SHARDING [conn838] updating metadata for mydomain.Sessions from shard version 30643|0||563ba74d869758a4542b9075 to shard version 30643|1||563ba74d869758a4542b9075 2016-03-13T09:15:51.035+0000 I SHARDING [conn2172] metadata of collection mydomain.Sessions already up to date (shard version : 30643|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:15:51.035+0000 I SHARDING [conn838] collection version was loaded at version 30643|1||563ba74d869758a4542b9075, took 104ms 2016-03-13T09:15:51.035+0000 I SHARDING [conn419] metadata of collection mydomain.Sessions already up to date (shard version : 30643|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:15:53.560+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:15:53.349+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:15:54.365+0000 I JOURNAL [journal writer] old journal file will be removed: /data/journal/j._1158 2016-03-13T09:15:55.735+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30643000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:15:55.883+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }) in mydomain.Sessions', ts : 56e52fcb2848c4eacbd0120d 2016-03-13T09:15:55.883+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30643|1||563ba74d869758a4542b9075, current metadata version is 30643|1||563ba74d869758a4542b9075 2016-03-13T09:15:56.010+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30643|1||563ba74d869758a4542b9075, took 123ms) 2016-03-13T09:15:56.049+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:15:56.049+0000-56e52fcc2848c4eacbd0120e", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860556049), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:15:56.068+0000 I SHARDING [conn176] moveChunk request accepted at version 30643|1||563ba74d869758a4542b9075 2016-03-13T09:15:56.164+0000 I SHARDING [conn176] moveChunk number of documents: 5390 2016-03-13T09:15:56.213+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.216+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.227+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.248+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.267+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.328+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.409+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.551+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:56.814+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:57.340+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:58.372+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:15:59.404+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:00.449+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:01.473+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2423, clonedBytes: 6000796, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:02.502+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5322, clonedBytes: 16742314, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:03.526+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 18022570, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:04.551+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52fcc2848c4eacbd0120f", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5390, clonedBytes: 18022570, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:04.551+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:16:04.552+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:16:04.659+0000 I SHARDING [conn176] moveChunk setting version to: 30644|0||563ba74d869758a4542b9075 2016-03-13T09:16:04.660+0000 I SHARDING [conn1563] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:04.661+0000 I SHARDING [conn1099] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:04.661+0000 I SHARDING [conn3010] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:04.661+0000 I SHARDING [conn2794] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:04.661+0000 I SHARDING [conn2222] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:04.661+0000 I SHARDING [conn264] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:04.661+0000 I SHARDING [conn2980] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:04.693+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5390, clonedBytes: 18022570, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:16:04.693+0000 I SHARDING [conn176] moveChunk updating self version to: 30644|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') } for collection 'mydomain.Sessions' 2016-03-13T09:16:04.971+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:04.970+0000-56e52fd42848c4eacbd01210", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860564970), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, from: "shmydomain1", to: "shmydomain3", cloned: 5390, clonedBytes: 18022570, catchup: 0, steady: 0 } } 2016-03-13T09:16:05.011+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:16:05.012+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:16:05.013+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:05.012+0000-56e52fd52848c4eacbd01211", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860565012), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, step 1 of 6: 0, step 2 of 6: 333, step 3 of 6: 143, step 4 of 6: 8339, step 5 of 6: 461, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:16:05.212+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:16:05.212+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634520d584ad10f21360d6d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30643000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 5644 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 2 }, timeAcquiringMicros: { R: 60998, W: 4447 } } } protocol:op_command 9478ms 2016-03-13T09:16:05.842+0000 I SHARDING [conn818] remotely refreshing metadata for mydomain.Sessions with requested shard version 30644|1||563ba74d869758a4542b9075 based on current shard version 30644|0||563ba74d869758a4542b9075, current metadata version is 30644|0||563ba74d869758a4542b9075 2016-03-13T09:16:05.842+0000 I SHARDING [conn1091] remotely refreshing metadata for mydomain.Sessions with requested shard version 30644|1||563ba74d869758a4542b9075 based on current shard version 30644|0||563ba74d869758a4542b9075, current metadata version is 30644|0||563ba74d869758a4542b9075 2016-03-13T09:16:05.873+0000 I SHARDING [conn3010] remotely refreshing metadata for mydomain.Sessions with requested shard version 30644|1||563ba74d869758a4542b9075 based on current shard version 30644|0||563ba74d869758a4542b9075, current metadata version is 30644|0||563ba74d869758a4542b9075 2016-03-13T09:16:05.990+0000 I SHARDING [conn1091] updating metadata for mydomain.Sessions from shard version 30644|0||563ba74d869758a4542b9075 to shard version 30644|1||563ba74d869758a4542b9075 2016-03-13T09:16:05.990+0000 I SHARDING [conn818] metadata of collection mydomain.Sessions already up to date (shard version : 30644|1||563ba74d869758a4542b9075, took 145ms) 2016-03-13T09:16:05.990+0000 I SHARDING [conn3010] metadata of collection mydomain.Sessions already up to date (shard version : 30644|1||563ba74d869758a4542b9075, took 115ms) 2016-03-13T09:16:05.990+0000 I SHARDING [conn1091] collection version was loaded at version 30644|1||563ba74d869758a4542b9075, took 145ms 2016-03-13T09:16:11.476+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089a10e5aec60e69ccbae5') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ad92a8aa33e03183070') } 2016-03-13T09:16:11.695+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ad92a8aa33e03183070') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089b9b2a8aa33e03183efe') }, with opId: 770332225 2016-03-13T09:16:12.605+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30644000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:16:12.758+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }) in mydomain.Sessions', ts : 56e52fdc2848c4eacbd01212 2016-03-13T09:16:12.758+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30644|1||563ba74d869758a4542b9075, current metadata version is 30644|1||563ba74d869758a4542b9075 2016-03-13T09:16:12.878+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30644|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T09:16:12.911+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:12.911+0000-56e52fdc2848c4eacbd01213", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860572911), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:16:12.938+0000 I SHARDING [conn152] moveChunk request accepted at version 30644|1||563ba74d869758a4542b9075 2016-03-13T09:16:13.034+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:16:13.089+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.091+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.109+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.129+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.170+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.210+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.275+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.412+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:13.675+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:14.202+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:15.237+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:16.267+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:17.299+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:18.323+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 984, clonedBytes: 2740291, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:19.348+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4072, clonedBytes: 12099658, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:20.373+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 18092330, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:21.397+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52fdc2848c4eacbd01214", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 18092330, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:21.398+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:16:21.398+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:16:21.398+0000 I SHARDING [conn412] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:21.399+0000 I SHARDING [conn1791] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:21.399+0000 I SHARDING [conn1429] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:21.507+0000 I SHARDING [conn152] moveChunk setting version to: 30645|0||563ba74d869758a4542b9075 2016-03-13T09:16:21.509+0000 I SHARDING [conn1387] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:21.511+0000 I SHARDING [conn913] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:21.512+0000 I SHARDING [conn651] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:21.512+0000 I SHARDING [conn1779] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:21.543+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 18092330, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:16:21.543+0000 I SHARDING [conn152] moveChunk updating self version to: 30645|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') } for collection 'mydomain.Sessions' 2016-03-13T09:16:21.690+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:21.690+0000-56e52fe52848c4eacbd01215", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860581690), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, from: "shmydomain1", to: "shmydomain2", cloned: 5389, clonedBytes: 18092330, catchup: 0, steady: 0 } } 2016-03-13T09:16:21.723+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:16:21.723+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:16:21.723+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:21.723+0000-56e52fe52848c4eacbd01216", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860581723), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, step 1 of 6: 0, step 2 of 6: 332, step 3 of 6: 146, step 4 of 6: 8313, step 5 of 6: 325, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:16:21.929+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:16:21.929+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345421584ad10f1f990b05') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30644000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 402 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 1 }, timeAcquiringMicros: { R: 65262, W: 1517 } } } protocol:op_command 9324ms 2016-03-13T09:16:22.571+0000 I SHARDING [conn2558] remotely refreshing metadata for mydomain.Sessions with requested shard version 30645|1||563ba74d869758a4542b9075 based on current shard version 30645|0||563ba74d869758a4542b9075, current metadata version is 30645|0||563ba74d869758a4542b9075 2016-03-13T09:16:22.571+0000 I SHARDING [conn2801] remotely refreshing metadata for mydomain.Sessions with requested shard version 30645|1||563ba74d869758a4542b9075 based on current shard version 30645|0||563ba74d869758a4542b9075, current metadata version is 30645|0||563ba74d869758a4542b9075 2016-03-13T09:16:22.583+0000 I SHARDING [conn412] remotely refreshing metadata for mydomain.Sessions with requested shard version 30645|1||563ba74d869758a4542b9075 based on current shard version 30645|0||563ba74d869758a4542b9075, current metadata version is 30645|0||563ba74d869758a4542b9075 2016-03-13T09:16:22.698+0000 I SHARDING [conn2801] updating metadata for mydomain.Sessions from shard version 30645|0||563ba74d869758a4542b9075 to shard version 30645|1||563ba74d869758a4542b9075 2016-03-13T09:16:22.698+0000 I SHARDING [conn2558] metadata of collection mydomain.Sessions already up to date (shard version : 30645|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:16:22.698+0000 I SHARDING [conn412] metadata of collection mydomain.Sessions already up to date (shard version : 30645|1||563ba74d869758a4542b9075, took 114ms) 2016-03-13T09:16:22.699+0000 I SHARDING [conn2801] collection version was loaded at version 30645|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:16:23.759+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:16:23.560+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:16:26.959+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30645000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:16:27.108+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }) in mydomain.Sessions', ts : 56e52fea2848c4eacbd01217 2016-03-13T09:16:27.108+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30645|1||563ba74d869758a4542b9075, current metadata version is 30645|1||563ba74d869758a4542b9075 2016-03-13T09:16:27.230+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30645|1||563ba74d869758a4542b9075, took 119ms) 2016-03-13T09:16:27.266+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:27.266+0000-56e52feb2848c4eacbd01218", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860587266), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:16:27.297+0000 I SHARDING [conn152] moveChunk request accepted at version 30645|1||563ba74d869758a4542b9075 2016-03-13T09:16:27.384+0000 I SHARDING [conn152] moveChunk number of documents: 5389 2016-03-13T09:16:27.434+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:27.439+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:27.450+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:27.471+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:27.511+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:27.551+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:27.632+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:27.774+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:28.057+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:28.603+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:29.677+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:30.708+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:31.733+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:32.757+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3077, clonedBytes: 9354750, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:33.782+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5289, clonedBytes: 16762768, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:34.807+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 18075482, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:35.832+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e52feb2848c4eacbd01219", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 18075482, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:35.832+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:16:35.832+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:16:35.832+0000 I SHARDING [conn682] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:35.832+0000 I SHARDING [conn1294] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:35.833+0000 I SHARDING [conn2332] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:35.833+0000 I SHARDING [conn1161] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:35.947+0000 I SHARDING [conn152] moveChunk setting version to: 30646|0||563ba74d869758a4542b9075 2016-03-13T09:16:35.949+0000 I SHARDING [conn2320] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:35.949+0000 I SHARDING [conn1164] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:35.949+0000 I SHARDING [conn2454] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:35.989+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 18075482, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:16:35.989+0000 I SHARDING [conn152] moveChunk updating self version to: 30646|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') } for collection 'mydomain.Sessions' 2016-03-13T09:16:36.087+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:36.087+0000-56e52ff42848c4eacbd0121a", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860596087), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 18075482, catchup: 0, steady: 0 } } 2016-03-13T09:16:36.142+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:16:36.144+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:16:36.144+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:36.144+0000-56e52ff42848c4eacbd0121b", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860596144), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, step 1 of 6: 0, step 2 of 6: 338, step 3 of 6: 135, step 4 of 6: 8399, step 5 of 6: 312, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:16:36.291+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:16:36.291+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634564b55418c0ec3f816f0') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30645000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 6446 } }, MMAPV1Journal: { acquireCount: { r: 77, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 31, W: 2 }, timeAcquiringMicros: { R: 55337, W: 9178 } } } protocol:op_command 9332ms 2016-03-13T09:16:36.947+0000 I SHARDING [conn1931] remotely refreshing metadata for mydomain.Sessions with requested shard version 30646|1||563ba74d869758a4542b9075 based on current shard version 30646|0||563ba74d869758a4542b9075, current metadata version is 30646|0||563ba74d869758a4542b9075 2016-03-13T09:16:36.947+0000 I SHARDING [conn2142] remotely refreshing metadata for mydomain.Sessions with requested shard version 30646|1||563ba74d869758a4542b9075 based on current shard version 30646|0||563ba74d869758a4542b9075, current metadata version is 30646|0||563ba74d869758a4542b9075 2016-03-13T09:16:36.982+0000 I SHARDING [conn659] remotely refreshing metadata for mydomain.Sessions with requested shard version 30646|1||563ba74d869758a4542b9075 based on current shard version 30646|0||563ba74d869758a4542b9075, current metadata version is 30646|0||563ba74d869758a4542b9075 2016-03-13T09:16:37.078+0000 I SHARDING [conn1931] updating metadata for mydomain.Sessions from shard version 30646|0||563ba74d869758a4542b9075 to shard version 30646|1||563ba74d869758a4542b9075 2016-03-13T09:16:37.078+0000 I SHARDING [conn2142] metadata of collection mydomain.Sessions already up to date (shard version : 30646|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T09:16:37.078+0000 I SHARDING [conn1931] collection version was loaded at version 30646|1||563ba74d869758a4542b9075, took 129ms 2016-03-13T09:16:37.088+0000 I SHARDING [conn659] metadata of collection mydomain.Sessions already up to date (shard version : 30646|1||563ba74d869758a4542b9075, took 103ms) 2016-03-13T09:16:41.470+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30646000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:16:41.634+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5318 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ad92a8aa33e03183070') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089b9b2a8aa33e03183efe') } 2016-03-13T09:16:41.761+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }) in mydomain.Sessions', ts : 56e52ff92848c4eacbd0121c 2016-03-13T09:16:41.761+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30646|1||563ba74d869758a4542b9075, current metadata version is 30646|1||563ba74d869758a4542b9075 2016-03-13T09:16:41.885+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30646|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:16:41.923+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:41.923+0000-56e52ff92848c4eacbd0121d", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860601923), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:16:41.943+0000 I SHARDING [conn152] moveChunk request accepted at version 30646|1||563ba74d869758a4542b9075 2016-03-13T09:16:41.968+0000 I SHARDING [conn152] moveChunk number of documents: 5390 2016-03-13T09:16:42.026+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089b9b2a8aa33e03183efe') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089c61c5ab960e4d3f49cb') }, with opId: 770380669 2016-03-13T09:16:42.035+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.056+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.076+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.095+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.137+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.176+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.277+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.421+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:42.682+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:43.208+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:44.240+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:45.273+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:46.305+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:47.330+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2417, clonedBytes: 6498681, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:48.354+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5329, clonedBytes: 16628117, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:49.379+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 17636269, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:50.404+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e52ff92848c4eacbd0121e", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5390, clonedBytes: 17636269, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:50.404+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:16:50.404+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:16:50.512+0000 I SHARDING [conn152] moveChunk setting version to: 30647|0||563ba74d869758a4542b9075 2016-03-13T09:16:50.512+0000 I SHARDING [conn2807] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:50.514+0000 I SHARDING [conn2543] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:50.514+0000 I SHARDING [conn2882] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:50.514+0000 I SHARDING [conn420] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:50.515+0000 I SHARDING [conn1559] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:50.515+0000 I SHARDING [conn1435] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:50.515+0000 I SHARDING [conn505] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:16:50.532+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5390, clonedBytes: 17636269, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:16:50.532+0000 I SHARDING [conn152] moveChunk updating self version to: 30647|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') } for collection 'mydomain.Sessions' 2016-03-13T09:16:50.804+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:50.804+0000-56e530022848c4eacbd0121f", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860610804), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, from: "shmydomain1", to: "shmydomain2", cloned: 5390, clonedBytes: 17636269, catchup: 0, steady: 0 } } 2016-03-13T09:16:50.840+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:16:50.841+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:16:50.853+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:50.853+0000-56e530022848c4eacbd01220", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860610853), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, step 1 of 6: 0, step 2 of 6: 472, step 3 of 6: 75, step 4 of 6: 8385, step 5 of 6: 437, step 6 of 6: 12, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:16:51.060+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:16:51.061+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634589655418c0ec3f850a4') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30646000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 775 } }, MMAPV1Journal: { acquireCount: { r: 47, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 1, W: 1 }, timeAcquiringMicros: { R: 12229, W: 109 } } } protocol:op_command 9591ms 2016-03-13T09:16:51.670+0000 I SHARDING [conn437] remotely refreshing metadata for mydomain.Sessions with requested shard version 30647|1||563ba74d869758a4542b9075 based on current shard version 30647|0||563ba74d869758a4542b9075, current metadata version is 30647|0||563ba74d869758a4542b9075 2016-03-13T09:16:51.670+0000 I SHARDING [conn703] remotely refreshing metadata for mydomain.Sessions with requested shard version 30647|1||563ba74d869758a4542b9075 based on current shard version 30647|0||563ba74d869758a4542b9075, current metadata version is 30647|0||563ba74d869758a4542b9075 2016-03-13T09:16:51.672+0000 I SHARDING [conn390] remotely refreshing metadata for mydomain.Sessions with requested shard version 30647|1||563ba74d869758a4542b9075 based on current shard version 30647|0||563ba74d869758a4542b9075, current metadata version is 30647|0||563ba74d869758a4542b9075 2016-03-13T09:16:51.801+0000 I SHARDING [conn390] updating metadata for mydomain.Sessions from shard version 30647|0||563ba74d869758a4542b9075 to shard version 30647|1||563ba74d869758a4542b9075 2016-03-13T09:16:51.801+0000 I SHARDING [conn703] metadata of collection mydomain.Sessions already up to date (shard version : 30647|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T09:16:51.801+0000 I SHARDING [conn437] metadata of collection mydomain.Sessions already up to date (shard version : 30647|1||563ba74d869758a4542b9075, took 129ms) 2016-03-13T09:16:51.801+0000 I SHARDING [conn390] collection version was loaded at version 30647|1||563ba74d869758a4542b9075, took 127ms 2016-03-13T09:16:54.077+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:16:53.759+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:16:55.937+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30647000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:16:56.230+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }) in mydomain.Sessions', ts : 56e530072848c4eacbd01221 2016-03-13T09:16:56.230+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30647|1||563ba74d869758a4542b9075, current metadata version is 30647|1||563ba74d869758a4542b9075 2016-03-13T09:16:56.386+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30647|1||563ba74d869758a4542b9075, took 151ms) 2016-03-13T09:16:56.433+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:16:56.433+0000-56e530082848c4eacbd01222", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860616433), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:16:56.467+0000 I SHARDING [conn152] moveChunk request accepted at version 30647|1||563ba74d869758a4542b9075 2016-03-13T09:16:56.622+0000 I SHARDING [conn152] moveChunk number of documents: 5391 2016-03-13T09:16:56.671+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:56.675+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:56.691+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:56.710+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:56.731+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:56.772+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:56.853+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:56.994+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:57.257+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:57.783+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:58.815+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:16:59.847+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:00.879+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:01.924+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2175, clonedBytes: 5813698, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:02.949+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5343, clonedBytes: 16039088, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:03.974+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5391, clonedBytes: 16908566, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:04.998+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530082848c4eacbd01223", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5391, clonedBytes: 16908566, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:04.998+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:17:04.999+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:17:05.108+0000 I SHARDING [conn152] moveChunk setting version to: 30648|0||563ba74d869758a4542b9075 2016-03-13T09:17:05.128+0000 I SHARDING [conn210] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:05.128+0000 I SHARDING [conn1563] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:05.128+0000 I SHARDING [conn1099] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:05.129+0000 I SHARDING [conn2223] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:05.131+0000 I SHARDING [conn2507] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:05.131+0000 I SHARDING [conn1428] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:05.131+0000 I SHARDING [conn1717] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:05.155+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5391, clonedBytes: 16908566, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:17:05.155+0000 I SHARDING [conn152] moveChunk updating self version to: 30648|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') } for collection 'mydomain.Sessions' 2016-03-13T09:17:05.310+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:05.310+0000-56e530112848c4eacbd01224", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860625310), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, from: "shmydomain1", to: "shmydomain3", cloned: 5391, clonedBytes: 16908566, catchup: 0, steady: 0 } } 2016-03-13T09:17:05.342+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:17:05.346+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:17:05.346+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:05.346+0000-56e530112848c4eacbd01225", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860625346), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, step 1 of 6: 0, step 2 of 6: 530, step 3 of 6: 202, step 4 of 6: 8328, step 5 of 6: 347, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:17:05.548+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:17:05.548+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345b0e55418c0ec5990cac') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30647000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 31748 } }, MMAPV1Journal: { acquireCount: { r: 81, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 35, W: 2 }, timeAcquiringMicros: { R: 100354, W: 5847 } } } protocol:op_command 9611ms 2016-03-13T09:17:06.172+0000 I SHARDING [conn1125] remotely refreshing metadata for mydomain.Sessions with requested shard version 30648|1||563ba74d869758a4542b9075 based on current shard version 30648|0||563ba74d869758a4542b9075, current metadata version is 30648|0||563ba74d869758a4542b9075 2016-03-13T09:17:06.172+0000 I SHARDING [conn1898] remotely refreshing metadata for mydomain.Sessions with requested shard version 30648|1||563ba74d869758a4542b9075 based on current shard version 30648|0||563ba74d869758a4542b9075, current metadata version is 30648|0||563ba74d869758a4542b9075 2016-03-13T09:17:06.176+0000 I SHARDING [conn1091] remotely refreshing metadata for mydomain.Sessions with requested shard version 30648|1||563ba74d869758a4542b9075 based on current shard version 30648|0||563ba74d869758a4542b9075, current metadata version is 30648|0||563ba74d869758a4542b9075 2016-03-13T09:17:06.298+0000 I SHARDING [conn1125] updating metadata for mydomain.Sessions from shard version 30648|0||563ba74d869758a4542b9075 to shard version 30648|1||563ba74d869758a4542b9075 2016-03-13T09:17:06.298+0000 I SHARDING [conn1898] metadata of collection mydomain.Sessions already up to date (shard version : 30648|1||563ba74d869758a4542b9075, took 126ms) 2016-03-13T09:17:06.298+0000 I SHARDING [conn1125] collection version was loaded at version 30648|1||563ba74d869758a4542b9075, took 126ms 2016-03-13T09:17:06.298+0000 I SHARDING [conn1091] metadata of collection mydomain.Sessions already up to date (shard version : 30648|1||563ba74d869758a4542b9075, took 121ms) 2016-03-13T09:17:10.419+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30648000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:17:11.942+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }) in mydomain.Sessions', ts : 56e530162848c4eacbd01226 2016-03-13T09:17:11.942+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30648|1||563ba74d869758a4542b9075, current metadata version is 30648|1||563ba74d869758a4542b9075 2016-03-13T09:17:12.070+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30648|1||563ba74d869758a4542b9075, took 124ms) 2016-03-13T09:17:12.108+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:12.108+0000-56e530182848c4eacbd01227", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860632108), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:17:12.221+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5385 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089b9b2a8aa33e03183efe') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089c61c5ab960e4d3f49cb') } 2016-03-13T09:17:12.596+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089c61c5ab960e4d3f49cb') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089d262a8aa33e03185a14') }, with opId: 770429957 2016-03-13T09:17:13.419+0000 I SHARDING [conn152] moveChunk request accepted at version 30648|1||563ba74d869758a4542b9075 2016-03-13T09:17:13.527+0000 I SHARDING [conn152] moveChunk number of documents: 5298 2016-03-13T09:17:13.582+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:13.585+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:13.602+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:13.622+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:13.662+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:13.704+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:13.784+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:13.925+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:14.189+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:14.714+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:15.739+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:16.769+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:17.822+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:18.847+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1372, clonedBytes: 3068799, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:19.871+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4545, clonedBytes: 12896899, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:20.896+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5298, clonedBytes: 17536814, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:21.921+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e530192848c4eacbd01228", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5298, clonedBytes: 17536814, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:21.921+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:17:21.921+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:17:22.031+0000 I SHARDING [conn152] moveChunk setting version to: 30649|0||563ba74d869758a4542b9075 2016-03-13T09:17:22.033+0000 I SHARDING [conn1809] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:22.033+0000 I SHARDING [conn651] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:22.033+0000 I SHARDING [conn913] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:22.033+0000 I SHARDING [conn1610] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:22.033+0000 I SHARDING [conn2097] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:22.033+0000 I SHARDING [conn1660] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:22.033+0000 I SHARDING [conn2378] Waiting for 30 seconds for the migration critical section to end 2016-03-13T09:17:22.061+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5298, clonedBytes: 17536814, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:17:22.061+0000 I SHARDING [conn152] moveChunk updating self version to: 30649|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') } for collection 'mydomain.Sessions' 2016-03-13T09:17:22.192+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:22.192+0000-56e530222848c4eacbd01229", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860642192), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, from: "shmydomain1", to: "shmydomain2", cloned: 5298, clonedBytes: 17536814, catchup: 0, steady: 0 } } 2016-03-13T09:17:22.225+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:17:22.228+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:17:22.231+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:22.231+0000-56e530222848c4eacbd0122a", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860642231), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, step 1 of 6: 0, step 2 of 6: 2999, step 3 of 6: 158, step 4 of 6: 8343, step 5 of 6: 307, step 6 of 6: 2, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:17:22.435+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:17:22.435+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56345d9e584ad10f1f9a10c6') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30648000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:41 reslen:134 locks:{ Global: { acquireCount: { r: 90, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 3590 } }, MMAPV1Journal: { acquireCount: { r: 84, w: 4 } }, Database: { acquireCount: { r: 43, w: 2 } }, Collection: { acquireCount: { R: 43, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 82043, W: 5504 } } } protocol:op_command 12016ms 2016-03-13T09:17:23.073+0000 I SHARDING [conn244] remotely refreshing metadata for mydomain.Sessions with requested shard version 30649|1||563ba74d869758a4542b9075 based on current shard version 30649|0||563ba74d869758a4542b9075, current metadata version is 30649|0||563ba74d869758a4542b9075 2016-03-13T09:17:23.090+0000 I SHARDING [conn785] remotely refreshing metadata for mydomain.Sessions with requested shard version 30649|1||563ba74d869758a4542b9075 based on current shard version 30649|0||563ba74d869758a4542b9075, current metadata version is 30649|0||563ba74d869758a4542b9075 2016-03-13T09:17:23.090+0000 I SHARDING [conn913] remotely refreshing metadata for mydomain.Sessions with requested shard version 30649|1||563ba74d869758a4542b9075 based on current shard version 30649|0||563ba74d869758a4542b9075, current metadata version is 30649|0||563ba74d869758a4542b9075 2016-03-13T09:17:23.198+0000 I SHARDING [conn244] updating metadata for mydomain.Sessions from shard version 30649|0||563ba74d869758a4542b9075 to shard version 30649|1||563ba74d869758a4542b9075 2016-03-13T09:17:23.198+0000 I SHARDING [conn244] collection version was loaded at version 30649|1||563ba74d869758a4542b9075, took 118ms 2016-03-13T09:17:23.222+0000 I SHARDING [conn913] metadata of collection mydomain.Sessions already up to date (shard version : 30649|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:17:23.222+0000 I SHARDING [conn785] metadata of collection mydomain.Sessions already up to date (shard version : 30649|1||563ba74d869758a4542b9075, took 128ms) 2016-03-13T09:17:24.350+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:17:24.077+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:17:26.711+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30649000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:17:27.052+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }) in mydomain.Sessions', ts : 56e530262848c4eacbd0122b 2016-03-13T09:17:27.052+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30649|1||563ba74d869758a4542b9075, current metadata version is 30649|1||563ba74d869758a4542b9075 2016-03-13T09:17:27.182+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30649|1||563ba74d869758a4542b9075, took 127ms) 2016-03-13T09:17:27.219+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:27.219+0000-56e530272848c4eacbd0122c", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860647219), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:17:27.231+0000 I SHARDING [conn176] moveChunk request accepted at version 30649|1||563ba74d869758a4542b9075 2016-03-13T09:17:27.322+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:17:27.372+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:27.374+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:27.379+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:27.417+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:27.437+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:27.478+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:27.579+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:27.720+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:28.003+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:28.530+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:29.562+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:30.594+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:31.626+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:32.651+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2585, clonedBytes: 7626341, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:33.676+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5296, clonedBytes: 16765702, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:34.708+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 18103615, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:35.733+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e530272848c4eacbd0122d", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 18103615, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:17:35.733+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:17:35.733+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:17:35.843+0000 I SHARDING [conn176] moveChunk setting version to: 30650|0||563ba74d869758a4542b9075 2016-03-13T09:17:35.891+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 18103615, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:17:35.891+0000 I SHARDING [conn176] moveChunk updating self version to: 30650|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') } for collection 'mydomain.Sessions' 2016-03-13T09:17:36.029+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:36.029+0000-56e530302848c4eacbd01276", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860656029), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, from: "shmydomain1", to: "shmydomain3", cloned: 5389, clonedBytes: 18103615, catchup: 0, steady: 0 } } 2016-03-13T09:17:36.061+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:17:36.065+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:17:36.065+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:17:36.065+0000-56e530302848c4eacbd01277", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860656065), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, step 1 of 6: 0, step 2 of 6: 520, step 3 of 6: 138, step 4 of 6: 8362, step 5 of 6: 331, step 6 of 6: 0, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:17:36.404+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:17:36.404+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634605ca2a4330ea423620f') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30649000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4610 } }, MMAPV1Journal: { acquireCount: { r: 79, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 33, W: 2 }, timeAcquiringMicros: { R: 60054, W: 4027 } } } protocol:op_command 9693ms 2016-03-13T09:17:39.390+0000 I SHARDING [conn886] remotely refreshing metadata for mydomain.Sessions with requested shard version 30650|1||563ba74d869758a4542b9075 based on current shard version 30650|0||563ba74d869758a4542b9075, current metadata version is 30650|0||563ba74d869758a4542b9075 2016-03-13T09:17:39.390+0000 I SHARDING [conn406] remotely refreshing metadata for mydomain.Sessions with requested shard version 30650|1||563ba74d869758a4542b9075 based on current shard version 30650|0||563ba74d869758a4542b9075, current metadata version is 30650|0||563ba74d869758a4542b9075 2016-03-13T09:17:39.497+0000 I SHARDING [conn1889] remotely refreshing metadata for mydomain.Sessions with requested shard version 30650|1||563ba74d869758a4542b9075 based on current shard version 30650|0||563ba74d869758a4542b9075, current metadata version is 30650|0||563ba74d869758a4542b9075 2016-03-13T09:17:39.515+0000 I SHARDING [conn406] updating metadata for mydomain.Sessions from shard version 30650|0||563ba74d869758a4542b9075 to shard version 30650|1||563ba74d869758a4542b9075 2016-03-13T09:17:39.515+0000 I SHARDING [conn886] metadata of collection mydomain.Sessions already up to date (shard version : 30650|1||563ba74d869758a4542b9075, took 125ms) 2016-03-13T09:17:39.515+0000 I SHARDING [conn406] collection version was loaded at version 30650|1||563ba74d869758a4542b9075, took 125ms 2016-03-13T09:17:39.606+0000 I SHARDING [conn1889] metadata of collection mydomain.Sessions already up to date (shard version : 30650|1||563ba74d869758a4542b9075, took 105ms) 2016-03-13T09:17:40.898+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089c61c5ab960e4d3f49cb') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089d262a8aa33e03185a14') } 2016-03-13T09:17:43.379+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089d262a8aa33e03185a14') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089de6584ad1621aeec23e') }, with opId: 770463234 2016-03-13T09:17:54.628+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:17:54.350+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:17:57.685+0000 I SHARDING [conn3340] request split points lookup for chunk mydomain.ShardTest { : 3572581960749947492 } -->> { : 4971254716927996603 } 2016-03-13T09:17:57.685+0000 I SHARDING [conn3340] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:00.571+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089d262a8aa33e03185a14') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089de6584ad1621aeec23e') } 2016-03-13T09:18:02.570+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30650000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:18:02.578+0000 I SHARDING [conn3332] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:02.727+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }) in mydomain.Sessions', ts : 56e5304a2848c4eacbd01283 2016-03-13T09:18:02.727+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30650|1||563ba74d869758a4542b9075, current metadata version is 30650|1||563ba74d869758a4542b9075 2016-03-13T09:18:02.863+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30650|1||563ba74d869758a4542b9075, took 136ms) 2016-03-13T09:18:02.894+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:02.894+0000-56e5304a2848c4eacbd01288", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860682894), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:18:02.925+0000 I SHARDING [conn152] moveChunk request accepted at version 30650|1||563ba74d869758a4542b9075 2016-03-13T09:18:02.954+0000 I SHARDING [conn152] moveChunk number of documents: 5393 2016-03-13T09:18:03.007+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:03.012+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:03.248+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:03.646+0000 I SHARDING [conn3340] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:03.647+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:03.656+0000 I NETWORK [initandlisten] connection accepted from 10.0.231.121:46421 #3341 (3059 connections now open) 2016-03-13T09:18:03.670+0000 I NETWORK [initandlisten] connection accepted from 10.0.231.121:46422 #3342 (3060 connections now open) 2016-03-13T09:18:03.671+0000 I SHARDING [conn3341] request split points lookup for chunk mydomain.ShardTest { : 3572581960749947492 } -->> { : 4971254716927996603 } 2016-03-13T09:18:03.671+0000 I SHARDING [conn3341] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:03.749+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:03.923+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:04.544+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089de6584ad1621aeec23e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ebbe5aec60e69cd13a4') }, with opId: 770469514 2016-03-13T09:18:04.550+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:04.634+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:04.772+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:05.036+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:05.562+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:06.594+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:07.639+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1141, clonedBytes: 2374084, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:08.663+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 3901, clonedBytes: 11723955, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:09.688+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5393, clonedBytes: 17908339, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:10.713+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5304a2848c4eacbd01289", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5393, clonedBytes: 17908339, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:10.713+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:18:10.713+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:18:10.824+0000 I SHARDING [conn152] moveChunk setting version to: 30651|0||563ba74d869758a4542b9075 2016-03-13T09:18:10.865+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5393, clonedBytes: 17908339, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:18:10.865+0000 I SHARDING [conn152] moveChunk updating self version to: 30651|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') } for collection 'mydomain.Sessions' 2016-03-13T09:18:10.992+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:10.992+0000-56e530522848c4eacbd01295", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860690992), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, from: "shmydomain1", to: "shmydomain2", cloned: 5393, clonedBytes: 17908339, catchup: 0, steady: 0 } } 2016-03-13T09:18:11.025+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:18:11.028+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:18:11.029+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:11.029+0000-56e530532848c4eacbd01296", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860691029), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, step 1 of 6: 0, step 2 of 6: 355, step 3 of 6: 80, step 4 of 6: 7707, step 5 of 6: 315, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:18:11.230+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:18:11.231+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346357584ad10f1f9aaa8c') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30650000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 3049 } }, MMAPV1Journal: { acquireCount: { r: 47, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 1, W: 1 }, timeAcquiringMicros: { R: 279, W: 1888 } } } protocol:op_command 8661ms 2016-03-13T09:18:16.574+0000 I SHARDING [conn2825] remotely refreshing metadata for mydomain.Sessions with requested shard version 30651|1||563ba74d869758a4542b9075 based on current shard version 30651|0||563ba74d869758a4542b9075, current metadata version is 30651|0||563ba74d869758a4542b9075 2016-03-13T09:18:16.575+0000 I SHARDING [conn1334] remotely refreshing metadata for mydomain.Sessions with requested shard version 30651|1||563ba74d869758a4542b9075 based on current shard version 30651|0||563ba74d869758a4542b9075, current metadata version is 30651|0||563ba74d869758a4542b9075 2016-03-13T09:18:16.576+0000 I SHARDING [conn706] remotely refreshing metadata for mydomain.Sessions with requested shard version 30651|1||563ba74d869758a4542b9075 based on current shard version 30651|0||563ba74d869758a4542b9075, current metadata version is 30651|0||563ba74d869758a4542b9075 2016-03-13T09:18:16.713+0000 I SHARDING [conn706] updating metadata for mydomain.Sessions from shard version 30651|0||563ba74d869758a4542b9075 to shard version 30651|1||563ba74d869758a4542b9075 2016-03-13T09:18:16.713+0000 I SHARDING [conn1334] metadata of collection mydomain.Sessions already up to date (shard version : 30651|1||563ba74d869758a4542b9075, took 137ms) 2016-03-13T09:18:16.713+0000 I SHARDING [conn2825] metadata of collection mydomain.Sessions already up to date (shard version : 30651|1||563ba74d869758a4542b9075, took 137ms) 2016-03-13T09:18:16.713+0000 I SHARDING [conn706] collection version was loaded at version 30651|1||563ba74d869758a4542b9075, took 131ms 2016-03-13T09:18:21.468+0000 I SHARDING [conn152] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30651000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:18:21.730+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }) in mydomain.Sessions', ts : 56e5305d2848c4eacbd012b1 2016-03-13T09:18:21.730+0000 I SHARDING [conn152] remotely refreshing metadata for mydomain.Sessions based on current shard version 30651|1||563ba74d869758a4542b9075, current metadata version is 30651|1||563ba74d869758a4542b9075 2016-03-13T09:18:21.849+0000 I SHARDING [conn152] metadata of collection mydomain.Sessions already up to date (shard version : 30651|1||563ba74d869758a4542b9075, took 116ms) 2016-03-13T09:18:21.882+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:21.882+0000-56e5305d2848c4eacbd012b2", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860701882), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, from: "shmydomain1", to: "shmydomain3" } } 2016-03-13T09:18:21.921+0000 I SHARDING [conn152] moveChunk request accepted at version 30651|1||563ba74d869758a4542b9075 2016-03-13T09:18:22.016+0000 I SHARDING [conn152] moveChunk number of documents: 5390 2016-03-13T09:18:22.076+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.080+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.096+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.117+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.137+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.178+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.242+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.380+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.572+0000 I SHARDING [conn3340] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } -->> { : MaxKey, : MaxKey, : MinKey, : MinKey } 2016-03-13T09:18:22.580+0000 I NETWORK [initandlisten] connection accepted from 10.0.231.121:46437 #3343 (3061 connections now open) 2016-03-13T09:18:22.581+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:22.584+0000 I SHARDING [conn3342] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:22.587+0000 I SHARDING [conn3332] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:22.607+0000 I NETWORK [initandlisten] connection accepted from 10.0.231.121:46439 #3344 (3062 connections now open) 2016-03-13T09:18:22.627+0000 I SHARDING [conn3343] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:22.627+0000 I SHARDING [conn3335] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:22.628+0000 I SHARDING [conn3344] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:22.643+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:22.690+0000 I NETWORK [initandlisten] connection accepted from 10.0.231.120:57076 #3345 (3063 connections now open) 2016-03-13T09:18:22.711+0000 I SHARDING [conn3345] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:23.156+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:24.188+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:24.872+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:18:24.628+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:18:25.239+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:26.271+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:27.317+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 2391, clonedBytes: 5695305, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:28.356+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 5299, clonedBytes: 16739335, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:28.814+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089de6584ad1621aeec23e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ebbe5aec60e69cd13a4') } 2016-03-13T09:18:29.087+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ebbe5aec60e69cd13a4') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089f87c5ab960e4fe1f47e') }, with opId: 770476998 2016-03-13T09:18:29.294+0000 I SHARDING [conn3343] request split points lookup for chunk mydomain.ShardTest { : 3572581960749947492 } -->> { : 4971254716927996603 } 2016-03-13T09:18:29.294+0000 I SHARDING [conn3343] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:29.306+0000 I SHARDING [conn3344] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('54bde62769eb83015899984f'), : new Date(1421712000000), : MinKey, : MinKey } -->> { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } 2016-03-13T09:18:29.310+0000 I SHARDING [conn3345] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:29.311+0000 I SHARDING [conn3342] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:29.333+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } -->> { : MaxKey, : MaxKey, : MinKey, : MinKey } 2016-03-13T09:18:29.381+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5390, clonedBytes: 17932102, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:30.405+0000 I SHARDING [conn152] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain3_56e5305d2848c4eacbd012b3", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5390, clonedBytes: 17932102, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:30.406+0000 I SHARDING [conn152] About to check if it is safe to enter critical section 2016-03-13T09:18:30.406+0000 I SHARDING [conn152] About to enter migrate critical section 2016-03-13T09:18:30.534+0000 I SHARDING [conn152] moveChunk setting version to: 30652|0||563ba74d869758a4542b9075 2016-03-13T09:18:30.569+0000 I SHARDING [conn152] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5390, clonedBytes: 17932102, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:18:30.569+0000 I SHARDING [conn152] moveChunk updating self version to: 30652|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') } for collection 'mydomain.Sessions' 2016-03-13T09:18:30.710+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:30.710+0000-56e530662848c4eacbd0130f", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860710710), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, from: "shmydomain1", to: "shmydomain3", cloned: 5390, clonedBytes: 17932102, catchup: 0, steady: 0 } } 2016-03-13T09:18:30.832+0000 I SHARDING [conn152] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:18:30.835+0000 I SHARDING [conn152] forking for cleanup of chunk data 2016-03-13T09:18:30.837+0000 I SHARDING [conn152] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:30.837+0000-56e530662848c4eacbd01310", server: "ip-10-0-163-109", clientAddr: "10.0.231.120:42284", time: new Date(1457860710837), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, step 1 of 6: 0, step 2 of 6: 452, step 3 of 6: 153, step 4 of 6: 8331, step 5 of 6: 429, step 6 of 6: 1, to: "shmydomain3", from: "shmydomain1", note: "success" } } 2016-03-13T09:18:31.137+0000 I SHARDING [conn152] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:18:31.137+0000 I COMMAND [conn152] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain3/in.db3m1.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain3", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5634669d55418c0ec3f9ca7d') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30651000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 2 }, timeAcquiringMicros: { R: 4073 } }, MMAPV1Journal: { acquireCount: { r: 85, w: 4 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { R: 39, W: 2 }, timeAcquiringMicros: { R: 69348, W: 23450 } } } protocol:op_command 9669ms 2016-03-13T09:18:35.859+0000 I SHARDING [conn3343] request split points lookup for chunk mydomain.ShardTest { : -619365771742255419 } -->> { : 772921417880186793 } 2016-03-13T09:18:35.859+0000 I SHARDING [conn3343] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:36.717+0000 I SHARDING [conn1012] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|0||563ba74d869758a4542b9075, current metadata version is 30652|0||563ba74d869758a4542b9075 2016-03-13T09:18:36.718+0000 I SHARDING [conn1756] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|0||563ba74d869758a4542b9075, current metadata version is 30652|0||563ba74d869758a4542b9075 2016-03-13T09:18:36.718+0000 I SHARDING [conn1084] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|0||563ba74d869758a4542b9075, current metadata version is 30652|0||563ba74d869758a4542b9075 2016-03-13T09:18:36.720+0000 I SHARDING [conn3345] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } -->> { : MaxKey, : MaxKey, : MinKey, : MinKey } 2016-03-13T09:18:36.726+0000 I SHARDING [conn3335] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:36.727+0000 I SHARDING [conn3343] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:36.736+0000 I SHARDING [conn3344] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:36.739+0000 I SHARDING [conn3342] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:36.749+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } -->> { : MaxKey, : MaxKey, : MinKey, : MinKey } 2016-03-13T09:18:36.751+0000 I SHARDING [conn3340] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('54bde62769eb83015899984f'), : new Date(1421712000000), : MinKey, : MinKey } -->> { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } 2016-03-13T09:18:36.804+0000 I SHARDING [conn3332] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:36.804+0000 I SHARDING [conn3345] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:36.804+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:18:46.617+0000 I SHARDING [RangeDeleter] rangeDeleter deleted 5386 documents for mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089ebbe5aec60e69cd13a4') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089f87c5ab960e4fe1f47e') } 2016-03-13T09:18:47.148+0000 I SHARDING [conn1084] updating metadata for mydomain.Sessions from shard version 30652|0||563ba74d869758a4542b9075 to shard version 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:47.148+0000 I SHARDING [conn1084] collection version was loaded at version 30652|1||563ba74d869758a4542b9075, took 10429ms 2016-03-13T09:18:47.148+0000 I COMMAND [conn1084] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('56e52cd0deb5830befdcc538'), a: ObjectId('539aa5c0645cff1ad0779a2a') }, projection: { _id: 1 }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30652|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 } } } protocol:op_command 10429ms 2016-03-13T09:18:47.148+0000 I COMMAND [conn2106] command mydomain.AccountTypes command: find { find: "AccountTypes", filter: { _id: ObjectId('54ee07f10623e75c5804e6dc') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:655 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10429ms 2016-03-13T09:18:47.148+0000 I COMMAND [conn1664] command mydomain.ResolutionTypes command: find { find: "ResolutionTypes", filter: { Platform: 0, ScreenWidth: 375, ScreenHeight: 667 }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { Platform: 1, ScreenHeight: 1, ScreenWidth: 1, DpiGroup: 1 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:325 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10429ms 2016-03-13T09:18:47.148+0000 I COMMAND [conn2200] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('533efb4e645cff1f6c911e5a') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1767 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.148+0000 I COMMAND [conn1721] command mydomain.Apps command: find { find: "Apps", filter: { APIKey: "6665ade62f0341af8cd42837141f48a5" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { APIKey: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1610 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.149+0000 I COMMAND [conn399] command mydomain.ResolutionTypes command: find { find: "ResolutionTypes", filter: { Platform: 1, DpiGroup: 3, ScreenWidth: 720, ScreenHeight: 1184 }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { Platform: 1, ScreenHeight: 1, ScreenWidth: 1, DpiGroup: 1 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:345 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.149+0000 I COMMAND [conn1716] command mydomain.MissingScreenActionImages command: find { find: "MissingScreenActionImages", filter: { LastAttempt: { $lte: new Date(1457857109325) }, Platform: 0, DeviceType: 0, AppVersion: "3.13.0", AppId: ObjectId('533efb4e645cff1f6c911e5a') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppId: 1.0, Platform: 1.0, AppVersion: 1.0, DeviceType: 1.0, LastAttempt: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:235 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.149+0000 I COMMAND [conn1720] command mydomain.Accounts command: find { find: "Accounts", filter: { _id: ObjectId('5211e583645cff16b8589372') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:4458 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.149+0000 I COMMAND [conn966] command mydomain.MissingScreenActionImages command: find { find: "MissingScreenActionImages", filter: { LastAttempt: { $lte: new Date(1457857109322) }, Platform: 0, DeviceType: 0, AppVersion: "4.2.0", AppId: ObjectId('55cb1aa6d5539e19dcc49315') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppId: 1.0, Platform: 1.0, AppVersion: 1.0, DeviceType: 1.0, LastAttempt: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:235 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.149+0000 I COMMAND [conn2179] command mydomain.AccountTypes command: find { find: "AccountTypes", filter: { _id: ObjectId('541e84344daa7c1705933483') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:540 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.148+0000 I COMMAND [conn1224] command mydomain.AccountTypes command: find { find: "AccountTypes", filter: { _id: ObjectId('53b9759690d14a7f7ab95084') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:591 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.150+0000 I COMMAND [conn1743] command mydomain.AccountTypes command: find { find: "AccountTypes", filter: { _id: ObjectId('54ee07f10623e75c5804e6dc') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:655 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.150+0000 I COMMAND [conn1905] command mydomain.DeviceModels command: find { find: "DeviceModels", filter: { DeviceCode: "iPhone5,1" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { DeviceCode: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:381 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.150+0000 I COMMAND [conn3116] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('539aa5c0645cff1ad0779a2a') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1901 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.150+0000 I COMMAND [conn1298] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('539aa5c0645cff1ad0779a2a') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1901 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.150+0000 I COMMAND [conn2072] command mydomain.ResolutionTypes command: find { find: "ResolutionTypes", filter: { Platform: 0, ScreenWidth: 375, ScreenHeight: 667 }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { Platform: 1, ScreenHeight: 1, ScreenWidth: 1, DpiGroup: 1 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:325 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.150+0000 I COMMAND [conn1218] command mydomain.MissingScreenActionImages command: find { find: "MissingScreenActionImages", filter: { LastAttempt: { $lte: new Date(1457857109320) }, Platform: 0, DeviceType: 0, AppVersion: "3.6.8", AppId: ObjectId('5641b508d553a01698b7108d') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppId: 1.0, Platform: 1.0, AppVersion: 1.0, DeviceType: 1.0, LastAttempt: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:235 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10429ms 2016-03-13T09:18:47.150+0000 I COMMAND [conn1860] command mydomain.DeviceModels command: find { find: "DeviceModels", filter: { DeviceCode: "iPad4,2" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { DeviceCode: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:379 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn1168] command mydomain.Funnels command: find { find: "Funnels", filter: { Platform: 0, DeviceType: 0, FunnelStatus: { $in: [ 0, 1, 2, 3 ] }, AppId: ObjectId('533efb4e645cff1f6c911e5a') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppId: 1.0 } keysExamined:36 docsExamined:36 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:7 reslen:3213 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn823] command mydomain.DeviceModels command: find { find: "DeviceModels", filter: { DeviceCode: "Nomi_i503" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { DeviceCode: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:1001 locks:{ Global: { acquireCount: { r: 4 } }, MMAPV1Journal: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { R: 2 } } } protocol:op_command 10429ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn1815] command mydomain.MissingScreenActionImages command: find { find: "MissingScreenActionImages", filter: { LastAttempt: { $lte: new Date(1457857109313) }, Platform: 0, DeviceType: 0, AppVersion: "122", AppId: ObjectId('539aa5c0645cff1ad0779a2a') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppId: 1.0, Platform: 1.0, AppVersion: 1.0, DeviceType: 1.0, LastAttempt: 1.0 } keysExamined:3 docsExamined:3 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:3 reslen:1112 locks:{ Global: { acquireCount: { r: 6 } }, MMAPV1Journal: { acquireCount: { r: 3 } }, Database: { acquireCount: { r: 3 } }, Collection: { acquireCount: { R: 3 } } } protocol:op_command 10432ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn1878] command mydomain.AccountTypes command: find { find: "AccountTypes", filter: { _id: ObjectId('562a20fad5539e0638ee6069') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:580 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn1928] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('55cb1aa6d5539e19dcc49315') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1745 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn1760] command mydomain.ResolutionTypes command: find { find: "ResolutionTypes", filter: { Platform: 1, DpiGroup: 1, ScreenWidth: 320, ScreenHeight: 480 }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { Platform: 1, ScreenHeight: 1, ScreenWidth: 1, DpiGroup: 1 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:343 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn389] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('56333acdd5539e0f04cf3fe4') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1672 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn982] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('539aa5c0645cff1ad0779a2a') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1901 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.152+0000 I COMMAND [conn124] command mydomain.MissingScreenActionImages command: find { find: "MissingScreenActionImages", filter: { LastAttempt: { $lte: new Date(1457857109339) }, Platform: 1, DeviceType: 0, AppVersion: "4.0.1", AppId: ObjectId('55cb1aa6d5539e19dcc49315') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppId: 1.0, Platform: 1.0, AppVersion: 1.0, DeviceType: 1.0, LastAttempt: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:235 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.152+0000 I COMMAND [conn1728] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('54be7a0769eb830158999d2e') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1737 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.151+0000 I COMMAND [conn1739] command mydomain.Apps command: find { find: "Apps", filter: { APIKey: "a949ec567f1e44659e491baaf2ae6f5b" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { APIKey: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1901 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.152+0000 I COMMAND [conn2063] command mydomain.MissingScreenActionImages command: find { find: "MissingScreenActionImages", filter: { LastAttempt: { $lte: new Date(1457857109351) }, Platform: 1, DeviceType: 0, AppVersion: "1.13", AppId: ObjectId('5571bc4dd5539e06f08854c0') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppId: 1.0, Platform: 1.0, AppVersion: 1.0, DeviceType: 1.0, LastAttempt: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:235 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.152+0000 I COMMAND [conn1980] command mydomain.AppUsage command: find { find: "AppUsage", filter: { _id: ObjectId('53ee4aef645cff0148e1ed57') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 9000|0, ObjectId('54c675d032c2781032b65b35') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:374 locks:{ Global: { acquireCount: { r: 4 } }, MMAPV1Journal: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { R: 2 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.152+0000 I COMMAND [conn2040] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('55f7ee69d5539e17a46942b8') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:4641 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.152+0000 I COMMAND [conn3127] command mydomain.Apps command: find { find: "Apps", filter: { _id: ObjectId('54460165645d0523b8d52049') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IDHACK keysExamined:1 docsExamined:1 idhack:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1790 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.152+0000 I COMMAND [conn680] command mydomain.PendingSessions command: find { find: "PendingSessions", filter: { c: ObjectId('56e52ebcdeb5830bf2a2bfb4') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 86000|0, ObjectId('54c775a4509aea9affefdbe4') ] } planSummary: IXSCAN { c: 1.0, _id: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:225 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10427ms 2016-03-13T09:18:47.152+0000 I SHARDING [conn2034] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|1||563ba74d869758a4542b9075, current metadata version is 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:47.153+0000 I COMMAND [conn1863] command mydomain.AppScreens command: find { find: "AppScreens", filter: { _id: { $in: [ ObjectId('56c8fecfc478a165936f92e7'), ObjectId('56c8fecfc478a165936f92e8'), ObjectId('56c8feecc478a165936f9775'), ObjectId('56c8fecfc478a165936f92e8') ] } }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { _id: 1 } keysExamined:5 docsExamined:3 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:3 reslen:37758 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.153+0000 I COMMAND [conn1787] command mydomain.PendingSessions command: find { find: "PendingSessions", filter: { c: ObjectId('562e976743ed5c0e911ca0dd') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 86000|0, ObjectId('54c775a4509aea9affefdbe4') ] } planSummary: IXSCAN { c: 1.0, _id: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:225 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.153+0000 I COMMAND [conn2000] command mydomain.PendingSessions command: find { find: "PendingSessions", filter: { c: ObjectId('56e06f3588d7240bd953e8ca') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 86000|0, ObjectId('54c775a4509aea9affefdbe4') ] } planSummary: IXSCAN { c: 1.0, _id: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:225 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 10428ms 2016-03-13T09:18:47.173+0000 I COMMAND [conn1812] command mydomain.ScreenActions command: find { find: "ScreenActions", filter: { ActionType: 0, AppScreenId: ObjectId('56d807ccc478a1659340ccf8') }, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { AppScreenId: 1.0, ActionType: 1.0, ActionIndex: 1.0 } keysExamined:25 docsExamined:25 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:24 nreturned:25 reslen:105174 locks:{ Global: { acquireCount: { r: 50 } }, MMAPV1Journal: { acquireCount: { r: 25 } }, Database: { acquireCount: { r: 25 } }, Collection: { acquireCount: { R: 25 } } } protocol:op_command 10449ms 2016-03-13T09:18:47.450+0000 I SHARDING [conn1756] metadata of collection mydomain.Sessions already up to date (shard version : 30652|1||563ba74d869758a4542b9075, took 10731ms) 2016-03-13T09:18:47.513+0000 I SHARDING [conn724] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|1||563ba74d869758a4542b9075, current metadata version is 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:47.513+0000 I COMMAND [conn1756] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('56e53023584ad14e9bea0387'), a: ObjectId('55cb1aa6d5539e19dcc49315') }, projection: { _id: 1 }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30652|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 } } } protocol:op_command 10795ms 2016-03-13T09:18:49.017+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.ShardTest { : 3572581960749947492 } -->> { : 4971254716927996603 } 2016-03-13T09:18:49.017+0000 I SHARDING [conn3333] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:49.428+0000 I SHARDING [conn176] received moveChunk request: { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30652000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } 2016-03-13T09:18:49.499+0000 I SHARDING [conn1012] metadata of collection mydomain.Sessions already up to date (shard version : 30652|1||563ba74d869758a4542b9075, took 12781ms) 2016-03-13T09:18:49.637+0000 I SHARDING [conn1790] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|1||563ba74d869758a4542b9075, current metadata version is 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:49.637+0000 I COMMAND [conn1012] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('56e5301f584ad14e99a4f968'), a: ObjectId('55d9971bd553a0187085f298') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30652|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 } } } protocol:op_command 12920ms 2016-03-13T09:18:49.637+0000 I COMMAND [conn1876] command mydomain.Apps command: find { find: "Apps", filter: { APIKey: "a8491f6470c1403ab28c67f5c74d7cf0" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { APIKey: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1771 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 12912ms 2016-03-13T09:18:49.638+0000 I COMMAND [conn1051] command mydomain.Apps command: find { find: "Apps", filter: { APIKey: "3b2cafa256e44ead9ebde2cc4f31b34c" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { APIKey: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1790 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 12912ms 2016-03-13T09:18:49.790+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' acquired for 'migrating chunk [{ a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }) in mydomain.Sessions', ts : 56e530792848c4eacbd013a5 2016-03-13T09:18:49.790+0000 I SHARDING [conn176] remotely refreshing metadata for mydomain.Sessions based on current shard version 30652|1||563ba74d869758a4542b9075, current metadata version is 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:49.949+0000 I SHARDING [conn176] metadata of collection mydomain.Sessions already up to date (shard version : 30652|1||563ba74d869758a4542b9075, took 158ms) 2016-03-13T09:18:49.983+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:49.983+0000-56e530792848c4eacbd013a7", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860729983), what: "moveChunk.start", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, from: "shmydomain1", to: "shmydomain2" } } 2016-03-13T09:18:50.075+0000 I SHARDING [conn176] moveChunk request accepted at version 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:50.102+0000 I SHARDING [conn176] moveChunk number of documents: 5389 2016-03-13T09:18:50.195+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.ShardTest { : 772921417880186793 } -->> { : 2170020934714513131 } 2016-03-13T09:18:50.195+0000 I SHARDING [conn3333] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:50.247+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.249+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.254+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.262+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.287+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.408+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.467+0000 I SHARDING [RangeDeleter] Deleter starting delete for: mydomain.Sessions from { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56089f87c5ab960e4fe1f47e') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('5608a050584ad1621aeeec1f') }, with opId: 770483607 2016-03-13T09:18:50.510+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.671+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:50.935+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:51.482+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:51.660+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.ShardTest { : -619365771742255419 } -->> { : 772921417880186793 } 2016-03-13T09:18:51.660+0000 I SHARDING [conn3333] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:52.541+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:53.107+0000 I SHARDING [conn2034] metadata of collection mydomain.Sessions already up to date (shard version : 30652|1||563ba74d869758a4542b9075, took 5936ms) 2016-03-13T09:18:53.179+0000 I SHARDING [conn3137] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|1||563ba74d869758a4542b9075, current metadata version is 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:53.179+0000 I COMMAND [conn1070] command mydomain.Apps command: find { find: "Apps", filter: { APIKey: "83d6b5326e714be8bcb2bf78786d52ab" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { APIKey: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:4641 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 16453ms 2016-03-13T09:18:53.179+0000 I COMMAND [conn1997] command mydomain.PendingSessions command: find { find: "PendingSessions", filter: { c: ObjectId('56e5259cdeb5830befdc3411') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 86000|0, ObjectId('54c775a4509aea9affefdbe4') ] } planSummary: IXSCAN { c: 1.0, _id: 1.0 } keysExamined:0 docsExamined:0 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:225 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 16453ms 2016-03-13T09:18:53.182+0000 I COMMAND [conn2034] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('560088b76ff3fa50bc464ebf'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30652|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 }, acquireWaitCount: { R: 1, W: 1 }, timeAcquiringMicros: { R: 3572, W: 18679 } } } protocol:op_command 16457ms 2016-03-13T09:18:53.566+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:54.599+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:54.905+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.ShardTest { : 6364950480325397030 } -->> { : 7760453691830818353 } 2016-03-13T09:18:54.905+0000 I SHARDING [conn3333] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:55.210+0000 I SHARDING [LockPinger] cluster in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019 pinged successfully at 2016-03-13T09:18:54.872+0000 by distributed lock pinger 'in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019/ip-10-0-163-109:27017:1457539529:-252000331', sleeping for 30000ms 2016-03-13T09:18:55.360+0000 I SHARDING [conn724] metadata of collection mydomain.Sessions already up to date (shard version : 30652|1||563ba74d869758a4542b9075, took 7845ms) 2016-03-13T09:18:55.423+0000 I SHARDING [conn2256] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|1||563ba74d869758a4542b9075, current metadata version is 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:55.424+0000 I COMMAND [conn724] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('55f6e5e4a21c0f117cc9287d'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30652|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 }, acquireWaitCount: { R: 1, W: 1 }, timeAcquiringMicros: { R: 861, W: 2141 } } } protocol:op_command 18699ms 2016-03-13T09:18:55.623+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 1503, clonedBytes: 3081615, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:56.648+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "clone", counts: { cloned: 4449, clonedBytes: 12865679, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:57.673+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "catchup", counts: { cloned: 5389, clonedBytes: 18614865, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:57.861+0000 I SHARDING [conn1790] metadata of collection mydomain.Sessions already up to date (shard version : 30652|1||563ba74d869758a4542b9075, took 8212ms) 2016-03-13T09:18:57.935+0000 I SHARDING [conn3271] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30652|1||563ba74d869758a4542b9075, current metadata version is 30652|1||563ba74d869758a4542b9075 2016-03-13T09:18:57.936+0000 I COMMAND [conn1790] command mydomain.Sessions command: find { find: "Sessions", filter: { a: ObjectId('55b65c23d553a214f489b71f'), cs: { $gt: 133 }, c: ObjectId('5639c389ce7c830eb5f00b63') }, projection: { $sortKey: { $meta: "sortKey" } }, sort: { cs: 1 }, hint: { c: 1, cs: 1 }, ntoreturn: 5, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30652|1||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 2, w: 2 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 10864 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 }, acquireWaitCount: { R: 1, W: 1 }, timeAcquiringMicros: { R: 641, W: 22 } } } protocol:op_command 21210ms 2016-03-13T09:18:58.401+0000 I SHARDING [conn3333] request split points lookup for chunk mydomain.ShardTest { : 4971254716927996603 } -->> { : 6364950480325397030 } 2016-03-13T09:18:58.401+0000 I SHARDING [conn3333] limiting split vector to 250000 (from 349525) objects 2016-03-13T09:18:58.697+0000 I SHARDING [conn176] moveChunk data transfer progress: { active: true, sessionId: "shmydomain1_shmydomain2_56e5307a2848c4eacbd013a8", ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "steady", counts: { cloned: 5389, clonedBytes: 18614865, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 2016-03-13T09:18:58.698+0000 I SHARDING [conn176] About to check if it is safe to enter critical section 2016-03-13T09:18:58.733+0000 I SHARDING [conn176] About to enter migrate critical section 2016-03-13T09:18:59.018+0000 I SHARDING [conn176] moveChunk setting version to: 30653|0||563ba74d869758a4542b9075 2016-03-13T09:18:59.077+0000 I SHARDING [conn176] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, shardKeyPattern: { a: 1.0, _id: 1.0 }, state: "done", counts: { cloned: 5389, clonedBytes: 18614865, catchup: 0, steady: 0 }, ok: 1.0 } 2016-03-13T09:18:59.077+0000 I SHARDING [conn176] moveChunk updating self version to: 30653|1||563ba74d869758a4542b9075 through { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') } -> { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56347277a2a4330ea42577f3') } for collection 'mydomain.Sessions' 2016-03-13T09:18:59.300+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:59.300+0000-56e530832848c4eacbd013a9", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860739300), what: "moveChunk.commit", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, from: "shmydomain1", to: "shmydomain2", cloned: 5389, clonedBytes: 18614865, catchup: 0, steady: 0 } } 2016-03-13T09:18:59.348+0000 I SHARDING [conn176] MigrateFromStatus::done About to acquire global lock to exit critical section 2016-03-13T09:18:59.354+0000 I SHARDING [conn176] forking for cleanup of chunk data 2016-03-13T09:18:59.354+0000 I SHARDING [conn176] about to log metadata event into changelog: { _id: "ip-10-0-163-109-2016-03-13T09:18:59.354+0000-56e530832848c4eacbd013aa", server: "ip-10-0-163-109", clientAddr: "10.0.231.121:56185", time: new Date(1457860739354), what: "moveChunk.from", ns: "mydomain.Sessions", details: { min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, step 1 of 6: 0, step 2 of 6: 646, step 3 of 6: 130, step 4 of 6: 8492, step 5 of 6: 656, step 6 of 6: 0, to: "shmydomain2", from: "shmydomain1", note: "success" } } 2016-03-13T09:18:59.616+0000 I SHARDING [conn176] distributed lock 'mydomain.Sessions/ip-10-0-163-109:27017:1457539529:-252000331' unlocked. 2016-03-13T09:18:59.616+0000 I COMMAND [conn176] command admin.$cmd command: moveChunk { moveChunk: "mydomain.Sessions", from: "rsmydomain/in.db1m1.mongo323.test.mydomain.com:27017,in.db1m2.mongo323.test.mydomain.com:27017", to: "rsmydomain2/in.db2m1.mongo323.test.mydomain.com:27017,in.db2m2.mongo323.test.mydomain.com:27017", fromShard: "shmydomain1", toShard: "shmydomain2", min: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346a2a55418c0ec59aacce') }, max: { a: ObjectId('533efb4e645cff1f6c911e5a'), _id: ObjectId('56346e2d55418c0ec59b2587') }, maxChunkSizeBytes: 67108864, configdb: "in.dbcfg1.mongo323.test.mydomain.com:27019,in.dbcfg2.mongo323.test.mydomain.com:27019,in.dbcfg3.mongo323.test.mydomain.com:27019", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0, shardVersion: [ Timestamp 30652000|1, ObjectId('563ba74d869758a4542b9075') ], epoch: ObjectId('563ba74d869758a4542b9075') } keyUpdates:0 writeConflicts:0 numYields:42 reslen:134 locks:{ Global: { acquireCount: { r: 92, w: 2, R: 2 }, acquireWaitCount: { R: 1 }, timeAcquiringMicros: { R: 5353 } }, MMAPV1Journal: { acquireCount: { r: 46, w: 3 } }, Database: { acquireCount: { r: 44, w: 2 } }, Collection: { acquireCount: { R: 44, W: 2 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1407 } } } protocol:op_command 10198ms 2016-03-13T09:19:00.455+0000 I SHARDING [conn3332] request split points lookup for chunk mydomain.RetentionZeroReports { : ObjectId('552d0fbd69eb8504a4eb8c65'), : new Date(1439164800000), : MinKey, : MinKey } -->> { : ObjectId('5652e983d5539e0fa4ccca2b'), : new Date(1448236800000), : MinKey, : MinKey } 2016-03-13T09:19:02.488+0000 I SHARDING [conn3137] metadata of collection mydomain.Sessions already up to date (shard version : 30653|0||563ba74d869758a4542b9075, took 9305ms) 2016-03-13T09:19:02.559+0000 I SHARDING [conn553] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30653|0||563ba74d869758a4542b9075, current metadata version is 30653|0||563ba74d869758a4542b9075 2016-03-13T09:19:02.560+0000 I COMMAND [conn3137] command mydomain.Sessions command: find { find: "Sessions", filter: { _id: ObjectId('55c5d4b4584ad153a9706997'), a: ObjectId('554cd0f9d5539e16b4ec4546') }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } keyUpdates:0 writeConflicts:0 exception: [mydomain.Sessions] shard version not ok: version epoch mismatch detected for mydomain.Sessions, the collection may have been dropped and recreated ( ns : mydomain.Sessions, received : 0|0||000000000000000000000000, wanted : 30653|0||563ba74d869758a4542b9075, send ) code:13388 numYields:0 reslen:463 locks:{ Global: { acquireCount: { r: 3, w: 1 } }, MMAPV1Journal: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { r: 1, w: 1 } }, Collection: { acquireCount: { R: 1, W: 1 }, acquireWaitCount: { R: 1, W: 1 }, timeAcquiringMicros: { R: 928, W: 3420 } } } protocol:op_command 25834ms 2016-03-13T09:19:03.162+0000 W SHARDING [conn2256] invalid chunks found when reloading mydomain.Sessions, previous version was 30653|1||563ba74d869758a4542b9075, this should be rare 2016-03-13T09:19:03.243+0000 W SHARDING [conn2256] could not remotely refresh metadata for mydomain.Sessions :: caused by :: invalid chunks found when reloading mydomain.Sessions, previous version was 30653|1||563ba74d869758a4542b9075, this should be rare 2016-03-13T09:19:03.243+0000 I SHARDING [conn555] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30653|0||563ba74d869758a4542b9075, current metadata version is 30653|0||563ba74d869758a4542b9075 2016-03-13T09:19:03.244+0000 I COMMAND [conn2256] command mydomain.Sessions command: insert { insert: "Sessions", documents: [ { ci: 1427874.0, co: 1, an: 1, io: 1, av: "129", cs: 14, if: [ 0, 0, 375, 667 ], lc: "en-IN", lo: { cc: "IN", d: "Raipur Uttarakhand" }, nv: 3, dc: "iPhone8,1", dt: 0, du: 19167, a: ObjectId('539aa5c0645cff1ad0779a2a'), c: ObjectId('56cf54e92851f15711673c3c'), sw: 375, sv: "2.1.5", st: new Date(1457196577126), p: 0, sh: 667, sn: 6, sc: [ { ac: [], du: 201, gs: [], si: ObjectId('56b0539ee737ac6c8d865706'), st: 0 }, { ac: [], du: 3400, gs: [ { et: 3149, r: true, t: 0, st: 3135 } ], si: ObjectId('56b0539ee737ac6c8d86570a'), st: 201 }, { ac: [], du: 2000, gs: [ { et: 5116, r: true, t: 0, st: 5101 } ], si: ObjectId('56b071e4e737ac6c8d880dc3'), st: 3601 }, { ac: [ { a: ObjectId('5476cf02761bd07e9fa4c550'), b: [ 15, 537, 345, 48 ], d: "searchFlights:", i: "26", p: "Search flights", s: 6833, u: true, t: 0 } ], du: 1369, gs: [ { et: 6833, r: true, t: 0, st: 6802 } ], si: ObjectId('56b071e4e737ac6c8d880dc7'), st: 5601 }, { ac: [], du: 11831, gs: [], si: ObjectId('56b07769e737ac6c8d885fd1'), st: 6970 }, { ac: [], du: 366, gs: [], si: ObjectId('56b07839e737ac6c8d886b47'), st: 18801 } ], _id: ObjectId('56db0e217cf4010bf1e34afd'), os: "9.2.1" } ], ordered: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } ninserted:0 keyUpdates:0 writeConflicts:0 exception: stale shard version detected before write, received 0|0||000000000000000000000000 but local version is 30652|0||563ba74d869758a4542b9075 code:63 numYields:0 reslen:470 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, MMAPV1Journal: { acquireCount: { w: 2 } }, Database: { acquireCount: { w: 1 } }, Collection: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1682 } } } protocol:op_command 26519ms 2016-03-13T09:19:04.341+0000 W SHARDING [conn3271] invalid chunks found when reloading mydomain.Sessions, previous version was 30653|1||563ba74d869758a4542b9075, this should be rare 2016-03-13T09:19:04.430+0000 W SHARDING [conn3271] could not remotely refresh metadata for mydomain.Sessions :: caused by :: invalid chunks found when reloading mydomain.Sessions, previous version was 30653|1||563ba74d869758a4542b9075, this should be rare 2016-03-13T09:19:04.477+0000 I SHARDING [conn3274] remotely refreshing metadata for mydomain.Sessions with requested shard version 0|0||000000000000000000000000, current shard version is 30653|0||563ba74d869758a4542b9075, current metadata version is 30653|0||563ba74d869758a4542b9075 2016-03-13T09:19:04.477+0000 I COMMAND [conn3271] command mydomain.Sessions command: insert { insert: "Sessions", documents: [ { ci: 521425, co: 2, ai: "pm5099174 / 85920236641211639", ce: [ { t: 0, n: "DepositorSession" }, { t: 1410, n: "ChatFormGlobalRoomTab" }, { t: 1430, n: "ChatFormEntireAllianceRoomTab" }, { t: 3037, n: "ChatFormTrueAllianceRoomTab" }, { t: 9348, n: "DailyQuestsFormSimpleQuestsTab" }, { t: 17894, n: "DailyQuestsFormClanQuestsTab" } ], an: 0, io: 3, av: "4.3.2", cs: 38, if: [ 0, 0, 1080, 1920 ], lc: "fr-FR", lo: { cc: "FR", d: "Vitry-Sur-Seine Ile-De-France" }, nv: 0, di: "G928FXXU2APA2", dc: "SM-G928F", dt: 0, du: 54636, a: ObjectId('55f7ee69d5539e17a46942b8'), c: ObjectId('56d1aa647a37b26455c91671'), sw: 1080, sv: "2.1.3gl", st: new Date(1456652113498), p: 1, sh: 1920, sn: 4, sc: [ { ac: [], du: 1, gs: [], si: ObjectId('56c5cc41c478a16593455ece'), st: 0 }, { ac: [], du: 1428, gs: [ { et: 1308, r: false, t: 0, st: 1305 } ], si: ObjectId('56c5cc41c478a16593455ecf'), st: 1 }, { ac: [], du: 7928, gs: [ { et: 3022, r: false, t: 0, st: 2987 }, { et: 8202, r: false, t: 0, st: 8162 }, { et: 9342, r: false, t: 0, st: 9251 } ], si: ObjectId('56c5cc41c478a16593455ed2'), st: 1429 }, { ac: [], du: 45279, gs: [ { et: 11252, r: false, t: 0, st: 11179 }, { et: 13991, r: false, t: 0, st: 13945 }, { et: 16583, r: false, t: 0, st: 16544 }, { et: 17876, r: false, t: 0, st: 17843 }, { et: 19507, r: false, t: 0, st: 19466 }, { et: 22265, r: false, t: 0, st: 22190 }, { et: 24586, r: false, t: 0, st: 24569 } ], si: ObjectId('56c5df92c478a16593467d68'), st: 9357 } ], _id: ObjectId('56d2bf51fb252352e92e62ee'), os: "5.1.1" } ], ordered: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } ninserted:0 keyUpdates:0 writeConflicts:0 exception: stale shard version detected before write, received 0|0||000000000000000000000000 but local version is 30652|0||563ba74d869758a4542b9075 code:63 numYields:0 reslen:470 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, MMAPV1Journal: { acquireCount: { w: 2 } }, Database: { acquireCount: { w: 1 } }, Collection: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1327 } } } protocol:op_command 27753ms 2016-03-13T09:19:04.477+0000 I COMMAND [conn2009] command mydomain.Apps command: find { find: "Apps", filter: { APIKey: "a949ec567f1e44659e491baaf2ae6f5b" }, limit: 1, singleBatch: true, shardVersion: [ Timestamp 0|0, ObjectId('000000000000000000000000') ] } planSummary: IXSCAN { APIKey: 1.0 } keysExamined:1 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:1901 locks:{ Global: { acquireCount: { r: 2 } }, MMAPV1Journal: { acquireCount: { r: 1 } }, Database: { acquireCount: { r: 1 } }, Collection: { acquireCount: { R: 1 } } } protocol:op_command 27751ms ^C [ec2-user@ip-10-0-163-109 ~]$