Thu Mar 7 08:45:24 [conn82] end connection 127.0.0.1:42533 (0 connections now open) MongoDB shell version: 2.2.4-pre- null Replica set test! ReplSetTest Starting Set ReplSetTest n is : 0 ReplSetTest n: 0 ports: [ 31100, 31101 ] 31100 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31100, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "remove2-rs0", "dbpath" : "$set-$node", "useHostname" : true, "noJournalPrealloc" : undefined, "pathOpts" : { "testName" : "remove2", "shard" : 0, "node" : 0, "set" : "remove2-rs0" }, "restart" : undefined } ReplSetTest Starting.... Resetting db path '/data/db/remove2-rs0-0' Thu Mar 7 08:45:24 shell: started program /mnt/slaves/Linux_32bit_V2.2/mongo/mongod --oplogSize 40 --port 31100 --noprealloc --smallfiles --rest --replSet remove2-rs0 --dbpath /data/db/remove2-rs0-0 m31100| note: noprealloc may hurt performance in many applications m31100| Thu Mar 7 08:45:24 m31100| Thu Mar 7 08:45:24 warning: 32-bit servers don't have journaling enabled by default. Please use --journal if you want durability. m31100| Thu Mar 7 08:45:24 m31100| Thu Mar 7 08:45:25 [initandlisten] MongoDB starting : pid=27603 port=31100 dbpath=/data/db/remove2-rs0-0 32-bit host=bs-linux32.10gen.cc m31100| Thu Mar 7 08:45:25 [initandlisten] m31100| Thu Mar 7 08:45:25 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data m31100| Thu Mar 7 08:45:25 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations m31100| Thu Mar 7 08:45:25 [initandlisten] ** with --journal, the limit is lower m31100| Thu Mar 7 08:45:25 [initandlisten] m31100| Thu Mar 7 08:45:25 [initandlisten] db version v2.2.4-pre-, pdfile version 4.5 m31100| Thu Mar 7 08:45:25 [initandlisten] git version: 379bee085f2d8bd71c136a5aa136aef2b3da80ed m31100| Thu Mar 7 08:45:25 [initandlisten] build info: Linux bs-linux32.10gen.cc 2.6.21.7-2.fc8xen #1 SMP Fri Feb 15 12:39:36 EST 2008 i686 BOOST_LIB_VERSION=1_49 m31100| Thu Mar 7 08:45:25 [initandlisten] options: { dbpath: "/data/db/remove2-rs0-0", noprealloc: true, oplogSize: 40, port: 31100, replSet: "remove2-rs0", rest: true, smallfiles: true } m31100| Thu Mar 7 08:45:25 [initandlisten] Unable to check for journal files due to: boost::filesystem::basic_directory_iterator constructor: No such file or directory: "/data/db/remove2-rs0-0/journal" m31100| Thu Mar 7 08:45:25 [initandlisten] waiting for connections on port 31100 m31100| Thu Mar 7 08:45:25 [websvr] admin web console waiting for connections on port 32100 m31100| Thu Mar 7 08:45:25 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31100| Thu Mar 7 08:45:25 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done [ connection to bs-linux32.10gen.cc:31100 ] ReplSetTest n is : 1 ReplSetTest n: 1 ports: [ 31100, 31101 ] 31101 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31101, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "remove2-rs0", "dbpath" : "$set-$node", "useHostname" : true, "noJournalPrealloc" : undefined, "pathOpts" : { "testName" : "remove2", "shard" : 0, "node" : 1, "set" : "remove2-rs0" }, "restart" : undefined } ReplSetTest Starting.... Resetting db path '/data/db/remove2-rs0-1' m31100| Thu Mar 7 08:45:25 [initandlisten] connection accepted from 127.0.0.1:40875 #1 (1 connection now open) Thu Mar 7 08:45:25 shell: started program /mnt/slaves/Linux_32bit_V2.2/mongo/mongod --oplogSize 40 --port 31101 --noprealloc --smallfiles --rest --replSet remove2-rs0 --dbpath /data/db/remove2-rs0-1 m31101| note: noprealloc may hurt performance in many applications m31101| Thu Mar 7 08:45:25 m31101| Thu Mar 7 08:45:25 warning: 32-bit servers don't have journaling enabled by default. Please use --journal if you want durability. m31101| Thu Mar 7 08:45:25 m31101| Thu Mar 7 08:45:25 [initandlisten] MongoDB starting : pid=27621 port=31101 dbpath=/data/db/remove2-rs0-1 32-bit host=bs-linux32.10gen.cc m31101| Thu Mar 7 08:45:25 [initandlisten] m31101| Thu Mar 7 08:45:25 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data m31101| Thu Mar 7 08:45:25 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations m31101| Thu Mar 7 08:45:25 [initandlisten] ** with --journal, the limit is lower m31101| Thu Mar 7 08:45:25 [initandlisten] m31101| Thu Mar 7 08:45:25 [initandlisten] db version v2.2.4-pre-, pdfile version 4.5 m31101| Thu Mar 7 08:45:25 [initandlisten] git version: 379bee085f2d8bd71c136a5aa136aef2b3da80ed m31101| Thu Mar 7 08:45:25 [initandlisten] build info: Linux bs-linux32.10gen.cc 2.6.21.7-2.fc8xen #1 SMP Fri Feb 15 12:39:36 EST 2008 i686 BOOST_LIB_VERSION=1_49 m31101| Thu Mar 7 08:45:25 [initandlisten] options: { dbpath: "/data/db/remove2-rs0-1", noprealloc: true, oplogSize: 40, port: 31101, replSet: "remove2-rs0", rest: true, smallfiles: true } m31101| Thu Mar 7 08:45:25 [initandlisten] Unable to check for journal files due to: boost::filesystem::basic_directory_iterator constructor: No such file or directory: "/data/db/remove2-rs0-1/journal" m31101| Thu Mar 7 08:45:25 [websvr] admin web console waiting for connections on port 32101 m31101| Thu Mar 7 08:45:25 [initandlisten] waiting for connections on port 31101 m31101| Thu Mar 7 08:45:25 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31101| Thu Mar 7 08:45:25 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done [ connection to bs-linux32.10gen.cc:31100, connection to bs-linux32.10gen.cc:31101 ] { "replSetInitiate" : { "_id" : "remove2-rs0", "members" : [ { "_id" : 0, "host" : "bs-linux32.10gen.cc:31100" }, { "_id" : 1, "host" : "bs-linux32.10gen.cc:31101" } ] } } m31100| Thu Mar 7 08:45:25 [conn1] replSet replSetInitiate admin command received from client m31100| Thu Mar 7 08:45:25 [conn1] replSet replSetInitiate config object parses ok, 2 members specified m31101| Thu Mar 7 08:45:25 [initandlisten] connection accepted from 127.0.0.1:36663 #1 (1 connection now open) m31101| Thu Mar 7 08:45:25 [initandlisten] connection accepted from 10.255.119.66:58007 #2 (2 connections now open) m31100| Thu Mar 7 08:45:25 [conn1] replSet replSetInitiate all members seem up m31100| Thu Mar 7 08:45:25 [conn1] ****** m31100| Thu Mar 7 08:45:25 [conn1] creating replication oplog of size: 40MB... m31100| Thu Mar 7 08:45:25 [FileAllocator] allocating new datafile /data/db/remove2-rs0-0/local.ns, filling with zeroes... m31100| Thu Mar 7 08:45:25 [FileAllocator] creating directory /data/db/remove2-rs0-0/_tmp m31100| Thu Mar 7 08:45:25 [FileAllocator] done allocating datafile /data/db/remove2-rs0-0/local.ns, size: 16MB, took 0.24 secs m31100| Thu Mar 7 08:45:25 [FileAllocator] allocating new datafile /data/db/remove2-rs0-0/local.0, filling with zeroes... m31100| Thu Mar 7 08:45:26 [FileAllocator] done allocating datafile /data/db/remove2-rs0-0/local.0, size: 64MB, took 1.119 secs m31100| Thu Mar 7 08:45:26 [conn1] ****** m31100| Thu Mar 7 08:45:26 [conn1] replSet info saving a newer config version to local.system.replset m31100| Thu Mar 7 08:45:26 [conn1] replSet saveConfigLocally done m31100| Thu Mar 7 08:45:26 [conn1] replSet replSetInitiate config now saved locally. Should come online in about a minute. m31100| Thu Mar 7 08:45:26 [conn1] command admin.$cmd command: { replSetInitiate: { _id: "remove2-rs0", members: [ { _id: 0.0, host: "bs-linux32.10gen.cc:31100" }, { _id: 1.0, host: "bs-linux32.10gen.cc:31101" } ] } } ntoreturn:1 keyUpdates:0 locks(micros) W:1408226 reslen:112 1413ms { "info" : "Config now saved locally. Should come online in about a minute.", "ok" : 1 } Replica set test! ReplSetTest Starting Set ReplSetTest n is : 0 ReplSetTest n: 0 ports: [ 31200, 31201 ] 31200 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31200, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "remove2-rs1", "dbpath" : "$set-$node", "useHostname" : true, "noJournalPrealloc" : undefined, "pathOpts" : { "testName" : "remove2", "shard" : 1, "node" : 0, "set" : "remove2-rs1" }, "restart" : undefined } ReplSetTest Starting.... Resetting db path '/data/db/remove2-rs1-0' Thu Mar 7 08:45:26 shell: started program /mnt/slaves/Linux_32bit_V2.2/mongo/mongod --oplogSize 40 --port 31200 --noprealloc --smallfiles --rest --replSet remove2-rs1 --dbpath /data/db/remove2-rs1-0 m31200| note: noprealloc may hurt performance in many applications m31200| Thu Mar 7 08:45:26 m31200| Thu Mar 7 08:45:26 warning: 32-bit servers don't have journaling enabled by default. Please use --journal if you want durability. m31200| Thu Mar 7 08:45:26 m31200| Thu Mar 7 08:45:26 [initandlisten] MongoDB starting : pid=27641 port=31200 dbpath=/data/db/remove2-rs1-0 32-bit host=bs-linux32.10gen.cc m31200| Thu Mar 7 08:45:26 [initandlisten] m31200| Thu Mar 7 08:45:26 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data m31200| Thu Mar 7 08:45:26 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations m31200| Thu Mar 7 08:45:26 [initandlisten] ** with --journal, the limit is lower m31200| Thu Mar 7 08:45:26 [initandlisten] m31200| Thu Mar 7 08:45:26 [initandlisten] db version v2.2.4-pre-, pdfile version 4.5 m31200| Thu Mar 7 08:45:26 [initandlisten] git version: 379bee085f2d8bd71c136a5aa136aef2b3da80ed m31200| Thu Mar 7 08:45:26 [initandlisten] build info: Linux bs-linux32.10gen.cc 2.6.21.7-2.fc8xen #1 SMP Fri Feb 15 12:39:36 EST 2008 i686 BOOST_LIB_VERSION=1_49 m31200| Thu Mar 7 08:45:26 [initandlisten] options: { dbpath: "/data/db/remove2-rs1-0", noprealloc: true, oplogSize: 40, port: 31200, replSet: "remove2-rs1", rest: true, smallfiles: true } m31200| Thu Mar 7 08:45:26 [initandlisten] Unable to check for journal files due to: boost::filesystem::basic_directory_iterator constructor: No such file or directory: "/data/db/remove2-rs1-0/journal" m31200| Thu Mar 7 08:45:26 [websvr] admin web console waiting for connections on port 32200 m31200| Thu Mar 7 08:45:26 [initandlisten] waiting for connections on port 31200 m31200| Thu Mar 7 08:45:26 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31200| Thu Mar 7 08:45:26 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done [ connection to bs-linux32.10gen.cc:31200 ] ReplSetTest n is : 1 ReplSetTest n: 1 ports: [ 31200, 31201 ] 31201 number { "useHostName" : true, "oplogSize" : 40, "keyFile" : undefined, "port" : 31201, "noprealloc" : "", "smallfiles" : "", "rest" : "", "replSet" : "remove2-rs1", "dbpath" : "$set-$node", "useHostname" : true, "noJournalPrealloc" : undefined, "pathOpts" : { "testName" : "remove2", "shard" : 1, "node" : 1, "set" : "remove2-rs1" }, "restart" : undefined } ReplSetTest Starting.... Resetting db path '/data/db/remove2-rs1-1' m31200| Thu Mar 7 08:45:27 [initandlisten] connection accepted from 127.0.0.1:46938 #1 (1 connection now open) Thu Mar 7 08:45:27 shell: started program /mnt/slaves/Linux_32bit_V2.2/mongo/mongod --oplogSize 40 --port 31201 --noprealloc --smallfiles --rest --replSet remove2-rs1 --dbpath /data/db/remove2-rs1-1 m31201| note: noprealloc may hurt performance in many applications m31201| Thu Mar 7 08:45:27 m31201| Thu Mar 7 08:45:27 warning: 32-bit servers don't have journaling enabled by default. Please use --journal if you want durability. m31201| Thu Mar 7 08:45:27 m31201| Thu Mar 7 08:45:27 [initandlisten] MongoDB starting : pid=27659 port=31201 dbpath=/data/db/remove2-rs1-1 32-bit host=bs-linux32.10gen.cc m31201| Thu Mar 7 08:45:27 [initandlisten] m31201| Thu Mar 7 08:45:27 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data m31201| Thu Mar 7 08:45:27 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations m31201| Thu Mar 7 08:45:27 [initandlisten] ** with --journal, the limit is lower m31201| Thu Mar 7 08:45:27 [initandlisten] m31201| Thu Mar 7 08:45:27 [initandlisten] db version v2.2.4-pre-, pdfile version 4.5 m31201| Thu Mar 7 08:45:27 [initandlisten] git version: 379bee085f2d8bd71c136a5aa136aef2b3da80ed m31201| Thu Mar 7 08:45:27 [initandlisten] build info: Linux bs-linux32.10gen.cc 2.6.21.7-2.fc8xen #1 SMP Fri Feb 15 12:39:36 EST 2008 i686 BOOST_LIB_VERSION=1_49 m31201| Thu Mar 7 08:45:27 [initandlisten] options: { dbpath: "/data/db/remove2-rs1-1", noprealloc: true, oplogSize: 40, port: 31201, replSet: "remove2-rs1", rest: true, smallfiles: true } m31201| Thu Mar 7 08:45:27 [initandlisten] Unable to check for journal files due to: boost::filesystem::basic_directory_iterator constructor: No such file or directory: "/data/db/remove2-rs1-1/journal" m31201| Thu Mar 7 08:45:27 [initandlisten] waiting for connections on port 31201 m31201| Thu Mar 7 08:45:27 [websvr] admin web console waiting for connections on port 32201 m31201| Thu Mar 7 08:45:27 [rsStart] replSet can't get local.system.replset config from self or any seed (EMPTYCONFIG) m31201| Thu Mar 7 08:45:27 [rsStart] replSet info you may need to run replSetInitiate -- rs.initiate() in the shell -- if that is not already done [ connection to bs-linux32.10gen.cc:31200, connection to bs-linux32.10gen.cc:31201 ] { "replSetInitiate" : { "_id" : "remove2-rs1", "members" : [ { "_id" : 0, "host" : "bs-linux32.10gen.cc:31200" }, { "_id" : 1, "host" : "bs-linux32.10gen.cc:31201" } ] } } m31200| Thu Mar 7 08:45:27 [conn1] replSet replSetInitiate admin command received from client m31200| Thu Mar 7 08:45:27 [conn1] replSet replSetInitiate config object parses ok, 2 members specified m31201| Thu Mar 7 08:45:27 [initandlisten] connection accepted from 127.0.0.1:46873 #1 (1 connection now open) m31201| Thu Mar 7 08:45:27 [initandlisten] connection accepted from 10.255.119.66:43951 #2 (2 connections now open) m31200| Thu Mar 7 08:45:27 [conn1] replSet replSetInitiate all members seem up m31200| Thu Mar 7 08:45:27 [conn1] ****** m31200| Thu Mar 7 08:45:27 [conn1] creating replication oplog of size: 40MB... m31200| Thu Mar 7 08:45:27 [FileAllocator] allocating new datafile /data/db/remove2-rs1-0/local.ns, filling with zeroes... m31200| Thu Mar 7 08:45:27 [FileAllocator] creating directory /data/db/remove2-rs1-0/_tmp m31200| Thu Mar 7 08:45:27 [FileAllocator] done allocating datafile /data/db/remove2-rs1-0/local.ns, size: 16MB, took 0.223 secs m31200| Thu Mar 7 08:45:27 [FileAllocator] allocating new datafile /data/db/remove2-rs1-0/local.0, filling with zeroes... m31200| Thu Mar 7 08:45:28 [FileAllocator] done allocating datafile /data/db/remove2-rs1-0/local.0, size: 64MB, took 1.115 secs m31200| Thu Mar 7 08:45:28 [conn1] ****** m31200| Thu Mar 7 08:45:28 [conn1] replSet info saving a newer config version to local.system.replset m31200| Thu Mar 7 08:45:28 [conn1] replSet saveConfigLocally done m31200| Thu Mar 7 08:45:28 [conn1] replSet replSetInitiate config now saved locally. Should come online in about a minute. m31200| Thu Mar 7 08:45:28 [conn1] command admin.$cmd command: { replSetInitiate: { _id: "remove2-rs1", members: [ { _id: 0.0, host: "bs-linux32.10gen.cc:31200" }, { _id: 1.0, host: "bs-linux32.10gen.cc:31201" } ] } } ntoreturn:1 keyUpdates:0 locks(micros) W:1379692 reslen:112 1383ms { "info" : "Config now saved locally. Should come online in about a minute.", "ok" : 1 } m31100| Thu Mar 7 08:45:35 [rsStart] replSet I am bs-linux32.10gen.cc:31100 m31100| Thu Mar 7 08:45:35 [rsStart] replSet STARTUP2 m31100| Thu Mar 7 08:45:35 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote m31100| Thu Mar 7 08:45:35 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31101 is up m31101| Thu Mar 7 08:45:35 [rsStart] trying to contact bs-linux32.10gen.cc:31100 m31100| Thu Mar 7 08:45:35 [initandlisten] connection accepted from 10.255.119.66:40313 #2 (2 connections now open) m31101| Thu Mar 7 08:45:35 [rsStart] replSet I am bs-linux32.10gen.cc:31101 m31101| Thu Mar 7 08:45:35 [rsStart] replSet got config version 1 from a remote, saving locally m31101| Thu Mar 7 08:45:35 [rsStart] replSet info saving a newer config version to local.system.replset m31101| Thu Mar 7 08:45:35 [FileAllocator] allocating new datafile /data/db/remove2-rs0-1/local.ns, filling with zeroes... m31101| Thu Mar 7 08:45:35 [FileAllocator] creating directory /data/db/remove2-rs0-1/_tmp m31101| Thu Mar 7 08:45:35 [FileAllocator] done allocating datafile /data/db/remove2-rs0-1/local.ns, size: 16MB, took 0.213 secs m31101| Thu Mar 7 08:45:35 [FileAllocator] allocating new datafile /data/db/remove2-rs0-1/local.0, filling with zeroes... m31101| Thu Mar 7 08:45:35 [FileAllocator] done allocating datafile /data/db/remove2-rs0-1/local.0, size: 16MB, took 0.266 secs m31101| Thu Mar 7 08:45:35 [rsStart] replSet saveConfigLocally done m31101| Thu Mar 7 08:45:35 [rsStart] replSet STARTUP2 m31101| Thu Mar 7 08:45:35 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote m31101| Thu Mar 7 08:45:35 [rsSync] ****** m31101| Thu Mar 7 08:45:35 [rsSync] creating replication oplog of size: 40MB... m31101| Thu Mar 7 08:45:35 [FileAllocator] allocating new datafile /data/db/remove2-rs0-1/local.1, filling with zeroes... m31100| Thu Mar 7 08:45:36 [rsSync] replSet SECONDARY m31101| Thu Mar 7 08:45:36 [FileAllocator] done allocating datafile /data/db/remove2-rs0-1/local.1, size: 64MB, took 1.121 secs m31101| Thu Mar 7 08:45:36 [rsSync] ****** m31101| Thu Mar 7 08:45:36 [rsSync] replSet initial sync pending m31101| Thu Mar 7 08:45:36 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync m31200| Thu Mar 7 08:45:36 [rsStart] replSet I am bs-linux32.10gen.cc:31200 m31200| Thu Mar 7 08:45:36 [rsStart] replSet STARTUP2 m31200| Thu Mar 7 08:45:36 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31201 is up m31200| Thu Mar 7 08:45:36 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote m31100| Thu Mar 7 08:45:37 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31101 is now in state STARTUP2 m31100| Thu Mar 7 08:45:37 [rsMgr] not electing self, bs-linux32.10gen.cc:31101 would veto m31201| Thu Mar 7 08:45:37 [rsStart] trying to contact bs-linux32.10gen.cc:31200 m31200| Thu Mar 7 08:45:37 [initandlisten] connection accepted from 10.255.119.66:58682 #2 (2 connections now open) m31201| Thu Mar 7 08:45:37 [rsStart] replSet I am bs-linux32.10gen.cc:31201 m31201| Thu Mar 7 08:45:37 [rsStart] replSet got config version 1 from a remote, saving locally m31201| Thu Mar 7 08:45:37 [rsStart] replSet info saving a newer config version to local.system.replset m31201| Thu Mar 7 08:45:37 [FileAllocator] allocating new datafile /data/db/remove2-rs1-1/local.ns, filling with zeroes... m31201| Thu Mar 7 08:45:37 [FileAllocator] creating directory /data/db/remove2-rs1-1/_tmp m31101| Thu Mar 7 08:45:37 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31100 is up m31101| Thu Mar 7 08:45:37 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31100 is now in state SECONDARY m31201| Thu Mar 7 08:45:37 [FileAllocator] done allocating datafile /data/db/remove2-rs1-1/local.ns, size: 16MB, took 0.232 secs m31201| Thu Mar 7 08:45:37 [FileAllocator] allocating new datafile /data/db/remove2-rs1-1/local.0, filling with zeroes... m31201| Thu Mar 7 08:45:37 [FileAllocator] done allocating datafile /data/db/remove2-rs1-1/local.0, size: 16MB, took 0.253 secs m31201| Thu Mar 7 08:45:37 [rsStart] replSet saveConfigLocally done m31201| Thu Mar 7 08:45:37 [rsStart] replSet STARTUP2 m31201| Thu Mar 7 08:45:37 [rsMgr] replSet total number of votes is even - add arbiter or give one member an extra vote m31201| Thu Mar 7 08:45:37 [rsSync] ****** m31201| Thu Mar 7 08:45:37 [rsSync] creating replication oplog of size: 40MB... m31201| Thu Mar 7 08:45:37 [FileAllocator] allocating new datafile /data/db/remove2-rs1-1/local.1, filling with zeroes... m31200| Thu Mar 7 08:45:37 [rsSync] replSet SECONDARY m31201| Thu Mar 7 08:45:38 [FileAllocator] done allocating datafile /data/db/remove2-rs1-1/local.1, size: 64MB, took 1.075 secs m31201| Thu Mar 7 08:45:38 [rsSync] ****** m31201| Thu Mar 7 08:45:38 [rsSync] replSet initial sync pending m31201| Thu Mar 7 08:45:38 [rsSync] replSet initial sync need a member to be primary or secondary to do our initial sync m31200| Thu Mar 7 08:45:38 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31201 is now in state STARTUP2 m31200| Thu Mar 7 08:45:38 [rsMgr] not electing self, bs-linux32.10gen.cc:31201 would veto m31201| Thu Mar 7 08:45:39 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31200 is up m31201| Thu Mar 7 08:45:39 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31200 is now in state SECONDARY m31100| Thu Mar 7 08:45:43 [rsMgr] replSet info electSelf 0 m31101| Thu Mar 7 08:45:43 [conn2] replSet RECOVERING m31101| Thu Mar 7 08:45:43 [conn2] replSet info voting yea for bs-linux32.10gen.cc:31100 (0) m31100| Thu Mar 7 08:45:43 [rsMgr] replSet PRIMARY m31101| Thu Mar 7 08:45:43 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31100 is now in state PRIMARY m31100| Thu Mar 7 08:45:44 [FileAllocator] allocating new datafile /data/db/remove2-rs0-0/admin.ns, filling with zeroes... m31100| Thu Mar 7 08:45:44 [FileAllocator] done allocating datafile /data/db/remove2-rs0-0/admin.ns, size: 16MB, took 0.225 secs m31100| Thu Mar 7 08:45:44 [FileAllocator] allocating new datafile /data/db/remove2-rs0-0/admin.0, filling with zeroes... m31200| Thu Mar 7 08:45:44 [rsMgr] replSet info electSelf 0 m31201| Thu Mar 7 08:45:44 [conn2] replSet RECOVERING m31201| Thu Mar 7 08:45:44 [conn2] replSet info voting yea for bs-linux32.10gen.cc:31200 (0) m31200| Thu Mar 7 08:45:44 [rsMgr] replSet PRIMARY m31100| Thu Mar 7 08:45:45 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31101 is now in state RECOVERING m31201| Thu Mar 7 08:45:45 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31200 is now in state PRIMARY m31100| Thu Mar 7 08:45:45 [FileAllocator] done allocating datafile /data/db/remove2-rs0-0/admin.0, size: 16MB, took 0.278 secs m31100| Thu Mar 7 08:45:45 [conn1] build index admin.foo { _id: 1 } ReplSetTest Timestamp(1362663945000, 1) ReplSetTest waiting for connection to bs-linux32.10gen.cc:31101 to have an oplog built. m31100| Thu Mar 7 08:45:45 [conn1] build index done. scanned 0 total records. 0.036 secs m31100| Thu Mar 7 08:45:45 [conn1] insert admin.foo keyUpdates:0 550ms m31200| Thu Mar 7 08:45:46 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31201 is now in state RECOVERING ReplSetTest waiting for connection to bs-linux32.10gen.cc:31101 to have an oplog built. ReplSetTest waiting for connection to bs-linux32.10gen.cc:31101 to have an oplog built. ReplSetTest waiting for connection to bs-linux32.10gen.cc:31101 to have an oplog built. m31101| Thu Mar 7 08:45:52 [rsSync] replSet initial sync pending m31101| Thu Mar 7 08:45:52 [rsSync] replSet syncing to: bs-linux32.10gen.cc:31100 m31101| Thu Mar 7 08:45:52 [rsSync] build index local.me { _id: 1 } m31101| Thu Mar 7 08:45:52 [rsSync] build index done. scanned 0 total records. 0 secs m31101| Thu Mar 7 08:45:52 [rsSync] replSet initial sync drop all databases m31101| Thu Mar 7 08:45:52 [rsSync] dropAllDatabasesExceptLocal 1 m31101| Thu Mar 7 08:45:52 [rsSync] replSet initial sync clone all databases m31101| Thu Mar 7 08:45:52 [rsSync] replSet initial sync cloning db: admin m31100| Thu Mar 7 08:45:52 [initandlisten] connection accepted from 10.255.119.66:40327 #3 (3 connections now open) m31100| Thu Mar 7 08:45:52 [initandlisten] connection accepted from 10.255.119.66:40328 #4 (4 connections now open) m31101| Thu Mar 7 08:45:52 [FileAllocator] allocating new datafile /data/db/remove2-rs0-1/admin.ns, filling with zeroes... m31101| Thu Mar 7 08:45:53 [FileAllocator] done allocating datafile /data/db/remove2-rs0-1/admin.ns, size: 16MB, took 0.216 secs m31101| Thu Mar 7 08:45:53 [FileAllocator] allocating new datafile /data/db/remove2-rs0-1/admin.0, filling with zeroes... m31101| Thu Mar 7 08:45:53 [FileAllocator] done allocating datafile /data/db/remove2-rs0-1/admin.0, size: 16MB, took 0.278 secs ReplSetTest waiting for connection to bs-linux32.10gen.cc:31101 to have an oplog built. m31101| Thu Mar 7 08:45:53 [rsSync] build index admin.foo { _id: 1 } m31101| Thu Mar 7 08:45:53 [rsSync] fastBuildIndex dupsToDrop:0 m31101| Thu Mar 7 08:45:53 [rsSync] build index done. scanned 1 total records. 0 secs m31101| Thu Mar 7 08:45:53 [rsSync] replSet initial sync data copy, starting syncup m31101| Thu Mar 7 08:45:53 [rsSync] oplog sync 1 of 3 m31101| Thu Mar 7 08:45:53 [rsSync] oplog sync 2 of 3 m31101| Thu Mar 7 08:45:53 [rsSync] replSet initial sync building indexes m31101| Thu Mar 7 08:45:53 [rsSync] replSet initial sync cloning indexes for : admin m31100| Thu Mar 7 08:45:53 [conn4] end connection 10.255.119.66:40328 (3 connections now open) m31101| Thu Mar 7 08:45:53 [rsSync] oplog sync 3 of 3 m31101| Thu Mar 7 08:45:53 [rsSync] replSet initial sync finishing up m31100| Thu Mar 7 08:45:53 [initandlisten] connection accepted from 10.255.119.66:40329 #5 (4 connections now open) m31100| Thu Mar 7 08:45:53 [conn5] end connection 10.255.119.66:40329 (3 connections now open) m31101| Thu Mar 7 08:45:53 [rsSync] replSet set minValid=51389a09:1 m31101| Thu Mar 7 08:45:53 [rsSync] build index local.replset.minvalid { _id: 1 } m31101| Thu Mar 7 08:45:53 [rsSync] build index done. scanned 0 total records. 0 secs m31101| Thu Mar 7 08:45:53 [rsSync] replSet initial sync done m31100| Thu Mar 7 08:45:53 [conn3] end connection 10.255.119.66:40327 (2 connections now open) m31101| Thu Mar 7 08:45:53 [rsBackgroundSync] replSet syncing to: bs-linux32.10gen.cc:31100 m31100| Thu Mar 7 08:45:53 [initandlisten] connection accepted from 10.255.119.66:40332 #6 (3 connections now open) m31101| Thu Mar 7 08:45:54 [rsSyncNotifier] replset setting oplog notifier to bs-linux32.10gen.cc:31100 m31100| Thu Mar 7 08:45:54 [initandlisten] connection accepted from 10.255.119.66:40333 #7 (4 connections now open) m31201| Thu Mar 7 08:45:54 [rsSync] replSet initial sync pending m31201| Thu Mar 7 08:45:54 [rsSync] replSet syncing to: bs-linux32.10gen.cc:31200 m31201| Thu Mar 7 08:45:54 [rsSync] build index local.me { _id: 1 } m31201| Thu Mar 7 08:45:54 [rsSync] build index done. scanned 0 total records. 0 secs m31201| Thu Mar 7 08:45:54 [rsSync] replSet initial sync drop all databases m31201| Thu Mar 7 08:45:54 [rsSync] dropAllDatabasesExceptLocal 1 m31201| Thu Mar 7 08:45:54 [rsSync] replSet initial sync clone all databases m31201| Thu Mar 7 08:45:54 [rsSync] replSet initial sync data copy, starting syncup m31201| Thu Mar 7 08:45:54 [rsSync] oplog sync 1 of 3 m31201| Thu Mar 7 08:45:54 [rsSync] oplog sync 2 of 3 m31200| Thu Mar 7 08:45:54 [initandlisten] connection accepted from 10.255.119.66:58700 #3 (3 connections now open) m31201| Thu Mar 7 08:45:54 [rsSync] replSet initial sync building indexes m31201| Thu Mar 7 08:45:54 [rsSync] oplog sync 3 of 3 m31201| Thu Mar 7 08:45:54 [rsSync] replSet initial sync finishing up m31201| Thu Mar 7 08:45:54 [rsSync] replSet set minValid=513899f8:1 m31201| Thu Mar 7 08:45:54 [rsSync] build index local.replset.minvalid { _id: 1 } m31201| Thu Mar 7 08:45:54 [rsSync] build index done. scanned 0 total records. 0 secs m31201| Thu Mar 7 08:45:54 [rsSync] replSet initial sync done m31200| Thu Mar 7 08:45:54 [conn3] end connection 10.255.119.66:58700 (2 connections now open) { "ts" : Timestamp(1362663945000, 1), "h" : NumberLong("7260429978079068177"), "v" : 2, "op" : "i", "ns" : "admin.foo", "o" : { "_id" : ObjectId("51389a08d8ae495196fd4cb0"), "x" : 1 } } ReplSetTest await TS for connection to bs-linux32.10gen.cc:31101 is 1362663945000:1 and latest is 1362663945000:1 ReplSetTest await oplog size for connection to bs-linux32.10gen.cc:31101 is 1 ReplSetTest await synced=true Thu Mar 7 08:45:55 starting new replica set monitor for replica set remove2-rs0 with seed of bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 Thu Mar 7 08:45:55 successfully connected to seed bs-linux32.10gen.cc:31100 for replica set remove2-rs0 Thu Mar 7 08:45:55 changing hosts to { 0: "bs-linux32.10gen.cc:31100", 1: "bs-linux32.10gen.cc:31101" } from remove2-rs0/ Thu Mar 7 08:45:55 trying to add new host bs-linux32.10gen.cc:31100 to replica set remove2-rs0 m31100| Thu Mar 7 08:45:55 [initandlisten] connection accepted from 10.255.119.66:40335 #8 (5 connections now open) Thu Mar 7 08:45:55 successfully connected to new host bs-linux32.10gen.cc:31100 in replica set remove2-rs0 Thu Mar 7 08:45:55 trying to add new host bs-linux32.10gen.cc:31101 to replica set remove2-rs0 m31100| Thu Mar 7 08:45:55 [initandlisten] connection accepted from 10.255.119.66:40337 #9 (6 connections now open) m31101| Thu Mar 7 08:45:55 [initandlisten] connection accepted from 10.255.119.66:44498 #3 (3 connections now open) Thu Mar 7 08:45:55 successfully connected to new host bs-linux32.10gen.cc:31101 in replica set remove2-rs0 Thu Mar 7 08:45:55 Primary for replica set remove2-rs0 changed to bs-linux32.10gen.cc:31100 m31100| Thu Mar 7 08:45:55 [initandlisten] connection accepted from 10.255.119.66:40339 #10 (7 connections now open) m31100| Thu Mar 7 08:45:55 [conn8] end connection 10.255.119.66:40335 (6 connections now open) m31101| Thu Mar 7 08:45:55 [initandlisten] connection accepted from 10.255.119.66:44500 #4 (4 connections now open) Thu Mar 7 08:45:55 replica set monitor for replica set remove2-rs0 started, address is remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 Thu Mar 7 08:45:55 [ReplicaSetMonitorWatcher] starting m31200| Thu Mar 7 08:45:55 [FileAllocator] allocating new datafile /data/db/remove2-rs1-0/admin.ns, filling with zeroes... m31100| Thu Mar 7 08:45:55 [slaveTracking] build index local.slaves { _id: 1 } m31100| Thu Mar 7 08:45:55 [slaveTracking] build index done. scanned 0 total records. 0 secs m31101| Thu Mar 7 08:45:55 [rsSync] replSet SECONDARY m31201| Thu Mar 7 08:45:55 [rsBackgroundSync] replSet syncing to: bs-linux32.10gen.cc:31200 m31200| Thu Mar 7 08:45:55 [initandlisten] connection accepted from 10.255.119.66:58708 #4 (3 connections now open) m31200| Thu Mar 7 08:45:55 [FileAllocator] done allocating datafile /data/db/remove2-rs1-0/admin.ns, size: 16MB, took 0.264 secs m31200| Thu Mar 7 08:45:55 [FileAllocator] allocating new datafile /data/db/remove2-rs1-0/admin.0, filling with zeroes... m31200| Thu Mar 7 08:45:56 [FileAllocator] done allocating datafile /data/db/remove2-rs1-0/admin.0, size: 16MB, took 0.389 secs m31200| Thu Mar 7 08:45:56 [conn1] build index admin.foo { _id: 1 } ReplSetTest Timestamp(1362663956000, 1) m31200| Thu Mar 7 08:45:56 [conn1] build index done. scanned 0 total records. 0 secs m31200| Thu Mar 7 08:45:56 [conn1] insert admin.foo keyUpdates:0 663ms m31201| Thu Mar 7 08:45:56 [rsSync] replSet SECONDARY m31201| Thu Mar 7 08:45:56 [FileAllocator] allocating new datafile /data/db/remove2-rs1-1/admin.ns, filling with zeroes... m31201| Thu Mar 7 08:45:56 [FileAllocator] done allocating datafile /data/db/remove2-rs1-1/admin.ns, size: 16MB, took 0.246 secs m31201| Thu Mar 7 08:45:56 [FileAllocator] allocating new datafile /data/db/remove2-rs1-1/admin.0, filling with zeroes... { "ts" : Timestamp(1362663956000, 1), "h" : NumberLong("7260430781237952529"), "v" : 2, "op" : "i", "ns" : "admin.foo", "o" : { "_id" : ObjectId("51389a13d8ae495196fd4cb1"), "x" : 1 } } ReplSetTest await TS for connection to bs-linux32.10gen.cc:31201 is 1362663956000:1 and latest is 1362663956000:1 ReplSetTest await oplog size for connection to bs-linux32.10gen.cc:31201 is 2 ReplSetTest await synced=true Thu Mar 7 08:45:56 starting new replica set monitor for replica set remove2-rs1 with seed of bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31201| Thu Mar 7 08:45:56 [FileAllocator] done allocating datafile /data/db/remove2-rs1-1/admin.0, size: 16MB, took 0.282 secs m31201| Thu Mar 7 08:45:56 [repl writer worker 1] build index admin.foo { _id: 1 } m31201| Thu Mar 7 08:45:56 [repl writer worker 1] build index done. scanned 0 total records. 0 secs Thu Mar 7 08:45:56 successfully connected to seed bs-linux32.10gen.cc:31200 for replica set remove2-rs1 m31200| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:58709 #5 (4 connections now open) Thu Mar 7 08:45:56 changing hosts to { 0: "bs-linux32.10gen.cc:31200", 1: "bs-linux32.10gen.cc:31201" } from remove2-rs1/ Thu Mar 7 08:45:56 trying to add new host bs-linux32.10gen.cc:31200 to replica set remove2-rs1 Thu Mar 7 08:45:56 successfully connected to new host bs-linux32.10gen.cc:31200 in replica set remove2-rs1 Thu Mar 7 08:45:56 trying to add new host bs-linux32.10gen.cc:31201 to replica set remove2-rs1 m31200| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:58710 #6 (5 connections now open) Thu Mar 7 08:45:56 successfully connected to new host bs-linux32.10gen.cc:31201 in replica set remove2-rs1 m31201| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:49558 #3 (3 connections now open) m31200| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:58712 #7 (6 connections now open) m31200| Thu Mar 7 08:45:56 [conn5] end connection 10.255.119.66:58709 (5 connections now open) Thu Mar 7 08:45:56 Primary for replica set remove2-rs1 changed to bs-linux32.10gen.cc:31200 m31201| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:49560 #4 (4 connections now open) Thu Mar 7 08:45:56 replica set monitor for replica set remove2-rs1 started, address is remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 Resetting db path '/data/db/remove2-config0' Thu Mar 7 08:45:56 shell: started program /mnt/slaves/Linux_32bit_V2.2/mongo/mongod --port 29000 --dbpath /data/db/remove2-config0 --configsvr m29000| Thu Mar 7 08:45:56 m29000| Thu Mar 7 08:45:56 warning: 32-bit servers don't have journaling enabled by default. Please use --journal if you want durability. m31200| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:58715 #8 (6 connections now open) m31201| Thu Mar 7 08:45:56 [rsSyncNotifier] replset setting oplog notifier to bs-linux32.10gen.cc:31200 m29000| Thu Mar 7 08:45:56 m29000| Thu Mar 7 08:45:56 [initandlisten] MongoDB starting : pid=27749 port=29000 dbpath=/data/db/remove2-config0 32-bit host=bs-linux32.10gen.cc m29000| Thu Mar 7 08:45:56 [initandlisten] m29000| Thu Mar 7 08:45:56 [initandlisten] ** NOTE: when using MongoDB 32 bit, you are limited to about 2 gigabytes of data m29000| Thu Mar 7 08:45:56 [initandlisten] ** see http://blog.mongodb.org/post/137788967/32-bit-limitations m29000| Thu Mar 7 08:45:56 [initandlisten] ** with --journal, the limit is lower m29000| Thu Mar 7 08:45:56 [initandlisten] m29000| Thu Mar 7 08:45:56 [initandlisten] db version v2.2.4-pre-, pdfile version 4.5 m29000| Thu Mar 7 08:45:56 [initandlisten] git version: 379bee085f2d8bd71c136a5aa136aef2b3da80ed m29000| Thu Mar 7 08:45:56 [initandlisten] build info: Linux bs-linux32.10gen.cc 2.6.21.7-2.fc8xen #1 SMP Fri Feb 15 12:39:36 EST 2008 i686 BOOST_LIB_VERSION=1_49 m29000| Thu Mar 7 08:45:56 [initandlisten] options: { configsvr: true, dbpath: "/data/db/remove2-config0", port: 29000 } m29000| Thu Mar 7 08:45:56 [initandlisten] journal dir=/data/db/remove2-config0/journal m29000| Thu Mar 7 08:45:56 [initandlisten] recover : no journal files present, no recovery needed m29000| Thu Mar 7 08:45:56 [initandlisten] waiting for connections on port 29000 m29000| Thu Mar 7 08:45:56 [websvr] admin web console waiting for connections on port 30000 "bs-linux32.10gen.cc:29000" ShardingTest remove2 : { "config" : "bs-linux32.10gen.cc:29000", "shards" : [ connection to remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101, connection to remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 ] } Thu Mar 7 08:45:56 shell: started program /mnt/slaves/Linux_32bit_V2.2/mongo/mongos --port 30999 --configdb bs-linux32.10gen.cc:29000 --chunkSize 1 m29000| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 127.0.0.1:44488 #1 (1 connection now open) m29000| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:48336 #2 (2 connections now open) m30999| Thu Mar 7 08:45:56 warning: running with 1 config server should be done only for testing purposes and is not recommended for production m30999| Thu Mar 7 08:45:56 [mongosMain] MongoS version 2.2.4-pre- starting: pid=27766 port=30999 32-bit host=bs-linux32.10gen.cc (--help for usage) m30999| Thu Mar 7 08:45:56 [mongosMain] git version: 379bee085f2d8bd71c136a5aa136aef2b3da80ed m30999| Thu Mar 7 08:45:56 [mongosMain] build info: Linux bs-linux32.10gen.cc 2.6.21.7-2.fc8xen #1 SMP Fri Feb 15 12:39:36 EST 2008 i686 BOOST_LIB_VERSION=1_49 m30999| Thu Mar 7 08:45:56 [mongosMain] options: { chunkSize: 1, configdb: "bs-linux32.10gen.cc:29000", port: 30999 } m29000| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:48338 #3 (3 connections now open) m29000| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:48339 #4 (4 connections now open) m29000| Thu Mar 7 08:45:56 [initandlisten] connection accepted from 10.255.119.66:48340 #5 (5 connections now open) m29000| Thu Mar 7 08:45:56 [FileAllocator] allocating new datafile /data/db/remove2-config0/config.ns, filling with zeroes... m29000| Thu Mar 7 08:45:56 [FileAllocator] creating directory /data/db/remove2-config0/_tmp m31200| Thu Mar 7 08:45:56 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31201 is now in state SECONDARY m31100| Thu Mar 7 08:45:57 [rsHealthPoll] replSet member bs-linux32.10gen.cc:31101 is now in state SECONDARY m29000| Thu Mar 7 08:45:57 [FileAllocator] done allocating datafile /data/db/remove2-config0/config.ns, size: 16MB, took 0.267 secs m29000| Thu Mar 7 08:45:57 [FileAllocator] allocating new datafile /data/db/remove2-config0/config.0, filling with zeroes... m29000| Thu Mar 7 08:45:57 [FileAllocator] done allocating datafile /data/db/remove2-config0/config.0, size: 16MB, took 0.26 secs m29000| Thu Mar 7 08:45:57 [FileAllocator] allocating new datafile /data/db/remove2-config0/config.1, filling with zeroes... m29000| Thu Mar 7 08:45:57 [conn5] build index config.version { _id: 1 } m29000| Thu Mar 7 08:45:57 [conn5] build index done. scanned 0 total records. 0.001 secs m29000| Thu Mar 7 08:45:57 [conn5] insert config.version keyUpdates:0 locks(micros) w:540750 540ms m29000| Thu Mar 7 08:45:57 [conn3] build index config.settings { _id: 1 } m30999| Thu Mar 7 08:45:57 [mongosMain] waiting for connections on port 30999 m30999| Thu Mar 7 08:45:57 [websvr] admin web console waiting for connections on port 31999 m30999| Thu Mar 7 08:45:57 [Balancer] about to contact config servers and shards ShardingTest undefined going to add shard : remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m30999| Thu Mar 7 08:45:57 [mongosMain] connection accepted from 127.0.0.1:55663 #1 (1 connection now open) m31200| Thu Mar 7 08:45:57 [slaveTracking] build index local.slaves { _id: 1 } m31200| Thu Mar 7 08:45:57 [slaveTracking] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0.484 secs m29000| Thu Mar 7 08:45:57 [conn3] insert config.settings keyUpdates:0 locks(micros) w:485140 485ms m29000| Thu Mar 7 08:45:57 [conn3] build index config.chunks { _id: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] info: creating collection config.chunks on add index m29000| Thu Mar 7 08:45:57 [conn3] build index config.chunks { ns: 1, min: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] build index config.chunks { ns: 1, shard: 1, min: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] build index config.chunks { ns: 1, lastmod: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] build index config.shards { _id: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] info: creating collection config.shards on add index m29000| Thu Mar 7 08:45:57 [conn3] build index config.shards { host: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] build index config.databases { _id: 1 } m30999| Thu Mar 7 08:45:57 [Balancer] config servers and shards contacted successfully m30999| Thu Mar 7 08:45:57 [conn1] couldn't find database [admin] in config db m30999| Thu Mar 7 08:45:57 [Balancer] balancer id: bs-linux32.10gen.cc:30999 started at Mar 7 08:45:57 m31100| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:40362 #11 (7 connections now open) m31100| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:40363 #12 (8 connections now open) m31101| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:44524 #5 (5 connections now open) m31100| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:40365 #13 (9 connections now open) m31100| Thu Mar 7 08:45:57 [conn11] end connection 10.255.119.66:40362 (8 connections now open) m31101| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:44526 #6 (6 connections now open) { "shardAdded" : "remove2-rs0", "ok" : 1 } ShardingTest undefined going to add shard : remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31100| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:40367 #14 (9 connections now open) m31200| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:58734 #9 (7 connections now open) m31200| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:58735 #10 (8 connections now open) m31201| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:49583 #5 (5 connections now open) m31200| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:58737 #11 (9 connections now open) m31200| Thu Mar 7 08:45:57 [conn9] end connection 10.255.119.66:58734 (8 connections now open) m31201| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:49585 #6 (6 connections now open) m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [initandlisten] connection accepted from 10.255.119.66:48346 #6 (6 connections now open) m29000| Thu Mar 7 08:45:57 [conn6] build index config.mongos { _id: 1 } { "shardAdded" : "remove2-rs1", "ok" : 1 } m29000| Thu Mar 7 08:45:57 [conn6] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn5] build index config.locks { _id: 1 } m29000| Thu Mar 7 08:45:57 [conn5] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] build index config.lockpings { _id: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:57 [conn3] build index config.lockpings { ping: 1 } m29000| Thu Mar 7 08:45:57 [conn3] build index done. scanned 1 total records. 0 secs m31200| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:58739 #12 (9 connections now open) m30999| Thu Mar 7 08:45:57 [conn1] put [admin] on: config:bs-linux32.10gen.cc:29000 m30999| Thu Mar 7 08:45:57 [conn1] starting new replica set monitor for replica set remove2-rs0 with seed of bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m30999| Thu Mar 7 08:45:57 [conn1] successfully connected to seed bs-linux32.10gen.cc:31100 for replica set remove2-rs0 { "was" : 30, "ok" : 1 } { "was" : 30, "ok" : 1 } m30999| Thu Mar 7 08:45:57 [conn1] changing hosts to { 0: "bs-linux32.10gen.cc:31100", 1: "bs-linux32.10gen.cc:31101" } from remove2-rs0/ m30999| Thu Mar 7 08:45:57 [conn1] trying to add new host bs-linux32.10gen.cc:31100 to replica set remove2-rs0 m30999| Thu Mar 7 08:45:57 [conn1] successfully connected to new host bs-linux32.10gen.cc:31100 in replica set remove2-rs0 m30999| Thu Mar 7 08:45:57 [conn1] trying to add new host bs-linux32.10gen.cc:31101 to replica set remove2-rs0 m30999| Thu Mar 7 08:45:57 [LockPinger] creating distributed lock ping thread for bs-linux32.10gen.cc:29000 and process bs-linux32.10gen.cc:30999:1362663957:1804289383 (sleeping for 30000ms) m30999| Thu Mar 7 08:45:57 [conn1] successfully connected to new host bs-linux32.10gen.cc:31101 in replica set remove2-rs0 m30999| Thu Mar 7 08:45:57 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a152059b9aba6310471 m30999| Thu Mar 7 08:45:57 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. m31101| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:44537 #7 (7 connections now open) m31100| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:40375 #15 (10 connections now open) m31100| Thu Mar 7 08:45:58 [conn15] first cluster operation detected, adding sharding hook to enable versioning and authentication to remote servers m31100| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:40376 #16 (11 connections now open) m31100| Thu Mar 7 08:45:58 [conn15] CMD: drop test.remove2 m31100| Thu Mar 7 08:45:58 [FileAllocator] allocating new datafile /data/db/remove2-rs0-0/test.ns, filling with zeroes... m30999| Thu Mar 7 08:45:57 [conn1] Primary for replica set remove2-rs0 changed to bs-linux32.10gen.cc:31100 m30999| Thu Mar 7 08:45:57 [conn1] replica set monitor for replica set remove2-rs0 started, address is remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m30999| Thu Mar 7 08:45:57 [ReplicaSetMonitorWatcher] starting m30999| Thu Mar 7 08:45:57 [conn1] going to add shard: { _id: "remove2-rs0", host: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101" } m30999| Thu Mar 7 08:45:57 [conn1] starting new replica set monitor for replica set remove2-rs1 with seed of bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m30999| Thu Mar 7 08:45:57 [conn1] successfully connected to seed bs-linux32.10gen.cc:31200 for replica set remove2-rs1 m30999| Thu Mar 7 08:45:57 [conn1] changing hosts to { 0: "bs-linux32.10gen.cc:31200", 1: "bs-linux32.10gen.cc:31201" } from remove2-rs1/ m30999| Thu Mar 7 08:45:57 [conn1] trying to add new host bs-linux32.10gen.cc:31200 to replica set remove2-rs1 m30999| Thu Mar 7 08:45:57 [conn1] successfully connected to new host bs-linux32.10gen.cc:31200 in replica set remove2-rs1 m30999| Thu Mar 7 08:45:57 [conn1] trying to add new host bs-linux32.10gen.cc:31201 to replica set remove2-rs1 m30999| Thu Mar 7 08:45:57 [conn1] successfully connected to new host bs-linux32.10gen.cc:31201 in replica set remove2-rs1 m30999| Thu Mar 7 08:45:57 [conn1] Primary for replica set remove2-rs1 changed to bs-linux32.10gen.cc:31200 m30999| Thu Mar 7 08:45:58 [conn1] replica set monitor for replica set remove2-rs1 started, address is remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m30999| Thu Mar 7 08:45:58 [conn1] going to add shard: { _id: "remove2-rs1", host: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201" } m30999| Thu Mar 7 08:45:58 [mongosMain] connection accepted from 10.255.119.66:42045 #2 (2 connections now open) m30999| Thu Mar 7 08:45:58 [conn2] couldn't find database [test] in config db m30999| Thu Mar 7 08:45:58 [conn2] put [test] on: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m30999| Thu Mar 7 08:45:58 [conn2] DROP: test.remove2 m30999| Thu Mar 7 08:45:58 [conn2] creating WriteBackListener for: bs-linux32.10gen.cc:31100 serverID: 51389a152059b9aba6310470 m30999| Thu Mar 7 08:45:58 [conn2] creating WriteBackListener for: bs-linux32.10gen.cc:31101 serverID: 51389a152059b9aba6310470 m30999| Thu Mar 7 08:45:58 [conn1] enabling sharding on: test m30999| Thu Mar 7 08:45:58 [conn1] CMD: shardcollection: { shardCollection: "test.remove2", key: { i: 1.0 } } m30999| Thu Mar 7 08:45:58 [conn1] enable sharding on: test.remove2 with shard key: { i: 1.0 } m29000| Thu Mar 7 08:45:58 [FileAllocator] done allocating datafile /data/db/remove2-config0/config.1, size: 32MB, took 0.603 secs m31100| Thu Mar 7 08:45:58 [FileAllocator] done allocating datafile /data/db/remove2-rs0-0/test.ns, size: 16MB, took 0.375 secs m31100| Thu Mar 7 08:45:58 [FileAllocator] allocating new datafile /data/db/remove2-rs0-0/test.0, filling with zeroes... m30999| Thu Mar 7 08:45:58 [conn1] going to create 1 chunk(s) for: test.remove2 using new epoch 51389a162059b9aba6310472 m30999| Thu Mar 7 08:45:58 [conn1] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 2 version: 1|0||51389a162059b9aba6310472 based on: (empty) m29000| Thu Mar 7 08:45:58 [conn3] build index config.collections { _id: 1 } m29000| Thu Mar 7 08:45:58 [conn3] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:48364 #7 (7 connections now open) m30999| Thu Mar 7 08:45:58 [conn1] creating WriteBackListener for: bs-linux32.10gen.cc:31200 serverID: 51389a152059b9aba6310470 m30999| Thu Mar 7 08:45:58 [conn1] creating WriteBackListener for: bs-linux32.10gen.cc:31201 serverID: 51389a152059b9aba6310470 m31100| Thu Mar 7 08:45:58 [FileAllocator] done allocating datafile /data/db/remove2-rs0-0/test.0, size: 16MB, took 0.322 secs m30999| Thu Mar 7 08:45:58 [conn1] resetting shard version of test.remove2 on bs-linux32.10gen.cc:31200, version is zero m31200| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:58746 #13 (10 connections now open) m31200| Thu Mar 7 08:45:58 [conn13] first cluster operation detected, adding sharding hook to enable versioning and authentication to remote servers m31200| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:58747 #14 (11 connections now open) m30999| Thu Mar 7 08:45:58 [conn2] resetting shard version of test.remove2 on bs-linux32.10gen.cc:31200, version is zero m31100| Thu Mar 7 08:45:58 [conn14] build index test.remove2 { _id: 1 } m31100| Thu Mar 7 08:45:58 [conn14] build index done. scanned 0 total records. 0 secs m31100| Thu Mar 7 08:45:58 [conn14] info: creating collection test.remove2 on add index m31100| Thu Mar 7 08:45:58 [conn14] build index test.remove2 { i: 1.0 } m31100| Thu Mar 7 08:45:58 [conn14] build index done. scanned 0 total records. 0 secs m31100| Thu Mar 7 08:45:58 [conn14] insert test.system.indexes keyUpdates:0 locks(micros) w:707832 707ms m31100| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:40378 #17 (12 connections now open) m31100| Thu Mar 7 08:45:58 [conn17] no current chunk manager found for this shard, will initialize m31100| Thu Mar 7 08:45:58 [conn14] request split points lookup for chunk test.remove2 { : MinKey } -->> { : MaxKey } m31100| Thu Mar 7 08:45:58 [conn14] warning: chunk is larger than 1024 bytes because of key { i: 0.0 } m31100| Thu Mar 7 08:45:58 [conn14] request split points lookup for chunk test.remove2 { : MinKey } -->> { : MaxKey } m31100| Thu Mar 7 08:45:58 [conn14] warning: chunk is larger than 1024 bytes because of key { i: 0.0 } m31100| Thu Mar 7 08:45:58 [conn14] request split points lookup for chunk test.remove2 { : MinKey } -->> { : MaxKey } m31100| Thu Mar 7 08:45:58 [conn14] max number of requested split points reached (2) before the end of chunk test.remove2 { : MinKey } -->> { : MaxKey } m31100| Thu Mar 7 08:45:58 [conn14] warning: chunk is larger than 1024 bytes because of key { i: 0.0 } m31101| Thu Mar 7 08:45:58 [FileAllocator] allocating new datafile /data/db/remove2-rs0-1/test.ns, filling with zeroes... m31100| Thu Mar 7 08:45:58 [conn14] received splitChunk request: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: MinKey }, max: { i: MaxKey }, from: "remove2-rs0", splitKeys: [ { i: 0.0 } ], shardId: "test.remove2-i_MinKey", configdb: "bs-linux32.10gen.cc:29000" } m31100| Thu Mar 7 08:45:58 [LockPinger] creating distributed lock ping thread for bs-linux32.10gen.cc:29000 and process bs-linux32.10gen.cc:31100:1362663958:463284344 (sleeping for 30000ms) m31200| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:58748 #15 (12 connections now open) m29000| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:48368 #8 (8 connections now open) m31201| Thu Mar 7 08:45:58 [initandlisten] connection accepted from 10.255.119.66:49597 #7 (7 connections now open) m29000| Thu Mar 7 08:45:59 [conn8] insert config.locks keyUpdates:0 locks(micros) w:31 310ms m29000| Thu Mar 7 08:45:59 [conn7] update config.lockpings query: { _id: "bs-linux32.10gen.cc:31100:1362663958:463284344" } update: { $set: { ping: new Date(1362663958735) } } nscanned:0 nupdated:1 fastmodinsert:1 keyUpdates:0 locks(micros) w:85 310ms m29000| Thu Mar 7 08:45:59 [conn7] build index config.changelog { _id: 1 } m29000| Thu Mar 7 08:45:59 [conn7] build index done. scanned 0 total records. 0 secs m30999| Thu Mar 7 08:45:59 [conn2] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 3 version: 1|2||51389a162059b9aba6310472 based on: 1|0||51389a162059b9aba6310472 m30999| Thu Mar 7 08:45:59 [conn2] autosplitted test.remove2 shard: ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|0||000000000000000000000000 min: { i: MinKey } max: { i: MaxKey } on: { i: 0.0 } (splitThreshold 921) m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a16f5a6130c40436646 m31100| Thu Mar 7 08:45:59 [conn14] splitChunk accepted at version 1|0||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:45:59-0", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663959048), what: "split", ns: "test.remove2", details: { before: { min: { i: MinKey }, max: { i: MaxKey }, lastmod: Timestamp 1000|0, lastmodEpoch: ObjectId('000000000000000000000000') }, left: { min: { i: MinKey }, max: { i: 0.0 }, lastmod: Timestamp 1000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472') }, right: { min: { i: 0.0 }, max: { i: MaxKey }, lastmod: Timestamp 1000|2, lastmodEpoch: ObjectId('51389a162059b9aba6310472') } } } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:45:59 [conn14] command admin.$cmd command: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: MinKey }, max: { i: MaxKey }, from: "remove2-rs0", splitKeys: [ { i: 0.0 } ], shardId: "test.remove2-i_MinKey", configdb: "bs-linux32.10gen.cc:29000" } ntoreturn:1 keyUpdates:0 locks(micros) r:46 reslen:37 315ms m31101| Thu Mar 7 08:45:59 [FileAllocator] done allocating datafile /data/db/remove2-rs0-1/test.ns, size: 16MB, took 0.334 secs m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : MaxKey } m31100| Thu Mar 7 08:45:59 [conn14] max number of requested split points reached (2) before the end of chunk test.remove2 { : 0.0 } -->> { : MaxKey } m31100| Thu Mar 7 08:45:59 [conn14] received splitChunk request: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: 0.0 }, max: { i: MaxKey }, from: "remove2-rs0", splitKeys: [ { i: 9.0 } ], shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000" } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a17f5a6130c40436647 m31100| Thu Mar 7 08:45:59 [conn14] splitChunk accepted at version 1|2||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:45:59-1", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663959076), what: "split", ns: "test.remove2", details: { before: { min: { i: 0.0 }, max: { i: MaxKey }, lastmod: Timestamp 1000|2, lastmodEpoch: ObjectId('000000000000000000000000') }, left: { min: { i: 0.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|3, lastmodEpoch: ObjectId('51389a162059b9aba6310472') }, right: { min: { i: 9.0 }, max: { i: MaxKey }, lastmod: Timestamp 1000|4, lastmodEpoch: ObjectId('51389a162059b9aba6310472') } } } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31101| Thu Mar 7 08:45:59 [FileAllocator] allocating new datafile /data/db/remove2-rs0-1/test.0, filling with zeroes... m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 9.0 } -->> { : MaxKey } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] max number of requested split points reached (2) before the end of chunk test.remove2 { : 0.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] received splitChunk request: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: 0.0 }, max: { i: 9.0 }, from: "remove2-rs0", splitKeys: [ { i: 3.0 } ], shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000" } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a17f5a6130c40436648 m31100| Thu Mar 7 08:45:59 [conn14] splitChunk accepted at version 1|4||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:45:59-2", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663959117), what: "split", ns: "test.remove2", details: { before: { min: { i: 0.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|3, lastmodEpoch: ObjectId('000000000000000000000000') }, left: { min: { i: 0.0 }, max: { i: 3.0 }, lastmod: Timestamp 1000|5, lastmodEpoch: ObjectId('51389a162059b9aba6310472') }, right: { min: { i: 3.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|6, lastmodEpoch: ObjectId('51389a162059b9aba6310472') } } } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 9.0 } -->> { : MaxKey } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : 3.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 3.0 } -->> { : 9.0 } m30999| Thu Mar 7 08:45:59 [conn2] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 4 version: 1|4||51389a162059b9aba6310472 based on: 1|2||51389a162059b9aba6310472 m30999| Thu Mar 7 08:45:59 [conn2] autosplitted test.remove2 shard: ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|2||000000000000000000000000 min: { i: 0.0 } max: { i: MaxKey } on: { i: 9.0 } (splitThreshold 471859) m30999| Thu Mar 7 08:45:59 [conn2] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 5 version: 1|6||51389a162059b9aba6310472 based on: 1|4||51389a162059b9aba6310472 m30999| Thu Mar 7 08:45:59 [conn2] autosplitted test.remove2 shard: ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|3||000000000000000000000000 min: { i: 0.0 } max: { i: 9.0 } on: { i: 3.0 } (splitThreshold 1048576) m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 3.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] max number of requested split points reached (2) before the end of chunk test.remove2 { : 3.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] received splitChunk request: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: 3.0 }, max: { i: 9.0 }, from: "remove2-rs0", splitKeys: [ { i: 5.0 } ], shardId: "test.remove2-i_3.0", configdb: "bs-linux32.10gen.cc:29000" } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a17f5a6130c40436649 m31100| Thu Mar 7 08:45:59 [conn14] splitChunk accepted at version 1|6||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:45:59-3", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663959145), what: "split", ns: "test.remove2", details: { before: { min: { i: 3.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|6, lastmodEpoch: ObjectId('000000000000000000000000') }, left: { min: { i: 3.0 }, max: { i: 5.0 }, lastmod: Timestamp 1000|7, lastmodEpoch: ObjectId('51389a162059b9aba6310472') }, right: { min: { i: 5.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|8, lastmodEpoch: ObjectId('51389a162059b9aba6310472') } } } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 5.0 } -->> { : 9.0 } m30999| Thu Mar 7 08:45:59 [conn2] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 6 version: 1|8||51389a162059b9aba6310472 based on: 1|6||51389a162059b9aba6310472 m30999| Thu Mar 7 08:45:59 [conn2] autosplitted test.remove2 shard: ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|6||000000000000000000000000 min: { i: 3.0 } max: { i: 9.0 } on: { i: 5.0 } (splitThreshold 1048576) m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : 3.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 5.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] max number of requested split points reached (2) before the end of chunk test.remove2 { : 5.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] received splitChunk request: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: 5.0 }, max: { i: 9.0 }, from: "remove2-rs0", splitKeys: [ { i: 6.0 } ], shardId: "test.remove2-i_5.0", configdb: "bs-linux32.10gen.cc:29000" } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a17f5a6130c4043664a m31100| Thu Mar 7 08:45:59 [conn14] splitChunk accepted at version 1|8||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:45:59-4", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663959163), what: "split", ns: "test.remove2", details: { before: { min: { i: 5.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|8, lastmodEpoch: ObjectId('000000000000000000000000') }, left: { min: { i: 5.0 }, max: { i: 6.0 }, lastmod: Timestamp 1000|9, lastmodEpoch: ObjectId('51389a162059b9aba6310472') }, right: { min: { i: 6.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|10, lastmodEpoch: ObjectId('51389a162059b9aba6310472') } } } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m30999| Thu Mar 7 08:45:59 [conn2] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 7 version: 1|10||51389a162059b9aba6310472 based on: 1|8||51389a162059b9aba6310472 m30999| Thu Mar 7 08:45:59 [conn2] autosplitted test.remove2 shard: ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|8||000000000000000000000000 min: { i: 5.0 } max: { i: 9.0 } on: { i: 6.0 } (splitThreshold 1048576) m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 9.0 } -->> { : MaxKey } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 5.0 } -->> { : 6.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : 3.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 6.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : 3.0 } m31100| Thu Mar 7 08:45:59 [conn14] max number of requested split points reached (2) before the end of chunk test.remove2 { : 0.0 } -->> { : 3.0 } m31100| Thu Mar 7 08:45:59 [conn14] received splitChunk request: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: 0.0 }, max: { i: 3.0 }, from: "remove2-rs0", splitKeys: [ { i: 1.0 } ], shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000" } m31101| Thu Mar 7 08:45:59 [FileAllocator] done allocating datafile /data/db/remove2-rs0-1/test.0, size: 16MB, took 0.366 secs m31101| Thu Mar 7 08:45:59 [repl writer worker 1] build index test.remove2 { _id: 1 } m31101| Thu Mar 7 08:45:59 [repl writer worker 1] build index done. scanned 0 total records. 0.013 secs m31101| Thu Mar 7 08:45:59 [repl writer worker 1] info: creating collection test.remove2 on add index m31101| Thu Mar 7 08:45:59 [repl writer worker 1] build index test.remove2 { i: 1.0 } m31101| Thu Mar 7 08:45:59 [repl writer worker 1] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:45:59 [conn8] update config.locks query: { _id: "test.remove2", state: 0, ts: ObjectId('51389a17f5a6130c4043664a') } update: { $set: { state: 1, who: "bs-linux32.10gen.cc:31100:1362663958:463284344:conn14:2005399094", process: "bs-linux32.10gen.cc:31100:1362663958:463284344", when: new Date(1362663959188), why: "split-{ i: 0.0 }", ts: ObjectId('51389a17f5a6130c4043664b') } } nscanned:1 nupdated:1 keyUpdates:0 locks(micros) w:222 277ms m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a17f5a6130c4043664b m31100| Thu Mar 7 08:45:59 [conn14] splitChunk accepted at version 1|10||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:45:59-5", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663959474), what: "split", ns: "test.remove2", details: { before: { min: { i: 0.0 }, max: { i: 3.0 }, lastmod: Timestamp 1000|5, lastmodEpoch: ObjectId('000000000000000000000000') }, left: { min: { i: 0.0 }, max: { i: 1.0 }, lastmod: Timestamp 1000|11, lastmodEpoch: ObjectId('51389a162059b9aba6310472') }, right: { min: { i: 1.0 }, max: { i: 3.0 }, lastmod: Timestamp 1000|12, lastmodEpoch: ObjectId('51389a162059b9aba6310472') } } } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:45:59 [conn14] command admin.$cmd command: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: 0.0 }, max: { i: 3.0 }, from: "remove2-rs0", splitKeys: [ { i: 1.0 } ], shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000" } ntoreturn:1 keyUpdates:0 locks(micros) r:40 reslen:37 286ms m30999| Thu Mar 7 08:45:59 [conn2] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 8 version: 1|12||51389a162059b9aba6310472 based on: 1|10||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 1.0 } -->> { : 3.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 6.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] max number of requested split points reached (2) before the end of chunk test.remove2 { : 6.0 } -->> { : 9.0 } m31100| Thu Mar 7 08:45:59 [conn14] received splitChunk request: { splitChunk: "test.remove2", keyPattern: { i: 1.0 }, min: { i: 6.0 }, max: { i: 9.0 }, from: "remove2-rs0", splitKeys: [ { i: 7.0 } ], shardId: "test.remove2-i_6.0", configdb: "bs-linux32.10gen.cc:29000" } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a17f5a6130c4043664c m31100| Thu Mar 7 08:45:59 [conn14] splitChunk accepted at version 1|12||51389a162059b9aba6310472 m31100| Thu Mar 7 08:45:59 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:45:59-6", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663959494), what: "split", ns: "test.remove2", details: { before: { min: { i: 6.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|10, lastmodEpoch: ObjectId('000000000000000000000000') }, left: { min: { i: 6.0 }, max: { i: 7.0 }, lastmod: Timestamp 1000|13, lastmodEpoch: ObjectId('51389a162059b9aba6310472') }, right: { min: { i: 7.0 }, max: { i: 9.0 }, lastmod: Timestamp 1000|14, lastmodEpoch: ObjectId('51389a162059b9aba6310472') } } } m31100| Thu Mar 7 08:45:59 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 0.0 } -->> { : 1.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 1.0 } -->> { : 3.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 3.0 } -->> { : 5.0 } m31100| Thu Mar 7 08:45:59 [conn14] request split points lookup for chunk test.remove2 { : 7.0 } -->> { : 9.0 } m30999| Thu Mar 7 08:45:59 [conn2] autosplitted test.remove2 shard: ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|5||000000000000000000000000 min: { i: 0.0 } max: { i: 3.0 } on: { i: 1.0 } (splitThreshold 1048576) m30999| Thu Mar 7 08:45:59 [conn2] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 9 version: 1|14||51389a162059b9aba6310472 based on: 1|12||51389a162059b9aba6310472 m30999| Thu Mar 7 08:45:59 [conn2] autosplitted test.remove2 shard: ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|10||000000000000000000000000 min: { i: 6.0 } max: { i: 9.0 } on: { i: 7.0 } (splitThreshold 1048576) m31100| Thu Mar 7 08:45:59 [initandlisten] connection accepted from 10.255.119.66:40387 #18 (13 connections now open) m29000| Thu Mar 7 08:45:59 [initandlisten] connection accepted from 10.255.119.66:48373 #9 (9 connections now open) m30999| Thu Mar 7 08:45:59 [conn1] creating WriteBackListener for: bs-linux32.10gen.cc:29000 serverID: 51389a152059b9aba6310470 m29000| Thu Mar 7 08:45:59 [conn9] first cluster operation detected, adding sharding hook to enable versioning and authentication to remote servers ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 m31101| Thu Mar 7 08:46:03 [conn2] end connection 10.255.119.66:58007 (6 connections now open) m31101| Thu Mar 7 08:46:03 [initandlisten] connection accepted from 10.255.119.66:44551 #8 (7 connections now open) ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 m30999| Thu Mar 7 08:46:03 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a1b2059b9aba6310473 m29000| Thu Mar 7 08:46:03 [conn6] build index config.tags { _id: 1 } m29000| Thu Mar 7 08:46:03 [conn6] build index done. scanned 0 total records. 0 secs m29000| Thu Mar 7 08:46:03 [conn6] info: creating collection config.tags on add index m29000| Thu Mar 7 08:46:03 [conn6] build index config.tags { ns: 1, min: 1 } m29000| Thu Mar 7 08:46:03 [conn6] build index done. scanned 0 total records. 0 secs m30999| Thu Mar 7 08:46:03 [Balancer] ns: test.remove2 going to move { _id: "test.remove2-i_MinKey", lastmod: Timestamp 1000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: MinKey }, max: { i: 0.0 }, shard: "remove2-rs0" } from: remove2-rs0 to: remove2-rs1 tag [] m30999| Thu Mar 7 08:46:03 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 1|1||000000000000000000000000 min: { i: MinKey } max: { i: 0.0 }) remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 -> remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31100| Thu Mar 7 08:46:03 [conn14] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: MinKey }, max: { i: 0.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_MinKey", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31100| Thu Mar 7 08:46:04 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a1bf5a6130c4043664d m31100| Thu Mar 7 08:46:04 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:04-7", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663964002), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31100| Thu Mar 7 08:46:04 [conn14] moveChunk request accepted at version 1|14||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:04 [conn14] moveChunk number of documents: 0 m31100| Thu Mar 7 08:46:04 [conn14] starting new replica set monitor for replica set remove2-rs1 with seed of bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31100| Thu Mar 7 08:46:04 [conn14] successfully connected to seed bs-linux32.10gen.cc:31200 for replica set remove2-rs1 m31100| Thu Mar 7 08:46:04 [conn14] changing hosts to { 0: "bs-linux32.10gen.cc:31200", 1: "bs-linux32.10gen.cc:31201" } from remove2-rs1/ m31100| Thu Mar 7 08:46:04 [conn14] trying to add new host bs-linux32.10gen.cc:31200 to replica set remove2-rs1 m31100| Thu Mar 7 08:46:04 [conn14] successfully connected to new host bs-linux32.10gen.cc:31200 in replica set remove2-rs1 m31100| Thu Mar 7 08:46:04 [conn14] trying to add new host bs-linux32.10gen.cc:31201 to replica set remove2-rs1 m31100| Thu Mar 7 08:46:04 [conn14] successfully connected to new host bs-linux32.10gen.cc:31201 in replica set remove2-rs1 m31100| Thu Mar 7 08:46:04 [conn14] Primary for replica set remove2-rs1 changed to bs-linux32.10gen.cc:31200 m31100| Thu Mar 7 08:46:04 [conn14] replica set monitor for replica set remove2-rs1 started, address is remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31100| Thu Mar 7 08:46:04 [ReplicaSetMonitorWatcher] starting m31100| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:40400 #19 (14 connections now open) m31100| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:40401 #20 (15 connections now open) m31100| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:40403 #21 (16 connections now open) m31100| Thu Mar 7 08:46:04 [conn19] end connection 10.255.119.66:40400 (15 connections now open) m31100| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:40405 #22 (16 connections now open) m31101| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:44562 #9 (8 connections now open) m31101| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:44564 #10 (9 connections now open) m31200| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:58760 #16 (13 connections now open) m31200| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:58761 #17 (14 connections now open) m31200| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:58763 #18 (15 connections now open) m31200| Thu Mar 7 08:46:04 [conn16] end connection 10.255.119.66:58760 (14 connections now open) m31200| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:58765 #19 (15 connections now open) m31200| Thu Mar 7 08:46:04 [migrateThread] starting receiving-end of migration of chunk { i: MinKey } -> { i: 0.0 } for collection test.remove2 from remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 (1 slaves detected) m31200| Thu Mar 7 08:46:04 [migrateThread] starting new replica set monitor for replica set remove2-rs0 with seed of bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m31200| Thu Mar 7 08:46:04 [migrateThread] successfully connected to seed bs-linux32.10gen.cc:31100 for replica set remove2-rs0 m31200| Thu Mar 7 08:46:04 [migrateThread] changing hosts to { 0: "bs-linux32.10gen.cc:31100", 1: "bs-linux32.10gen.cc:31101" } from remove2-rs0/ m31200| Thu Mar 7 08:46:04 [migrateThread] trying to add new host bs-linux32.10gen.cc:31100 to replica set remove2-rs0 m31200| Thu Mar 7 08:46:04 [migrateThread] successfully connected to new host bs-linux32.10gen.cc:31100 in replica set remove2-rs0 m31200| Thu Mar 7 08:46:04 [migrateThread] trying to add new host bs-linux32.10gen.cc:31101 to replica set remove2-rs0 m31200| Thu Mar 7 08:46:04 [migrateThread] successfully connected to new host bs-linux32.10gen.cc:31101 in replica set remove2-rs0 m31200| Thu Mar 7 08:46:04 [migrateThread] Primary for replica set remove2-rs0 changed to bs-linux32.10gen.cc:31100 m31200| Thu Mar 7 08:46:04 [migrateThread] replica set monitor for replica set remove2-rs0 started, address is remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m31200| Thu Mar 7 08:46:04 [ReplicaSetMonitorWatcher] starting m31200| Thu Mar 7 08:46:04 [FileAllocator] allocating new datafile /data/db/remove2-rs1-0/test.ns, filling with zeroes... m31201| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:49609 #8 (8 connections now open) m31201| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:49611 #9 (9 connections now open) ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 m31200| Thu Mar 7 08:46:04 [FileAllocator] done allocating datafile /data/db/remove2-rs1-0/test.ns, size: 16MB, took 0.261 secs m31200| Thu Mar 7 08:46:04 [FileAllocator] allocating new datafile /data/db/remove2-rs1-0/test.0, filling with zeroes... ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 m31200| Thu Mar 7 08:46:04 [FileAllocator] done allocating datafile /data/db/remove2-rs1-0/test.0, size: 16MB, took 0.441 secs m31200| Thu Mar 7 08:46:04 [migrateThread] build index test.remove2 { _id: 1 } m31200| Thu Mar 7 08:46:04 [migrateThread] build index done. scanned 0 total records. 0 secs m31200| Thu Mar 7 08:46:04 [migrateThread] info: creating collection test.remove2 on add index m31200| Thu Mar 7 08:46:04 [migrateThread] build index test.remove2 { i: 1.0 } m31200| Thu Mar 7 08:46:04 [migrateThread] build index done. scanned 0 total records. 0 secs m31200| Thu Mar 7 08:46:04 [migrateThread] Waiting for replication to catch up before entering critical section m31200| Thu Mar 7 08:46:04 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: MinKey } -> { i: 0.0 } m31201| Thu Mar 7 08:46:04 [FileAllocator] allocating new datafile /data/db/remove2-rs1-1/test.ns, filling with zeroes... ShardingTest input: { "remove2-rs0" : 8, "remove2-rs1" : 0 } min: 0 max: 8 chunk diff: 8 m31201| Thu Mar 7 08:46:04 [conn2] end connection 10.255.119.66:43951 (8 connections now open) m31201| Thu Mar 7 08:46:04 [initandlisten] connection accepted from 10.255.119.66:49619 #10 (9 connections now open) m31100| Thu Mar 7 08:46:05 [conn14] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: MinKey }, max: { i: 0.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31100| Thu Mar 7 08:46:05 [conn14] moveChunk setting version to: 2|0||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:05 [initandlisten] connection accepted from 10.255.119.66:58773 #20 (16 connections now open) m31200| Thu Mar 7 08:46:05 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:05 [conn20] Waiting for commit to finish m31100| Thu Mar 7 08:46:05 [conn14] moveChunk migrate commit accepted by TO-shard: { active: true, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: MinKey }, max: { i: 0.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } m31100| Thu Mar 7 08:46:05 [conn14] moveChunk updating self version to: 2|1||51389a162059b9aba6310472 through { i: 0.0 } -> { i: 1.0 } for collection 'test.remove2' m31100| Thu Mar 7 08:46:05 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:05-8", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663965018), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31100| Thu Mar 7 08:46:05 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:05 [conn14] MigrateFromStatus::done Global lock acquired m31100| Thu Mar 7 08:46:05 [conn14] doing delete inline m31100| Thu Mar 7 08:46:05 [conn14] moveChunk starting delete for: test.remove2 from { i: MinKey } -> { i: 0.0 } m31100| Thu Mar 7 08:46:05 [conn14] moveChunk deleted 0 documents for test.remove2 from { i: MinKey } -> { i: 0.0 } m31100| Thu Mar 7 08:46:05 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:05 [conn14] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:05 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: MinKey } -> { i: 0.0 } m30999| Thu Mar 7 08:46:05 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 10 version: 2|1||51389a162059b9aba6310472 based on: 1|14||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:05 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. m29000| Thu Mar 7 08:46:05 [initandlisten] connection accepted from 10.255.119.66:48393 #10 (10 connections now open) m31200| Thu Mar 7 08:46:05 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:05-0", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663965017), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, step1 of 5: 716, step2 of 5: 0, step3 of 5: 0, step4 of 5: 0, step5 of 5: 293 } } m31100| Thu Mar 7 08:46:05 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:46:05 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:05-9", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663965019), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, step1 of 6: 0, step2 of 6: 4, step3 of 6: 4, step4 of 6: 1001, step5 of 6: 9, step6 of 6: 0 } } m31100| Thu Mar 7 08:46:05 [conn14] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: MinKey }, max: { i: 0.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_MinKey", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:26 r:65 w:46 reslen:37 1020ms m31201| Thu Mar 7 08:46:05 [FileAllocator] done allocating datafile /data/db/remove2-rs1-1/test.ns, size: 16MB, took 0.302 secs m31201| Thu Mar 7 08:46:05 [FileAllocator] allocating new datafile /data/db/remove2-rs1-1/test.0, filling with zeroes... ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 m31100| Thu Mar 7 08:46:05 [conn2] end connection 10.255.119.66:40313 (15 connections now open) m31100| Thu Mar 7 08:46:05 [initandlisten] connection accepted from 10.255.119.66:40411 #23 (16 connections now open) m31201| Thu Mar 7 08:46:05 [FileAllocator] done allocating datafile /data/db/remove2-rs1-1/test.0, size: 16MB, took 0.395 secs m31201| Thu Mar 7 08:46:05 [repl writer worker 1] build index test.remove2 { _id: 1 } m31201| Thu Mar 7 08:46:05 [repl writer worker 1] build index done. scanned 0 total records. 0 secs m31201| Thu Mar 7 08:46:05 [repl writer worker 1] info: creating collection test.remove2 on add index m31201| Thu Mar 7 08:46:05 [repl writer worker 1] build index test.remove2 { i: 1.0 } m31201| Thu Mar 7 08:46:05 [repl writer worker 1] build index done. scanned 0 total records. 0 secs ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 m30999| Thu Mar 7 08:46:06 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a1e2059b9aba6310474 m30999| Thu Mar 7 08:46:06 [Balancer] ns: test.remove2 going to move { _id: "test.remove2-i_0.0", lastmod: Timestamp 2000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: 0.0 }, max: { i: 1.0 }, shard: "remove2-rs0" } from: remove2-rs0 to: remove2-rs1 tag [] m30999| Thu Mar 7 08:46:06 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 2|1||000000000000000000000000 min: { i: 0.0 } max: { i: 1.0 }) remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 -> remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31100| Thu Mar 7 08:46:06 [conn14] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: 0.0 }, max: { i: 1.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31100| Thu Mar 7 08:46:06 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a1ef5a6130c4043664e m31100| Thu Mar 7 08:46:06 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:06-10", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663966030), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31100| Thu Mar 7 08:46:06 [conn14] moveChunk request accepted at version 2|1||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:06 [conn14] moveChunk number of documents: 30 m31200| Thu Mar 7 08:46:06 [migrateThread] starting receiving-end of migration of chunk { i: 0.0 } -> { i: 1.0 } for collection test.remove2 from remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 (1 slaves detected) m31200| Thu Mar 7 08:46:06 [migrateThread] Waiting for replication to catch up before entering critical section m31200| Thu Mar 7 08:46:06 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 0.0 } -> { i: 1.0 } ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 ShardingTest input: { "remove2-rs0" : 7, "remove2-rs1" : 1 } min: 1 max: 7 chunk diff: 6 m31100| Thu Mar 7 08:46:07 [conn14] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: 0.0 }, max: { i: 1.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 30, clonedBytes: 492810, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31100| Thu Mar 7 08:46:07 [conn14] moveChunk setting version to: 3|0||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:07 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:07 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:07 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 0.0 } -> { i: 1.0 } m31200| Thu Mar 7 08:46:07 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:07-1", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663967037), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, step1 of 5: 0, step2 of 5: 0, step3 of 5: 13, step4 of 5: 0, step5 of 5: 992 } } m31100| Thu Mar 7 08:46:07 [conn14] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: 0.0 }, max: { i: 1.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 30, clonedBytes: 492810, catchup: 0, steady: 0 }, ok: 1.0 } m31100| Thu Mar 7 08:46:07 [conn14] moveChunk updating self version to: 3|1||51389a162059b9aba6310472 through { i: 1.0 } -> { i: 3.0 } for collection 'test.remove2' m31100| Thu Mar 7 08:46:07 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:07-11", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663967042), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31100| Thu Mar 7 08:46:07 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:07 [conn14] MigrateFromStatus::done Global lock acquired m31100| Thu Mar 7 08:46:07 [conn14] doing delete inline m31100| Thu Mar 7 08:46:07 [conn14] moveChunk starting delete for: test.remove2 from { i: 0.0 } -> { i: 1.0 } m31100| Thu Mar 7 08:46:07 [conn14] moveChunk deleted 30 documents for test.remove2 from { i: 0.0 } -> { i: 1.0 } m31100| Thu Mar 7 08:46:07 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:07 [conn14] MigrateFromStatus::done Global lock acquired m31100| Thu Mar 7 08:46:07 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:46:07 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:07-12", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663967050), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, step1 of 6: 0, step2 of 6: 6, step3 of 6: 0, step4 of 6: 1002, step5 of 6: 8, step6 of 6: 7 } } m31100| Thu Mar 7 08:46:07 [conn14] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: 0.0 }, max: { i: 1.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:26 r:104 w:7268 reslen:37 1026ms m30999| Thu Mar 7 08:46:07 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 11 version: 3|1||51389a162059b9aba6310472 based on: 2|1||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:07 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 m31200| Thu Mar 7 08:46:07 [conn2] end connection 10.255.119.66:58682 (15 connections now open) m31200| Thu Mar 7 08:46:07 [initandlisten] connection accepted from 10.255.119.66:58778 #21 (16 connections now open) ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 m30999| Thu Mar 7 08:46:08 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a202059b9aba6310475 m30999| Thu Mar 7 08:46:08 [Balancer] ns: test.remove2 going to move { _id: "test.remove2-i_1.0", lastmod: Timestamp 3000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: 1.0 }, max: { i: 3.0 }, shard: "remove2-rs0" } from: remove2-rs0 to: remove2-rs1 tag [] m30999| Thu Mar 7 08:46:08 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 3|1||000000000000000000000000 min: { i: 1.0 } max: { i: 3.0 }) remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 -> remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31100| Thu Mar 7 08:46:08 [conn14] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: 1.0 }, max: { i: 3.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_1.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31100| Thu Mar 7 08:46:08 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a20f5a6130c4043664f m31100| Thu Mar 7 08:46:08 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:08-13", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663968056), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31200| Thu Mar 7 08:46:08 [migrateThread] starting receiving-end of migration of chunk { i: 1.0 } -> { i: 3.0 } for collection test.remove2 from remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 (1 slaves detected) m31100| Thu Mar 7 08:46:08 [conn14] moveChunk request accepted at version 3|1||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:08 [conn14] moveChunk number of documents: 60 m31200| Thu Mar 7 08:46:08 [migrateThread] Waiting for replication to catch up before entering critical section m31200| Thu Mar 7 08:46:08 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 1.0 } -> { i: 3.0 } ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 ShardingTest input: { "remove2-rs0" : 6, "remove2-rs1" : 2 } min: 2 max: 6 chunk diff: 4 m31100| Thu Mar 7 08:46:09 [conn14] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: 1.0 }, max: { i: 3.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31100| Thu Mar 7 08:46:09 [conn14] moveChunk setting version to: 4|0||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:09 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:09 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:09 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:09 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:09 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 1.0 } -> { i: 3.0 } m31200| Thu Mar 7 08:46:09 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:09-2", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663969073), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, step1 of 5: 2, step2 of 5: 0, step3 of 5: 25, step4 of 5: 0, step5 of 5: 987 } } m31100| Thu Mar 7 08:46:09 [conn14] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: 1.0 }, max: { i: 3.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } m31100| Thu Mar 7 08:46:09 [conn14] moveChunk updating self version to: 4|1||51389a162059b9aba6310472 through { i: 3.0 } -> { i: 5.0 } for collection 'test.remove2' m31100| Thu Mar 7 08:46:09 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:09-14", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663969078), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31100| Thu Mar 7 08:46:09 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:09 [conn14] MigrateFromStatus::done Global lock acquired m31100| Thu Mar 7 08:46:09 [conn14] doing delete inline m31100| Thu Mar 7 08:46:09 [conn14] moveChunk starting delete for: test.remove2 from { i: 1.0 } -> { i: 3.0 } m31100| Thu Mar 7 08:46:09 [conn14] moveChunk deleted 60 documents for test.remove2 from { i: 1.0 } -> { i: 3.0 } m31100| Thu Mar 7 08:46:09 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:09 [conn14] MigrateFromStatus::done Global lock acquired m31100| Thu Mar 7 08:46:09 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:46:09 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:09-15", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663969085), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, step1 of 6: 0, step2 of 6: 1, step3 of 6: 0, step4 of 6: 1003, step5 of 6: 16, step6 of 6: 6 } } m31100| Thu Mar 7 08:46:09 [conn14] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: 1.0 }, max: { i: 3.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_1.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:26 r:136 w:6518 reslen:37 1029ms m30999| Thu Mar 7 08:46:09 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 12 version: 4|1||51389a162059b9aba6310472 based on: 3|1||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:09 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 m31100| Thu Mar 7 08:46:10 [conn14] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: 3.0 }, max: { i: 5.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_3.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31100| Thu Mar 7 08:46:10 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' acquired, ts : 51389a22f5a6130c40436650 m31100| Thu Mar 7 08:46:10 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:10-16", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663970093), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31100| Thu Mar 7 08:46:10 [conn14] moveChunk request accepted at version 4|1||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:10 [conn14] moveChunk number of documents: 60 m30999| Thu Mar 7 08:46:10 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a222059b9aba6310476 m30999| Thu Mar 7 08:46:10 [Balancer] ns: test.remove2 going to move { _id: "test.remove2-i_3.0", lastmod: Timestamp 4000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: 3.0 }, max: { i: 5.0 }, shard: "remove2-rs0" } from: remove2-rs0 to: remove2-rs1 tag [] m30999| Thu Mar 7 08:46:10 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 lastmod: 4|1||000000000000000000000000 min: { i: 3.0 } max: { i: 5.0 }) remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 -> remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31200| Thu Mar 7 08:46:10 [migrateThread] starting receiving-end of migration of chunk { i: 3.0 } -> { i: 5.0 } for collection test.remove2 from remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 (1 slaves detected) m31200| Thu Mar 7 08:46:10 [migrateThread] Waiting for replication to catch up before entering critical section m31200| Thu Mar 7 08:46:10 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 3.0 } -> { i: 5.0 } ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 ShardingTest input: { "remove2-rs0" : 5, "remove2-rs1" : 3 } min: 3 max: 5 chunk diff: 2 m31100| Thu Mar 7 08:46:11 [conn14] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: 3.0 }, max: { i: 5.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31100| Thu Mar 7 08:46:11 [conn14] moveChunk setting version to: 5|0||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:11 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:11 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:11 [conn20] Waiting for commit to finish m31200| Thu Mar 7 08:46:11 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 3.0 } -> { i: 5.0 } m31200| Thu Mar 7 08:46:11 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:11-3", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663971106), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, step1 of 5: 3, step2 of 5: 0, step3 of 5: 18, step4 of 5: 0, step5 of 5: 986 } } m31100| Thu Mar 7 08:46:11 [conn14] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", min: { i: 3.0 }, max: { i: 5.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } m31100| Thu Mar 7 08:46:11 [conn14] moveChunk updating self version to: 5|1||51389a162059b9aba6310472 through { i: 5.0 } -> { i: 6.0 } for collection 'test.remove2' m31100| Thu Mar 7 08:46:11 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:11-17", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663971110), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, from: "remove2-rs0", to: "remove2-rs1" } } m31100| Thu Mar 7 08:46:11 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:11 [conn14] MigrateFromStatus::done Global lock acquired m31100| Thu Mar 7 08:46:11 [conn14] doing delete inline m31100| Thu Mar 7 08:46:11 [conn14] moveChunk starting delete for: test.remove2 from { i: 3.0 } -> { i: 5.0 } m31100| Thu Mar 7 08:46:11 [conn14] moveChunk deleted 60 documents for test.remove2 from { i: 3.0 } -> { i: 5.0 } m31100| Thu Mar 7 08:46:11 [conn14] MigrateFromStatus::done About to acquire global write lock to exit critical section m31100| Thu Mar 7 08:46:11 [conn14] MigrateFromStatus::done Global lock acquired m30999| Thu Mar 7 08:46:11 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 13 version: 5|1||51389a162059b9aba6310472 based on: 4|1||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:11 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. m31100| Thu Mar 7 08:46:11 [conn14] distributed lock 'test.remove2/bs-linux32.10gen.cc:31100:1362663958:463284344' unlocked. m31100| Thu Mar 7 08:46:11 [conn14] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:11-18", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:40367", time: new Date(1362663971120), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, step1 of 6: 0, step2 of 6: 1, step3 of 6: 0, step4 of 6: 1003, step5 of 6: 12, step6 of 6: 5 } } m31100| Thu Mar 7 08:46:11 [conn14] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", to: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", fromShard: "remove2-rs0", toShard: "remove2-rs1", min: { i: 3.0 }, max: { i: 5.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_3.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:30 r:136 w:5696 reslen:37 1028ms ShardingTest input: { "remove2-rs0" : 4, "remove2-rs1" : 4 } min: 4 max: 4 chunk diff: 0 m31200| Thu Mar 7 08:46:11 [conn14] no current chunk manager found for this shard, will initialize m31200| Thu Mar 7 08:46:11 [initandlisten] connection accepted from 10.255.119.66:58783 #22 (17 connections now open) --- Sharding Status --- sharding version: { "_id" : 1, "version" : 3 } shards: { "_id" : "remove2-rs0", "host" : "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101" } { "_id" : "remove2-rs1", "host" : "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201" } databases: { "_id" : "admin", "partitioned" : false, "primary" : "config" } { "_id" : "test", "partitioned" : true, "primary" : "remove2-rs0" } test.remove2 chunks: remove2-rs1 4 remove2-rs0 4 { "i" : { $minKey : 1 } } -->> { "i" : 0 } on : remove2-rs1 Timestamp(2000, 0) { "i" : 0 } -->> { "i" : 1 } on : remove2-rs1 Timestamp(3000, 0) { "i" : 1 } -->> { "i" : 3 } on : remove2-rs1 Timestamp(4000, 0) { "i" : 3 } -->> { "i" : 5 } on : remove2-rs1 Timestamp(5000, 0) { "i" : 5 } -->> { "i" : 6 } on : remove2-rs0 Timestamp(5000, 1) { "i" : 6 } -->> { "i" : 7 } on : remove2-rs0 Timestamp(1000, 13) { "i" : 7 } -->> { "i" : 9 } on : remove2-rs0 Timestamp(1000, 14) { "i" : 9 } -->> { "i" : { $maxKey : 1 } } on : remove2-rs0 Timestamp(1000, 4) ---- Attempting to remove shard and add it back in ---- Removing shard with name: remove2-rs1 m30999| Thu Mar 7 08:46:11 [conn1] going to start draining shard: remove2-rs1 m30999| primaryLocalDoc: { _id: "local", primary: "remove2-rs1" } { "msg" : "draining started successfully", "state" : "started", "shard" : "remove2-rs1", "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } m30999| Thu Mar 7 08:46:12 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a242059b9aba6310477 m30999| Thu Mar 7 08:46:12 [Balancer] going to move { _id: "test.remove2-i_MinKey", lastmod: Timestamp 2000|0, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: MinKey }, max: { i: 0.0 }, shard: "remove2-rs1" } from remove2-rs1() to remove2-rs0 m30999| Thu Mar 7 08:46:12 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 lastmod: 2|0||000000000000000000000000 min: { i: MinKey } max: { i: 0.0 }) remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 -> remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m29000| Thu Mar 7 08:46:12 [initandlisten] connection accepted from 10.255.119.66:48405 #11 (11 connections now open) m31200| Thu Mar 7 08:46:12 [conn12] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: MinKey }, max: { i: 0.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_MinKey", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31200| Thu Mar 7 08:46:12 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' acquired, ts : 51389a2405a3bc487a6a541b m31200| Thu Mar 7 08:46:12 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:12-4", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663972131), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m31200| Thu Mar 7 08:46:12 [conn12] moveChunk request accepted at version 5|0||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:12 [conn12] moveChunk number of documents: 0 m31200| Thu Mar 7 08:46:12 [LockPinger] creating distributed lock ping thread for bs-linux32.10gen.cc:29000 and process bs-linux32.10gen.cc:31200:1362663972:208853604 (sleeping for 30000ms) m31100| Thu Mar 7 08:46:12 [migrateThread] starting receiving-end of migration of chunk { i: MinKey } -> { i: 0.0 } for collection test.remove2 from remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 (1 slaves detected) { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } m31100| Thu Mar 7 08:46:12 [migrateThread] Waiting for replication to catch up before entering critical section m31100| Thu Mar 7 08:46:12 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: MinKey } -> { i: 0.0 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(4), "dbs" : NumberLong(0) }, "ok" : 1 } m31200| Thu Mar 7 08:46:13 [conn12] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: MinKey }, max: { i: 0.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31200| Thu Mar 7 08:46:13 [conn12] moveChunk setting version to: 6|0||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:13 [initandlisten] connection accepted from 10.255.119.66:40421 #24 (17 connections now open) m31100| Thu Mar 7 08:46:13 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:13 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:13 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: MinKey } -> { i: 0.0 } m31100| Thu Mar 7 08:46:13 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:13-19", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663973138), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, step1 of 5: 1, step2 of 5: 0, step3 of 5: 2, step4 of 5: 0, step5 of 5: 995 } } m31200| Thu Mar 7 08:46:13 [conn12] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: MinKey }, max: { i: 0.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } m31200| Thu Mar 7 08:46:13 [conn12] moveChunk updating self version to: 6|1||51389a162059b9aba6310472 through { i: 0.0 } -> { i: 1.0 } for collection 'test.remove2' m31200| Thu Mar 7 08:46:13 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:13-5", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663973142), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m31200| Thu Mar 7 08:46:13 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:13 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:13 [conn12] doing delete inline m31200| Thu Mar 7 08:46:13 [conn12] moveChunk starting delete for: test.remove2 from { i: MinKey } -> { i: 0.0 } m31200| Thu Mar 7 08:46:13 [conn12] moveChunk deleted 0 documents for test.remove2 from { i: MinKey } -> { i: 0.0 } m31200| Thu Mar 7 08:46:13 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:13 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:13 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' unlocked. m31200| Thu Mar 7 08:46:13 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:13-6", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663973146), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: MinKey }, max: { i: 0.0 }, step1 of 6: 0, step2 of 6: 3, step3 of 6: 0, step4 of 6: 1001, step5 of 6: 8, step6 of 6: 0 } } m31200| Thu Mar 7 08:46:13 [conn12] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: MinKey }, max: { i: 0.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_MinKey", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:3182 r:90 w:44 reslen:37 1018ms m30999| Thu Mar 7 08:46:13 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 14 version: 6|1||51389a162059b9aba6310472 based on: 5|1||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:13 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } m30999| Thu Mar 7 08:46:14 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a262059b9aba6310478 m31200| Thu Mar 7 08:46:14 [conn12] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: 0.0 }, max: { i: 1.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31200| Thu Mar 7 08:46:14 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' acquired, ts : 51389a2605a3bc487a6a541c m31200| Thu Mar 7 08:46:14 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:14-7", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663974153), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m30999| Thu Mar 7 08:46:14 [Balancer] going to move { _id: "test.remove2-i_0.0", lastmod: Timestamp 6000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: 0.0 }, max: { i: 1.0 }, shard: "remove2-rs1" } from remove2-rs1() to remove2-rs0 m30999| Thu Mar 7 08:46:14 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 lastmod: 6|1||000000000000000000000000 min: { i: 0.0 } max: { i: 1.0 }) remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 -> remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m31200| Thu Mar 7 08:46:14 [conn12] moveChunk request accepted at version 6|1||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:14 [conn12] moveChunk number of documents: 30 m31100| Thu Mar 7 08:46:14 [migrateThread] starting receiving-end of migration of chunk { i: 0.0 } -> { i: 1.0 } for collection test.remove2 from remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 (1 slaves detected) m31100| Thu Mar 7 08:46:14 [migrateThread] Waiting for replication to catch up before entering critical section m31100| Thu Mar 7 08:46:14 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 0.0 } -> { i: 1.0 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(3), "dbs" : NumberLong(0) }, "ok" : 1 } m31200| Thu Mar 7 08:46:15 [conn12] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: 0.0 }, max: { i: 1.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 30, clonedBytes: 492810, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31200| Thu Mar 7 08:46:15 [conn12] moveChunk setting version to: 7|0||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:15 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:15 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:15 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:15 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:15 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 0.0 } -> { i: 1.0 } m31100| Thu Mar 7 08:46:15 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:15-20", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663975170), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, step1 of 5: 0, step2 of 5: 0, step3 of 5: 7, step4 of 5: 0, step5 of 5: 1007 } } m31200| Thu Mar 7 08:46:15 [conn12] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: 0.0 }, max: { i: 1.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 30, clonedBytes: 492810, catchup: 0, steady: 0 }, ok: 1.0 } m31200| Thu Mar 7 08:46:15 [conn12] moveChunk updating self version to: 7|1||51389a162059b9aba6310472 through { i: 1.0 } -> { i: 3.0 } for collection 'test.remove2' m31200| Thu Mar 7 08:46:15 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:15-8", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663975174), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m31200| Thu Mar 7 08:46:15 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:15 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:15 [conn12] doing delete inline m31200| Thu Mar 7 08:46:15 [conn12] moveChunk starting delete for: test.remove2 from { i: 0.0 } -> { i: 1.0 } m31200| Thu Mar 7 08:46:15 [conn12] moveChunk deleted 30 documents for test.remove2 from { i: 0.0 } -> { i: 1.0 } m31200| Thu Mar 7 08:46:15 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:15 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:15 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' unlocked. m31200| Thu Mar 7 08:46:15 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:15-9", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663975183), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: 0.0 }, max: { i: 1.0 }, step1 of 6: 0, step2 of 6: 1, step3 of 6: 0, step4 of 6: 1003, step5 of 6: 16, step6 of 6: 7 } } m31200| Thu Mar 7 08:46:15 [conn12] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: 0.0 }, max: { i: 1.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_0.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:25 r:101 w:7449 reslen:37 1030ms m30999| Thu Mar 7 08:46:15 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 15 version: 7|1||51389a162059b9aba6310472 based on: 6|1||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:15 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } m30999| Thu Mar 7 08:46:16 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a282059b9aba6310479 m31200| Thu Mar 7 08:46:16 [conn12] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: 1.0 }, max: { i: 3.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_1.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31200| Thu Mar 7 08:46:16 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' acquired, ts : 51389a2805a3bc487a6a541d m31200| Thu Mar 7 08:46:16 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:16-10", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663976189), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m30999| Thu Mar 7 08:46:16 [Balancer] going to move { _id: "test.remove2-i_1.0", lastmod: Timestamp 7000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: 1.0 }, max: { i: 3.0 }, shard: "remove2-rs1" } from remove2-rs1() to remove2-rs0 m30999| Thu Mar 7 08:46:16 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 lastmod: 7|1||000000000000000000000000 min: { i: 1.0 } max: { i: 3.0 }) remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 -> remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m31200| Thu Mar 7 08:46:16 [conn12] moveChunk request accepted at version 7|1||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:16 [conn12] moveChunk number of documents: 60 m31100| Thu Mar 7 08:46:16 [migrateThread] starting receiving-end of migration of chunk { i: 1.0 } -> { i: 3.0 } for collection test.remove2 from remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 (1 slaves detected) m31100| Thu Mar 7 08:46:16 [migrateThread] Waiting for replication to catch up before entering critical section m31100| Thu Mar 7 08:46:16 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 1.0 } -> { i: 3.0 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(2), "dbs" : NumberLong(0) }, "ok" : 1 } m31200| Thu Mar 7 08:46:17 [conn12] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: 1.0 }, max: { i: 3.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31200| Thu Mar 7 08:46:17 [conn12] moveChunk setting version to: 8|0||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:17 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:17 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:17 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:17 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 1.0 } -> { i: 3.0 } m31100| Thu Mar 7 08:46:17 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:17-21", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663977202), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, step1 of 5: 2, step2 of 5: 0, step3 of 5: 18, step4 of 5: 0, step5 of 5: 989 } } m31200| Thu Mar 7 08:46:17 [conn12] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: 1.0 }, max: { i: 3.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } m31200| Thu Mar 7 08:46:17 [conn12] moveChunk updating self version to: 8|1||51389a162059b9aba6310472 through { i: 3.0 } -> { i: 5.0 } for collection 'test.remove2' m31200| Thu Mar 7 08:46:17 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:17-11", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663977206), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m31200| Thu Mar 7 08:46:17 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:17 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:17 [conn12] doing delete inline m31200| Thu Mar 7 08:46:17 [conn12] moveChunk starting delete for: test.remove2 from { i: 1.0 } -> { i: 3.0 } m30999| Thu Mar 7 08:46:17 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 16 version: 8|1||51389a162059b9aba6310472 based on: 7|1||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:17 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. m31200| Thu Mar 7 08:46:17 [conn12] moveChunk deleted 60 documents for test.remove2 from { i: 1.0 } -> { i: 3.0 } m31200| Thu Mar 7 08:46:17 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:17 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:17 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' unlocked. m31200| Thu Mar 7 08:46:17 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:17-12", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663977213), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: 1.0 }, max: { i: 3.0 }, step1 of 6: 0, step2 of 6: 1, step3 of 6: 0, step4 of 6: 1003, step5 of 6: 12, step6 of 6: 6 } } m31200| Thu Mar 7 08:46:17 [conn12] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: 1.0 }, max: { i: 3.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_1.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:26 r:129 w:6150 reslen:37 1024ms { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } m30999| Thu Mar 7 08:46:18 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' acquired, ts : 51389a2a2059b9aba631047a m31200| Thu Mar 7 08:46:18 [conn12] received moveChunk request: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: 3.0 }, max: { i: 5.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_3.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } m31200| Thu Mar 7 08:46:18 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' acquired, ts : 51389a2a05a3bc487a6a541e m31200| Thu Mar 7 08:46:18 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:18-13", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663978221), what: "moveChunk.start", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m31200| Thu Mar 7 08:46:18 [conn12] moveChunk request accepted at version 8|1||51389a162059b9aba6310472 m31200| Thu Mar 7 08:46:18 [conn12] moveChunk number of documents: 60 m31100| Thu Mar 7 08:46:18 [migrateThread] starting receiving-end of migration of chunk { i: 3.0 } -> { i: 5.0 } for collection test.remove2 from remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 (1 slaves detected) m30999| Thu Mar 7 08:46:18 [Balancer] going to move { _id: "test.remove2-i_3.0", lastmod: Timestamp 8000|1, lastmodEpoch: ObjectId('51389a162059b9aba6310472'), ns: "test.remove2", min: { i: 3.0 }, max: { i: 5.0 }, shard: "remove2-rs1" } from remove2-rs1() to remove2-rs0 m30999| Thu Mar 7 08:46:18 [Balancer] moving chunk ns: test.remove2 moving ( ns:test.remove2 at: remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 lastmod: 8|1||000000000000000000000000 min: { i: 3.0 } max: { i: 5.0 }) remove2-rs1:remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 -> remove2-rs0:remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101 m31100| Thu Mar 7 08:46:18 [migrateThread] Waiting for replication to catch up before entering critical section m31100| Thu Mar 7 08:46:18 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 3.0 } -> { i: 5.0 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } { "msg" : "draining ongoing", "state" : "ongoing", "remaining" : { "chunks" : NumberLong(1), "dbs" : NumberLong(0) }, "ok" : 1 } m31200| Thu Mar 7 08:46:19 [conn12] moveChunk data transfer progress: { active: true, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: 3.0 }, max: { i: 5.0 }, shardKeyPattern: { i: 1 }, state: "steady", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m31200| Thu Mar 7 08:46:19 [conn12] moveChunk setting version to: 9|0||51389a162059b9aba6310472 m31100| Thu Mar 7 08:46:19 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:19 [conn24] Waiting for commit to finish m31100| Thu Mar 7 08:46:19 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.remove2' { i: 3.0 } -> { i: 5.0 } m31100| Thu Mar 7 08:46:19 [migrateThread] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:19-22", server: "bs-linux32.10gen.cc", clientAddr: ":27017", time: new Date(1362663979230), what: "moveChunk.to", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, step1 of 5: 2, step2 of 5: 0, step3 of 5: 20, step4 of 5: 0, step5 of 5: 983 } } m31200| Thu Mar 7 08:46:19 [conn12] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", min: { i: 3.0 }, max: { i: 5.0 }, shardKeyPattern: { i: 1 }, state: "done", counts: { cloned: 60, clonedBytes: 985620, catchup: 0, steady: 0 }, ok: 1.0 } m31200| Thu Mar 7 08:46:19 [conn12] moveChunk moved last chunk out for collection 'test.remove2' m31200| Thu Mar 7 08:46:19 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:19-14", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663979234), what: "moveChunk.commit", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, from: "remove2-rs1", to: "remove2-rs0" } } m31200| Thu Mar 7 08:46:19 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:19 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:19 [conn12] doing delete inline m31200| Thu Mar 7 08:46:19 [conn12] moveChunk starting delete for: test.remove2 from { i: 3.0 } -> { i: 5.0 } m31200| Thu Mar 7 08:46:19 [conn12] moveChunk deleted 60 documents for test.remove2 from { i: 3.0 } -> { i: 5.0 } m31200| Thu Mar 7 08:46:19 [conn12] MigrateFromStatus::done About to acquire global write lock to exit critical section m31200| Thu Mar 7 08:46:19 [conn12] MigrateFromStatus::done Global lock acquired m31200| Thu Mar 7 08:46:19 [conn12] distributed lock 'test.remove2/bs-linux32.10gen.cc:31200:1362663972:208853604' unlocked. m31200| Thu Mar 7 08:46:19 [conn12] about to log metadata event: { _id: "bs-linux32.10gen.cc-2013-03-07T13:46:19-15", server: "bs-linux32.10gen.cc", clientAddr: "10.255.119.66:58739", time: new Date(1362663979245), what: "moveChunk.from", ns: "test.remove2", details: { min: { i: 3.0 }, max: { i: 5.0 }, step1 of 6: 0, step2 of 6: 1, step3 of 6: 0, step4 of 6: 1003, step5 of 6: 8, step6 of 6: 10 } } m31200| Thu Mar 7 08:46:19 [conn12] command admin.$cmd command: { moveChunk: "test.remove2", from: "remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201", to: "remove2-rs0/bs-linux32.10gen.cc:31100,bs-linux32.10gen.cc:31101", fromShard: "remove2-rs1", toShard: "remove2-rs0", min: { i: 3.0 }, max: { i: 5.0 }, maxChunkSizeBytes: 1048576, shardId: "test.remove2-i_3.0", configdb: "bs-linux32.10gen.cc:29000", secondaryThrottle: false } ntoreturn:1 keyUpdates:0 locks(micros) W:42 r:128 w:5941 reslen:37 1024ms m30999| Thu Mar 7 08:46:19 [Balancer] ChunkManager: time to load chunks for test.remove2: 0ms sequenceNumber: 17 version: 9|0||51389a162059b9aba6310472 based on: 8|1||51389a162059b9aba6310472 m30999| Thu Mar 7 08:46:19 [Balancer] distributed lock 'balancer/bs-linux32.10gen.cc:30999:1362663957:1804289383' unlocked. m30999| Thu Mar 7 08:46:19 [conn1] going to remove shard: remove2-rs1 m30999| Thu Mar 7 08:46:19 [conn1] deleting replica set monitor for: remove2-rs1/bs-linux32.10gen.cc:31200,bs-linux32.10gen.cc:31201 m31201| Thu Mar 7 08:46:19 [conn5] end connection 10.255.119.66:49583 (8 connections now open) { "msg" : "removeshard completed successfully", "state" : "completed", "shard" : "remove2-rs1", "ok" : 1 } m31200| Thu Mar 7 08:46:19 [conn12] end connection 10.255.119.66:58739 (16 connections now open) m31200| Thu Mar 7 08:46:19 [conn10] end connection 10.255.119.66:58735 (15 connections now open) [ { "_id" : "balancer", "process" : "bs-linux32.10gen.cc:30999:1362663957:1804289383", "state" : 0, "ts" : ObjectId("51389a2a2059b9aba631047a"), "when" : ISODate("2013-03-07T13:46:18.218Z"), "who" : "bs-linux32.10gen.cc:30999:1362663957:1804289383:Balancer:846930886", "why" : "doing balance round" }, { "_id" : "test.remove2", "process" : "bs-linux32.10gen.cc:31200:1362663972:208853604", "state" : 0, "ts" : ObjectId("51389a2a05a3bc487a6a541e"), "when" : ISODate("2013-03-07T13:46:18.221Z"), "who" : "bs-linux32.10gen.cc:31200:1362663972:208853604:conn12:1136942858", "why" : "migrate-{ i: 3.0 }" } ] Thu Mar 7 08:46:19 TypeError: allCurrent[i].name has no properties src/mongo/shell/shardingtest.js:981 failed to load: /mnt/slaves/Linux_32bit_V2.2/mongo/jstests/sharding/remove2.js m29000| Thu Mar 7 08:46:19 got signal 15 (Terminated), will terminate after current cmd ends m29000| Thu Mar 7 08:46:19 [interruptThread] now exiting m29000| Thu Mar 7 08:46:19 dbexit: m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: going to close listening sockets... m29000| Thu Mar 7 08:46:19 [interruptThread] closing listening socket: 33 m29000| Thu Mar 7 08:46:19 [interruptThread] closing listening socket: 34 m29000| Thu Mar 7 08:46:19 [interruptThread] closing listening socket: 35 m29000| Thu Mar 7 08:46:19 [interruptThread] removing socket file: /tmp/mongodb-29000.sock m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: going to flush diaglog... m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: going to close sockets... m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: waiting for fs preallocator... m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: lock for final commit... m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: final commit... m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: closing all files... m29000| Thu Mar 7 08:46:19 [interruptThread] closeAllFiles() finished m29000| Thu Mar 7 08:46:19 [interruptThread] journalCleanup... m29000| Thu Mar 7 08:46:19 [interruptThread] removeJournalFiles m29000| Thu Mar 7 08:46:19 [interruptThread] shutdown: removing fs lock... m29000| Thu Mar 7 08:46:19 dbexit: really exiting now m30999| Thu Mar 7 08:46:20 [Balancer] DBClientCursor::init call() failed m30999| Thu Mar 7 08:46:20 [Balancer] Assertion: 13632:couldn't get updated shard list from config server m30999| 0x845a85a 0x8439b45 0x841f060 0x83a9b54 0x83a56b0 0x82d52d9 0x84237e4 0x84243ae 0x84a4d1e 0x29e542 0xf74b6e m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5mongo15printStackTraceERSo+0x2a) [0x845a85a] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5mongo10logContextEPKc+0xa5) [0x8439b45] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5mongo11msgassertedEiPKc+0xc0) [0x841f060] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0xdf4) [0x83a9b54] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5mongo5Shard15reloadShardInfoEv+0x20) [0x83a56b0] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5mongo8Balancer3runEv+0x249) [0x82d52d9] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5mongo13BackgroundJob7jobBodyEN5boost10shared_ptrINS0_9JobStatusEEE+0xb4) [0x84237e4] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos(_ZN5boost6detail11thread_dataINS_3_bi6bind_tIvNS_4_mfi3mf1IvN5mongo13BackgroundJobENS_10shared_ptrINS7_9JobStatusEEEEENS2_5list2INS2_5valueIPS7_EENSD_ISA_EEEEEEE3runEv+0x7e) [0x84243ae] m30999| /mnt/slaves/Linux_32bit_V2.2/mongo/mongos [0x84a4d1e] m30999| /lib/i686/nosegneg/libpthread.so.0 [0x29e542] m30999| /lib/i686/nosegneg/libc.so.6(clone+0x5e) [0xf74b6e] m30999| Thu Mar 7 08:46:20 [Balancer] scoped connection to bs-linux32.10gen.cc:29000 not being returned to the pool m30999| Thu Mar 7 08:46:20 [Balancer] caught exception while doing balance: couldn't get updated shard list from config server m30999| Thu Mar 7 08:46:20 [mongosMain] dbexit: received signal 15 rc:0 received signal 15 m31101| Thu Mar 7 08:46:20 [conn6] end connection 10.255.119.66:44526 (8 connections now open) m31100| Thu Mar 7 08:46:20 [conn12] end connection 10.255.119.66:40363 (16 connections now open) m31101| Thu Mar 7 08:46:20 [conn5] end connection 10.255.119.66:44524 (7 connections now open) m31100| Thu Mar 7 08:46:20 [conn13] end connection 10.255.119.66:40365 (15 connections now open) m31100| Thu Mar 7 08:46:20 [conn14] end connection 10.255.119.66:40367 (14 connections now open) m31201| Thu Mar 7 08:46:20 [conn6] end connection 10.255.119.66:49585 (7 connections now open) m31200| Thu Mar 7 08:46:20 [conn11] end connection 10.255.119.66:58737 (14 connections now open) m31100| Thu Mar 7 08:46:20 [conn15] end connection 10.255.119.66:40375 (13 connections now open) m31100| Thu Mar 7 08:46:20 [conn17] end connection 10.255.119.66:40378 (12 connections now open) m31200| Thu Mar 7 08:46:20 [conn13] end connection 10.255.119.66:58746 (13 connections now open) m31200| Thu Mar 7 08:46:20 [conn14] end connection 10.255.119.66:58747 (12 connections now open) m31200| Thu Mar 7 08:46:20 [conn22] end connection 10.255.119.66:58783 (11 connections now open) m31100| Thu Mar 7 08:46:20 [conn18] end connection 10.255.119.66:40387 (11 connections now open) m31100| Thu Mar 7 08:46:21 got signal 15 (Terminated), will terminate after current cmd ends m31100| Thu Mar 7 08:46:21 [interruptThread] now exiting m31100| Thu Mar 7 08:46:21 dbexit: m31100| Thu Mar 7 08:46:21 [interruptThread] shutdown: going to close listening sockets... m31100| Thu Mar 7 08:46:21 [interruptThread] closing listening socket: 12 m31100| Thu Mar 7 08:46:21 [interruptThread] closing listening socket: 13 m31100| Thu Mar 7 08:46:21 [interruptThread] closing listening socket: 14 m31100| Thu Mar 7 08:46:21 [interruptThread] removing socket file: /tmp/mongodb-31100.sock m31100| Thu Mar 7 08:46:21 [interruptThread] shutdown: going to flush diaglog... m31100| Thu Mar 7 08:46:21 [interruptThread] shutdown: going to close sockets... m31100| Thu Mar 7 08:46:21 [interruptThread] shutdown: waiting for fs preallocator... m31100| Thu Mar 7 08:46:21 [interruptThread] shutdown: closing all files... m31101| Thu Mar 7 08:46:21 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: bs-linux32.10gen.cc:31100 m31101| Thu Mar 7 08:46:21 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: bs-linux32.10gen.cc:31100 m31101| Thu Mar 7 08:46:21 [conn8] end connection 10.255.119.66:44551 (6 connections now open) m31201| Thu Mar 7 08:46:21 [conn8] end connection 10.255.119.66:49609 (6 connections now open) m31201| Thu Mar 7 08:46:21 [conn9] end connection 10.255.119.66:49611 (5 connections now open) m31200| Thu Mar 7 08:46:21 [conn17] end connection 10.255.119.66:58761 (10 connections now open) m31200| Thu Mar 7 08:46:21 [conn18] end connection 10.255.119.66:58763 (9 connections now open) m31200| Thu Mar 7 08:46:21 [conn19] end connection 10.255.119.66:58765 (8 connections now open) m31200| Thu Mar 7 08:46:21 [conn20] end connection 10.255.119.66:58773 (7 connections now open) m31100| Thu Mar 7 08:46:21 [interruptThread] closeAllFiles() finished m31100| Thu Mar 7 08:46:21 [interruptThread] shutdown: removing fs lock... m31100| Thu Mar 7 08:46:21 dbexit: really exiting now m31101| Thu Mar 7 08:46:22 got signal 15 (Terminated), will terminate after current cmd ends m31101| Thu Mar 7 08:46:22 [interruptThread] now exiting m31101| Thu Mar 7 08:46:22 dbexit: m31101| Thu Mar 7 08:46:22 [interruptThread] shutdown: going to close listening sockets... m31101| Thu Mar 7 08:46:22 [interruptThread] closing listening socket: 15 m31101| Thu Mar 7 08:46:22 [interruptThread] closing listening socket: 16 m31101| Thu Mar 7 08:46:22 [interruptThread] closing listening socket: 17 m31101| Thu Mar 7 08:46:22 [interruptThread] removing socket file: /tmp/mongodb-31101.sock m31101| Thu Mar 7 08:46:22 [interruptThread] shutdown: going to flush diaglog... m31101| Thu Mar 7 08:46:22 [interruptThread] shutdown: going to close sockets... m31101| Thu Mar 7 08:46:22 [interruptThread] shutdown: waiting for fs preallocator... m31101| Thu Mar 7 08:46:22 [interruptThread] shutdown: closing all files... m31101| Thu Mar 7 08:46:22 [interruptThread] closeAllFiles() finished m31101| Thu Mar 7 08:46:22 [interruptThread] shutdown: removing fs lock... m31101| Thu Mar 7 08:46:22 dbexit: really exiting now m31200| Thu Mar 7 08:46:23 got signal 15 (Terminated), will terminate after current cmd ends m31200| Thu Mar 7 08:46:23 [interruptThread] now exiting m31200| Thu Mar 7 08:46:23 dbexit: m31200| Thu Mar 7 08:46:23 [interruptThread] shutdown: going to close listening sockets... m31200| Thu Mar 7 08:46:23 [interruptThread] closing listening socket: 18 m31200| Thu Mar 7 08:46:23 [interruptThread] closing listening socket: 19 m31200| Thu Mar 7 08:46:23 [interruptThread] closing listening socket: 20 m31200| Thu Mar 7 08:46:23 [interruptThread] removing socket file: /tmp/mongodb-31200.sock m31200| Thu Mar 7 08:46:23 [interruptThread] shutdown: going to flush diaglog... m31200| Thu Mar 7 08:46:23 [interruptThread] shutdown: going to close sockets... m31200| Thu Mar 7 08:46:23 [interruptThread] shutdown: waiting for fs preallocator... m31200| Thu Mar 7 08:46:23 [interruptThread] shutdown: closing all files... m31201| Thu Mar 7 08:46:23 [conn10] end connection 10.255.119.66:49619 (4 connections now open) m31201| Thu Mar 7 08:46:23 [rsSyncNotifier] replset tracking exception: exception: 10278 dbclient error communicating with server: bs-linux32.10gen.cc:31200 m31201| Thu Mar 7 08:46:23 [rsBackgroundSync] replSet db exception in producer: 10278 dbclient error communicating with server: bs-linux32.10gen.cc:31200 m31200| Thu Mar 7 08:46:23 [interruptThread] closeAllFiles() finished m31200| Thu Mar 7 08:46:23 [interruptThread] shutdown: removing fs lock... m31200| Thu Mar 7 08:46:23 dbexit: really exiting now m31201| Thu Mar 7 08:46:24 got signal 15 (Terminated), will terminate after current cmd ends m31201| Thu Mar 7 08:46:24 [interruptThread] now exiting m31201| Thu Mar 7 08:46:24 dbexit: m31201| Thu Mar 7 08:46:24 [interruptThread] shutdown: going to close listening sockets... m31201| Thu Mar 7 08:46:24 [interruptThread] closing listening socket: 21 m31201| Thu Mar 7 08:46:24 [interruptThread] closing listening socket: 22 m31201| Thu Mar 7 08:46:24 [interruptThread] closing listening socket: 23 m31201| Thu Mar 7 08:46:24 [interruptThread] removing socket file: /tmp/mongodb-31201.sock m31201| Thu Mar 7 08:46:24 [interruptThread] shutdown: going to flush diaglog... m31201| Thu Mar 7 08:46:24 [interruptThread] shutdown: going to close sockets... m31201| Thu Mar 7 08:46:24 [interruptThread] shutdown: waiting for fs preallocator... m31201| Thu Mar 7 08:4 Thu Mar 7 08:46:25 got signal 15 (Terminated), will terminate after current cmd ends Thu Mar 7 08:46:25 [interruptThread] now exiting Thu Mar 7 08:46:25 dbexit: Thu Mar 7 08:46:25 [interruptThread] shutdown: going to close listening sockets... Thu Mar 7 08:46:25 [interruptThread] closing listening socket: 8 Thu Mar 7 08:46:25 [interruptThread] closing listening socket: 9 Thu Mar 7 08:46:25 [interruptThread] closing listening socket: 10 Thu Mar 7 08:46:25 [interruptThread] removing socket file: /tmp/mongodb-27999.sock Thu Mar 7 08:46:25 [interruptThread] shutdown: going to flush diaglog... Thu Mar 7 08:46:25 [interruptThread] shutdown: going to close sockets... Thu Mar 7 08:46:25 [interruptThread] shutdown: waiting for fs preallocator... Thu Mar 7 08:46:25 [interruptThread] shutdown: closing all files... Thu Mar 7 08:46:25 [interruptThread] closeAllFiles() finished Thu Mar 7 08:46:25 [interruptThread] shutdown: removing fs lock... Thu Mar 7 08:46:25 dbexit: really exiting now