num procs:305 removing: /data/db/sconsTests//mongod.lock removing: /data/db/sconsTests//local.0 removing: /data/db/sconsTests//local.ns 2014-04-02T17:50:22.261-0400 [initandlisten] MongoDB starting : pid=31520 port=27999 dbpath=/data/db/sconsTests/ 64-bit host=ubuntu 2014-04-02T17:50:22.261-0400 [initandlisten] _DEBUG build (which is slower) 2014-04-02T17:50:22.261-0400 [initandlisten] 2014-04-02T17:50:22.261-0400 [initandlisten] ** NOTE: This is a development version (2.7.0-pre-) of MongoDB. 2014-04-02T17:50:22.261-0400 [initandlisten] ** Not recommended for production. 2014-04-02T17:50:22.261-0400 [initandlisten] 2014-04-02T17:50:22.261-0400 [initandlisten] db version v2.7.0-pre- 2014-04-02T17:50:22.261-0400 [initandlisten] git version: 93b962665da9d3163cacaf55817d8d60a957a32a modules: enterprise 2014-04-02T17:50:22.261-0400 [initandlisten] OpenSSL version: OpenSSL 1.0.1 14 Mar 2012 2014-04-02T17:50:22.261-0400 [initandlisten] build info: Linux ubuntu 3.5.0-47-generic #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2014-04-02T17:50:22.261-0400 [initandlisten] allocator: tcmalloc 2014-04-02T17:50:22.261-0400 [initandlisten] options: { net: { http: { enabled: true }, port: 27999 }, setParameter: { enableTestCommands: "1" }, storage: { dbPath: "/data/db/sconsTests/", journal: { enabled: false } } } 2014-04-02T17:50:22.356-0400 [initandlisten] opening db: local 2014-04-02T17:50:22.356-0400 [initandlisten] _DEBUG ReadContext db wasn't open, will try to open admin.system.roles 2014-04-02T17:50:22.356-0400 [initandlisten] opening db: admin 2014-04-02T17:50:22.357-0400 [initandlisten] debug have W lock but w would suffice for command create 2014-04-02T17:50:22.357-0400 [FileAllocator] allocating new datafile /data/db/sconsTests/local.ns, filling with zeroes... 2014-04-02T17:50:22.357-0400 [FileAllocator] creating directory /data/db/sconsTests/_tmp 2014-04-02T17:50:22.357-0400 [IndexRebuilder] thread IndexRebuilder stack usage was 4272 bytes, which is the most so far 2014-04-02T17:50:22.406-0400 [FileAllocator] done allocating datafile /data/db/sconsTests/local.ns, size: 16MB, took 0.016 secs 2014-04-02T17:50:22.407-0400 [FileAllocator] allocating new datafile /data/db/sconsTests/local.0, filling with zeroes... 2014-04-02T17:50:22.423-0400 [FileAllocator] done allocating datafile /data/db/sconsTests/local.0, size: 64MB, took 0.014 secs 2014-04-02T17:50:22.423-0400 [initandlisten] datafileheader::init initializing /data/db/sconsTests/local.0 n:0 2014-04-02T17:50:22.424-0400 [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } 2014-04-02T17:50:22.424-0400 [initandlisten] added index to empty collection 2014-04-02T17:50:22.424-0400 [initandlisten] info PageFaultRetryableSection will not yield, already locked upon reaching 2014-04-02T17:50:22.424-0400 [initandlisten] waiting for connections on port 27999 2014-04-02T17:50:22.425-0400 [websvr] admin web console waiting for connections on port 28999 2014-04-02T17:50:23.219-0400 [initandlisten] connection accepted from 127.0.0.1:55172 #1 (1 connection now open) running /media/ssd/mongo3/mongod --port 27999 --dbpath /data/db/sconsTests/ --setParameter enableTestCommands=1 --httpinterface --nojournal ******************************************* Test : noauth_shard_collection.js ... 2014-04-02T17:50:23.219-0400 [initandlisten] connection accepted from 127.0.0.1:55173 #2 (2 connections now open) Command : /media/ssd/mongo3/mongo --port 27999 --authenticationMechanism MONGODB-CR --writeMode legacy --nodb /media/ssd/mongo3/jstests/sharding/noauth_shard_collection.js --eval TestData = new Object();TestData.testPath = "/media/ssd/mongo3/jstests/sharding/noauth_shard_collection.js";TestData.testFile = "noauth_shard_collection.js";TestData.testName = "noauth_shard_collection";TestData.setParameters = "";TestData.setParametersMongos = "";TestData.noJournal = true;TestData.noJournalPrealloc = false;TestData.auth = false;TestData.keyFile = null;TestData.keyFileData = null;TestData.authMechanism = "MONGODB-CR";TestData.useSSL = false;TestData.useX509 = false;MongoRunner.dataDir = "/data/db";MongoRunner.dataPath = MongoRunner.dataDir + "/"; Date : Wed Apr 2 17:50:23 2014 2014-04-02T17:50:23.220-0400 [conn1] end connection 127.0.0.1:55172 (1 connection now open) 2014-04-02T17:50:23.220-0400 [conn2] end connection 127.0.0.1:55173 (1 connection now open) 2014-04-02T17:50:23.220-0400 [conn1] thread conn1 stack usage was 5912 bytes, which is the most so far MongoDB shell version: 2.7.0-pre- /data/db/ Resetting db path '/data/db/auth_add_shard_collection0' 2014-04-02T17:50:23.581-0400 shell: started program /media/ssd/mongo3/mongod --port 30000 --dbpath /data/db/auth_add_shard_collection0 --nojournal --setParameter enableTestCommands=1 2014-04-02T17:50:23.583-0400 warning: Failed to connect to 127.0.0.1:30000, reason: errno:111 Connection refused m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] MongoDB starting : pid=31538 port=30000 dbpath=/data/db/auth_add_shard_collection0 64-bit host=ubuntu m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] _DEBUG build (which is slower) m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] ** NOTE: This is a development version (2.7.0-pre-) of MongoDB. m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] ** Not recommended for production. m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] db version v2.7.0-pre- m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] git version: 93b962665da9d3163cacaf55817d8d60a957a32a modules: enterprise m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] OpenSSL version: OpenSSL 1.0.1 14 Mar 2012 m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] build info: Linux ubuntu 3.5.0-47-generic #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] allocator: tcmalloc m30000| 2014-04-02T17:50:23.624-0400 [initandlisten] options: { net: { port: 30000 }, setParameter: { enableTestCommands: "1" }, storage: { dbPath: "/data/db/auth_add_shard_collection0", journal: { enabled: false } } } m30000| 2014-04-02T17:50:23.699-0400 [initandlisten] opening db: local m30000| 2014-04-02T17:50:23.699-0400 [initandlisten] _DEBUG ReadContext db wasn't open, will try to open admin.system.roles m30000| 2014-04-02T17:50:23.699-0400 [initandlisten] opening db: admin m30000| 2014-04-02T17:50:23.700-0400 [initandlisten] m30000| debug have W lock but w would suffice for command create m30000| 2014-04-02T17:50:23.700-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection0/local.ns, filling with zeroes... m30000| 2014-04-02T17:50:23.700-0400 [FileAllocator] creating directory /data/db/auth_add_shard_collection0/_tmp m30000| 2014-04-02T17:50:23.700-0400 [IndexRebuilder] thread IndexRebuilder stack usage was 3872 bytes, which is the most so far m30000| 2014-04-02T17:50:23.749-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection0/local.ns, size: 16MB, took 0.016 secs m30000| 2014-04-02T17:50:23.751-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection0/local.0, filling with zeroes... m30000| 2014-04-02T17:50:23.766-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection0/local.0, size: 64MB, took 0.015 secs m30000| 2014-04-02T17:50:23.766-0400 [initandlisten] datafileheader::init initializing /data/db/auth_add_shard_collection0/local.0 n:0 m30000| 2014-04-02T17:50:23.767-0400 [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } m30000| 2014-04-02T17:50:23.767-0400 [initandlisten] added index to empty collection m30000| 2014-04-02T17:50:23.767-0400 [initandlisten] info PageFaultRetryableSection will not yield, already locked upon reaching m30000| 2014-04-02T17:50:23.767-0400 [initandlisten] waiting for connections on port 30000 m30000| 2014-04-02T17:50:23.784-0400 [initandlisten] connection accepted from 127.0.0.1:35606 #1 (1 connection now open) Resetting db path '/data/db/auth_add_shard_collection1' 2014-04-02T17:50:23.798-0400 shell: started program /media/ssd/mongo3/mongod --port 30001 --dbpath /data/db/auth_add_shard_collection1 --nojournal --setParameter enableTestCommands=1 2014-04-02T17:50:23.799-0400 warning: Failed to connect to 127.0.0.1:30001, reason: errno:111 Connection refused m30001| 2014-04-02T17:50:23.839-0400 [initandlisten] MongoDB starting : pid=31554 port=30001 dbpath=/data/db/auth_add_shard_collection1 64-bit host=ubuntu m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] _DEBUG build (which is slower) m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] ** NOTE: This is a development version (2.7.0-pre-) of MongoDB. m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] ** Not recommended for production. m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] db version v2.7.0-pre- m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] git version: 93b962665da9d3163cacaf55817d8d60a957a32a modules: enterprise m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] OpenSSL version: OpenSSL 1.0.1 14 Mar 2012 m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] build info: Linux ubuntu 3.5.0-47-generic #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] allocator: tcmalloc m30001| 2014-04-02T17:50:23.840-0400 [initandlisten] options: { net: { port: 30001 }, setParameter: { enableTestCommands: "1" }, storage: { dbPath: "/data/db/auth_add_shard_collection1", journal: { enabled: false } } } m30001| 2014-04-02T17:50:23.917-0400 [initandlisten] opening db: local m30001| 2014-04-02T17:50:23.917-0400 [initandlisten] _DEBUG ReadContext db wasn't open, will try to open admin.system.roles m30001| 2014-04-02T17:50:23.917-0400 [initandlisten] opening db: admin m30001| 2014-04-02T17:50:23.918-0400 [initandlisten] m30001| debug have W lock but w would suffice for command create m30001| 2014-04-02T17:50:23.918-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection1/local.ns, filling with zeroes... m30001| 2014-04-02T17:50:23.918-0400 [FileAllocator] creating directory /data/db/auth_add_shard_collection1/_tmp m30001| 2014-04-02T17:50:23.919-0400 [IndexRebuilder] thread IndexRebuilder stack usage was 3872 bytes, which is the most so far m30001| 2014-04-02T17:50:23.967-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection1/local.ns, size: 16MB, took 0.016 secs m30001| 2014-04-02T17:50:23.969-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection1/local.0, filling with zeroes... m30001| 2014-04-02T17:50:23.984-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection1/local.0, size: 64MB, took 0.015 secs m30001| 2014-04-02T17:50:23.984-0400 [initandlisten] datafileheader::init initializing /data/db/auth_add_shard_collection1/local.0 n:0 m30001| 2014-04-02T17:50:23.986-0400 [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } m30001| 2014-04-02T17:50:23.986-0400 [initandlisten] added index to empty collection m30001| 2014-04-02T17:50:23.986-0400 [initandlisten] info PageFaultRetryableSection will not yield, already locked upon reaching m30001| 2014-04-02T17:50:23.986-0400 [initandlisten] waiting for connections on port 30001 m30001| 2014-04-02T17:50:24.000-0400 [initandlisten] connection accepted from 127.0.0.1:56298 #1 (1 connection now open) "localhost:30000" m30000| 2014-04-02T17:50:24.003-0400 [initandlisten] connection accepted from 127.0.0.1:35609 #2 (2 connections now open) ShardingTest auth_add_shard_collection : { "config" : "localhost:30000", "shards" : [ connection to localhost:30000, connection to localhost:30001 ] } 2014-04-02T17:50:24.014-0400 shell: started program /media/ssd/mongo3/mongos --port 30999 --configdb localhost:30000 -v --chunkSize 50 --setParameter enableTestCommands=1 2014-04-02T17:50:24.015-0400 warning: Failed to connect to 127.0.0.1:30999, reason: errno:111 Connection refused m30999| 2014-04-02T17:50:24.030-0400 warning: running with 1 config server should be done only for testing purposes and is not recommended for production m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] MongoS version 2.7.0-pre- starting: pid=31572 port=30999 64-bit host=ubuntu (--help for usage) m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] _DEBUG build m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] db version v2.7.0-pre- m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] git version: 93b962665da9d3163cacaf55817d8d60a957a32a modules: enterprise m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] OpenSSL version: OpenSSL 1.0.1 14 Mar 2012 m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] build info: Linux ubuntu 3.5.0-47-generic #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] allocator: tcmalloc m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] options: { net: { port: 30999 }, setParameter: { enableTestCommands: "1" }, sharding: { chunkSize: 50, configDB: "localhost:30000" }, systemLog: { verbosity: 1 } } m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] config string : localhost:30000 m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] creating new connection to:localhost:30000 m30999| 2014-04-02T17:50:24.040-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30000| 2014-04-02T17:50:24.040-0400 [initandlisten] connection accepted from 127.0.0.1:35611 #3 (3 connections now open) m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] connected to server localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:24.040-0400 [mongosMain] connected connection! m30000| 2014-04-02T17:50:24.041-0400 [conn3] _DEBUG ReadContext db wasn't open, will try to open config m30000| 2014-04-02T17:50:24.041-0400 [conn3] opening db: config m30999| 2014-04-02T17:50:24.041-0400 creating new connection to:localhost:30000 m30999| 2014-04-02T17:50:24.041-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30000| 2014-04-02T17:50:24.041-0400 [initandlisten] connection accepted from 127.0.0.1:35612 #4 (4 connections now open) m30999| 2014-04-02T17:50:24.041-0400 connected to server localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:24.041-0400 connected connection! m30000| 2014-04-02T17:50:24.042-0400 [conn3] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:24.151-0400 [conn3] command admin.$cmd command: fsync { fsync: 1 } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 109ms m30999| 2014-04-02T17:50:24.151-0400 [mongosMain] created new distributed lock for configUpgrade on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30999| 2014-04-02T17:50:24.152-0400 [mongosMain] creating new connection to:localhost:30000 m30999| 2014-04-02T17:50:24.152-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30000| 2014-04-02T17:50:24.152-0400 [initandlisten] connection accepted from 127.0.0.1:35613 #5 (5 connections now open) m30999| 2014-04-02T17:50:24.152-0400 [mongosMain] connected to server localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:24.152-0400 [mongosMain] connected connection! m30999| 2014-04-02T17:50:24.154-0400 [mongosMain] trying to acquire new distributed lock for configUpgrade on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : ubuntu:30999:1396475424:1804289383 ) m30999| 2014-04-02T17:50:24.154-0400 [LockPinger] creating distributed lock ping thread for localhost:30000 and process ubuntu:30999:1396475424:1804289383 (sleeping for 30000ms) m30999| 2014-04-02T17:50:24.154-0400 [mongosMain] inserting initial doc in config.locks for lock configUpgrade m30000| 2014-04-02T17:50:24.154-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection0/config.ns, filling with zeroes... m30999| 2014-04-02T17:50:24.155-0400 [mongosMain] about to acquire distributed lock 'configUpgrade/ubuntu:30999:1396475424:1804289383' m30000| 2014-04-02T17:50:24.185-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection0/config.ns, size: 16MB, took 0.03 secs m30000| 2014-04-02T17:50:24.186-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection0/config.0, filling with zeroes... m30000| 2014-04-02T17:50:24.202-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection0/config.0, size: 64MB, took 0.015 secs m30000| 2014-04-02T17:50:24.202-0400 [conn3] datafileheader::init initializing /data/db/auth_add_shard_collection0/config.0 n:0 m30000| 2014-04-02T17:50:24.203-0400 [conn3] build index on: config.lockpings properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.lockpings" } m30000| 2014-04-02T17:50:24.203-0400 [conn3] added index to empty collection m30000| 2014-04-02T17:50:24.204-0400 [conn5] build index on: config.locks properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.locks" } m30000| 2014-04-02T17:50:24.204-0400 [conn5] added index to empty collection 2014-04-02T17:50:24.216-0400 warning: Failed to connect to 127.0.0.1:30999, reason: errno:111 Connection refused m30999| 2014-04-02T17:50:24.227-0400 [LockPinger] cluster localhost:30000 pinged successfully at Wed Apr 2 17:50:24 2014 by distributed lock pinger 'localhost:30000/ubuntu:30999:1396475424:1804289383', sleeping for 30000ms m30999| 2014-04-02T17:50:24.227-0400 [mongosMain] distributed lock 'configUpgrade/ubuntu:30999:1396475424:1804289383' acquired, ts : 533c862020b8d10b157f75f5 m30999| 2014-04-02T17:50:24.229-0400 [mongosMain] starting upgrade of config server from v0 to v5 m30999| 2014-04-02T17:50:24.229-0400 [mongosMain] starting next upgrade step from v0 to v5 m30999| 2014-04-02T17:50:24.229-0400 [mongosMain] about to log new metadata event: { _id: "ubuntu-2014-04-02T21:50:24-533c862020b8d10b157f75f6", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475424229), what: "starting upgrade of config database", ns: "config.version", details: { from: 0, to: 5 } } m30000| 2014-04-02T17:50:24.230-0400 [conn3] build index on: config.changelog properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.changelog" } m30000| 2014-04-02T17:50:24.230-0400 [conn3] added index to empty collection m30999| 2014-04-02T17:50:24.231-0400 [mongosMain] creating new connection to:localhost:30000 m30999| 2014-04-02T17:50:24.231-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30000| 2014-04-02T17:50:24.231-0400 [initandlisten] connection accepted from 127.0.0.1:35615 #6 (6 connections now open) m30999| 2014-04-02T17:50:24.231-0400 [mongosMain] connected to server localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:24.231-0400 [mongosMain] connected connection! m30999| 2014-04-02T17:50:24.231-0400 [mongosMain] creating WriteBackListener for: localhost:30000 serverID: 000000000000000000000000 m30999| 2014-04-02T17:50:24.231-0400 [mongosMain] initializing shard connection to localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:24.231-0400 [WriteBackListener-localhost:30000] BackgroundJob starting: WriteBackListener-localhost:30000 m30999| 2014-04-02T17:50:24.231-0400 [WriteBackListener-localhost:30000] localhost:30000 is not a shard node m30000| 2014-04-02T17:50:24.232-0400 [conn6] first cluster operation detected, adding sharding hook to enable versioning and authentication to remote servers m30000| 2014-04-02T17:50:24.232-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:24.344-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 111ms m30999| 2014-04-02T17:50:24.344-0400 [mongosMain] writing initial config version at v5 m30000| 2014-04-02T17:50:24.345-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:24.405-0400 [conn6] build index on: config.version properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.version" } m30000| 2014-04-02T17:50:24.405-0400 [conn6] added index to empty collection m30999| 2014-04-02T17:50:24.406-0400 [mongosMain] about to log new metadata event: { _id: "ubuntu-2014-04-02T21:50:24-533c862020b8d10b157f75f8", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475424406), what: "finished upgrade of config database", ns: "config.version", details: { from: 0, to: 5 } } m30000| 2014-04-02T17:50:24.406-0400 [conn6] CMD fsync: sync:1 lock:0 2014-04-02T17:50:24.417-0400 warning: Failed to connect to 127.0.0.1:30999, reason: errno:111 Connection refused m30999| 2014-04-02T17:50:24.503-0400 [mongosMain] upgrade of config server to v5 successful m30999| 2014-04-02T17:50:24.504-0400 [mongosMain] distributed lock 'configUpgrade/ubuntu:30999:1396475424:1804289383' unlocked. m30000| 2014-04-02T17:50:24.504-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:24.569-0400 [conn6] build index on: config.settings properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.settings" } m30000| 2014-04-02T17:50:24.569-0400 [conn6] added index to empty collection m30000| 2014-04-02T17:50:24.569-0400 [conn6] CMD fsync: sync:1 lock:0 2014-04-02T17:50:24.618-0400 warning: Failed to connect to 127.0.0.1:30999, reason: errno:111 Connection refused m30000| 2014-04-02T17:50:24.677-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 108ms m30000| 2014-04-02T17:50:24.679-0400 [conn6] build index on: config.chunks properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.chunks" } m30000| 2014-04-02T17:50:24.679-0400 [conn6] added index to empty collection m30000| 2014-04-02T17:50:24.679-0400 [conn6] build index on: config.chunks properties: { v: 1, unique: true, key: { ns: 1, min: 1 }, name: "ns_1_min_1", ns: "config.chunks" } m30000| 2014-04-02T17:50:24.679-0400 [conn6] added index to empty collection m30000| 2014-04-02T17:50:24.680-0400 [conn6] CMD fsync: sync:1 lock:0 2014-04-02T17:50:24.819-0400 warning: Failed to connect to 127.0.0.1:30999, reason: errno:111 Connection refused m30000| 2014-04-02T17:50:24.819-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 139ms m30000| 2014-04-02T17:50:24.820-0400 [conn6] build index on: config.chunks properties: { v: 1, unique: true, key: { ns: 1, shard: 1, min: 1 }, name: "ns_1_shard_1_min_1", ns: "config.chunks" } m30000| 2014-04-02T17:50:24.820-0400 [conn6] added index to empty collection m30000| 2014-04-02T17:50:24.820-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:24.945-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 locks(micros) W:1 reslen:51 124ms m30000| 2014-04-02T17:50:24.945-0400 [conn6] build index on: config.chunks properties: { v: 1, unique: true, key: { ns: 1, lastmod: 1 }, name: "ns_1_lastmod_1", ns: "config.chunks" } m30000| 2014-04-02T17:50:24.945-0400 [conn6] added index to empty collection m30000| 2014-04-02T17:50:24.946-0400 [conn6] CMD fsync: sync:1 lock:0 2014-04-02T17:50:25.020-0400 warning: Failed to connect to 127.0.0.1:30999, reason: errno:111 Connection refused m30000| 2014-04-02T17:50:25.070-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 123ms m30000| 2014-04-02T17:50:25.071-0400 [conn6] build index on: config.shards properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.shards" } m30000| 2014-04-02T17:50:25.071-0400 [conn6] added index to empty collection m30000| 2014-04-02T17:50:25.071-0400 [conn6] build index on: config.shards properties: { v: 1, unique: true, key: { host: 1 }, name: "host_1", ns: "config.shards" } m30000| 2014-04-02T17:50:25.071-0400 [conn6] added index to empty collection m30000| 2014-04-02T17:50:25.072-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.178-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 106ms m30000| 2014-04-02T17:50:25.179-0400 [conn6] build index on: config.locks properties: { v: 1, unique: true, key: { ts: 1 }, name: "ts_1", ns: "config.locks" } m30000| 2014-04-02T17:50:25.179-0400 [conn6] building index using bulk method m30000| 2014-04-02T17:50:25.179-0400 [conn6] build index done. scanned 1 total records. 0 secs m30000| 2014-04-02T17:50:25.179-0400 [conn6] CMD fsync: sync:1 lock:0 2014-04-02T17:50:25.221-0400 warning: Failed to connect to 127.0.0.1:30999, reason: errno:111 Connection refused m30000| 2014-04-02T17:50:25.295-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 115ms m30000| 2014-04-02T17:50:25.296-0400 [conn6] build index on: config.locks properties: { v: 1, key: { state: 1, process: 1 }, name: "state_1_process_1", ns: "config.locks" } m30000| 2014-04-02T17:50:25.296-0400 [conn6] building index using bulk method m30000| 2014-04-02T17:50:25.296-0400 [conn6] build index done. scanned 1 total records. 0 secs m30000| 2014-04-02T17:50:25.297-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.412-0400 [conn6] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 locks(micros) W:1 reslen:51 115ms m30000| 2014-04-02T17:50:25.413-0400 [conn6] build index on: config.lockpings properties: { v: 1, key: { ping: 1 }, name: "ping_1", ns: "config.lockpings" } m30000| 2014-04-02T17:50:25.413-0400 [conn6] building index using bulk method m30000| 2014-04-02T17:50:25.413-0400 [conn6] build index done. scanned 1 total records. 0 secs m30999| 2014-04-02T17:50:25.413-0400 [mongosMain] scoped connection to localhost:30000 not being returned to the pool m30000| 2014-04-02T17:50:25.413-0400 [conn3] end connection 127.0.0.1:35611 (5 connections now open) m30999| 2014-04-02T17:50:25.413-0400 [cursorTimeout] BackgroundJob starting: cursorTimeout m30999| 2014-04-02T17:50:25.413-0400 [mongosMain] fd limit hard:4096 soft:1024 max conn: 819 m30999| 2014-04-02T17:50:25.413-0400 [Balancer] BackgroundJob starting: Balancer m30999| 2014-04-02T17:50:25.413-0400 [UserCacheInvalidatorThread] BackgroundJob starting: UserCacheInvalidatorThread m30999| 2014-04-02T17:50:25.413-0400 [Balancer] about to contact config servers and shards m30999| 2014-04-02T17:50:25.413-0400 [PeriodicTaskRunner] BackgroundJob starting: PeriodicTaskRunner m30999| 2014-04-02T17:50:25.414-0400 [mongosMain] waiting for connections on port 30999 m30999| 2014-04-02T17:50:25.414-0400 [Balancer] found 0 shards listed on config server(s): localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:25.414-0400 [Balancer] config servers and shards contacted successfully m30999| 2014-04-02T17:50:25.414-0400 [Balancer] balancer id: ubuntu:30999 started at Apr 2 17:50:25 m30999| 2014-04-02T17:50:25.414-0400 [Balancer] created new distributed lock for balancer on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30000| 2014-04-02T17:50:25.414-0400 [conn3] thread conn3 stack usage was 15864 bytes, which is the most so far m30000| 2014-04-02T17:50:25.415-0400 [conn6] build index on: config.mongos properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.mongos" } m30000| 2014-04-02T17:50:25.415-0400 [conn6] added index to empty collection m30999| 2014-04-02T17:50:25.415-0400 [Balancer] creating new connection to:localhost:30000 m30999| 2014-04-02T17:50:25.415-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30000| 2014-04-02T17:50:25.415-0400 [initandlisten] connection accepted from 127.0.0.1:35621 #7 (6 connections now open) m30999| 2014-04-02T17:50:25.415-0400 [Balancer] connected to server localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:25.415-0400 [Balancer] connected connection! m30999| 2014-04-02T17:50:25.416-0400 [Balancer] found 0 shards listed on config server(s): localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:25.416-0400 [Balancer] Refreshing MaxChunkSize: 50MB m30999| 2014-04-02T17:50:25.416-0400 [Balancer] trying to acquire new distributed lock for balancer on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : ubuntu:30999:1396475424:1804289383 ) m30999| 2014-04-02T17:50:25.416-0400 [Balancer] inserting initial doc in config.locks for lock balancer m30999| 2014-04-02T17:50:25.416-0400 [Balancer] about to acquire distributed lock 'balancer/ubuntu:30999:1396475424:1804289383' m30999| 2014-04-02T17:50:25.419-0400 [Balancer] distributed lock 'balancer/ubuntu:30999:1396475424:1804289383' acquired, ts : 533c862120b8d10b157f75fa m30999| 2014-04-02T17:50:25.419-0400 [Balancer] *** start balancing round m30999| 2014-04-02T17:50:25.419-0400 [Balancer] waitForDelete: 0 m30999| 2014-04-02T17:50:25.419-0400 [Balancer] secondaryThrottle: 1 m30999| 2014-04-02T17:50:25.419-0400 [Balancer] no collections to balance m30999| 2014-04-02T17:50:25.419-0400 [Balancer] no need to move any chunk m30999| 2014-04-02T17:50:25.419-0400 [Balancer] *** end of balancing round m30999| 2014-04-02T17:50:25.421-0400 [Balancer] distributed lock 'balancer/ubuntu:30999:1396475424:1804289383' unlocked. m30999| 2014-04-02T17:50:25.422-0400 [mongosMain] connection accepted from 127.0.0.1:46618 #1 (1 connection now open) 2014-04-02T17:50:25.428-0400 shell: started program /media/ssd/mongo3/mongos --port 30998 --configdb localhost:30000 -v --chunkSize 50 --setParameter enableTestCommands=1 2014-04-02T17:50:25.428-0400 warning: Failed to connect to 127.0.0.1:30998, reason: errno:111 Connection refused m30998| 2014-04-02T17:50:25.443-0400 warning: running with 1 config server should be done only for testing purposes and is not recommended for production m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] MongoS version 2.7.0-pre- starting: pid=31602 port=30998 64-bit host=ubuntu (--help for usage) m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] _DEBUG build m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] db version v2.7.0-pre- m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] git version: 93b962665da9d3163cacaf55817d8d60a957a32a modules: enterprise m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] OpenSSL version: OpenSSL 1.0.1 14 Mar 2012 m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] build info: Linux ubuntu 3.5.0-47-generic #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] allocator: tcmalloc m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] options: { net: { port: 30998 }, setParameter: { enableTestCommands: "1" }, sharding: { chunkSize: 50, configDB: "localhost:30000" }, systemLog: { verbosity: 1 } } m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] config string : localhost:30000 m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] creating new connection to:localhost:30000 m30998| 2014-04-02T17:50:25.453-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] connected to server localhost:30000 (127.0.0.1) m30000| 2014-04-02T17:50:25.453-0400 [initandlisten] connection accepted from 127.0.0.1:35624 #8 (7 connections now open) m30998| 2014-04-02T17:50:25.453-0400 [mongosMain] connected connection! m30998| 2014-04-02T17:50:25.456-0400 creating new connection to:localhost:30000 m30998| 2014-04-02T17:50:25.456-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30998| 2014-04-02T17:50:25.456-0400 connected to server localhost:30000 (127.0.0.1) m30000| 2014-04-02T17:50:25.456-0400 [initandlisten] connection accepted from 127.0.0.1:35625 #9 (8 connections now open) m30998| 2014-04-02T17:50:25.456-0400 connected connection! m30998| 2014-04-02T17:50:25.457-0400 [mongosMain] MaxChunkSize: 50 m30998| 2014-04-02T17:50:25.457-0400 [mongosMain] creating new connection to:localhost:30000 m30998| 2014-04-02T17:50:25.457-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30998| 2014-04-02T17:50:25.457-0400 [mongosMain] connected to server localhost:30000 (127.0.0.1) m30998| 2014-04-02T17:50:25.457-0400 [mongosMain] connected connection! m30000| 2014-04-02T17:50:25.457-0400 [initandlisten] connection accepted from 127.0.0.1:35626 #10 (9 connections now open) m30998| 2014-04-02T17:50:25.457-0400 [mongosMain] creating WriteBackListener for: localhost:30000 serverID: 000000000000000000000000 m30998| 2014-04-02T17:50:25.457-0400 [mongosMain] initializing shard connection to localhost:30000 (127.0.0.1) m30998| 2014-04-02T17:50:25.457-0400 [WriteBackListener-localhost:30000] BackgroundJob starting: WriteBackListener-localhost:30000 m30998| 2014-04-02T17:50:25.457-0400 [WriteBackListener-localhost:30000] localhost:30000 is not a shard node m30000| 2014-04-02T17:50:25.458-0400 [conn10] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.570-0400 [conn10] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 locks(micros) W:1 reslen:51 112ms m30000| 2014-04-02T17:50:25.571-0400 [conn10] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.572-0400 [conn10] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.573-0400 [conn10] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.574-0400 [conn10] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.575-0400 [conn10] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.576-0400 [conn10] CMD fsync: sync:1 lock:0 m30998| 2014-04-02T17:50:25.577-0400 [mongosMain] scoped connection to localhost:30000 not being returned to the pool m30000| 2014-04-02T17:50:25.577-0400 [conn8] end connection 127.0.0.1:35624 (8 connections now open) m30998| 2014-04-02T17:50:25.577-0400 [Balancer] BackgroundJob starting: Balancer m30998| 2014-04-02T17:50:25.577-0400 [mongosMain] fd limit hard:4096 soft:1024 max conn: 819 m30998| 2014-04-02T17:50:25.577-0400 [Balancer] about to contact config servers and shards m30998| 2014-04-02T17:50:25.577-0400 [UserCacheInvalidatorThread] BackgroundJob starting: UserCacheInvalidatorThread m30998| 2014-04-02T17:50:25.577-0400 [cursorTimeout] BackgroundJob starting: cursorTimeout m30998| 2014-04-02T17:50:25.577-0400 [PeriodicTaskRunner] BackgroundJob starting: PeriodicTaskRunner m30998| 2014-04-02T17:50:25.578-0400 [mongosMain] waiting for connections on port 30998 m30998| 2014-04-02T17:50:25.578-0400 [Balancer] found 0 shards listed on config server(s): localhost:30000 (127.0.0.1) m30998| 2014-04-02T17:50:25.578-0400 [Balancer] config servers and shards contacted successfully m30998| 2014-04-02T17:50:25.578-0400 [Balancer] balancer id: ubuntu:30998 started at Apr 2 17:50:25 m30998| 2014-04-02T17:50:25.578-0400 [Balancer] created new distributed lock for balancer on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30998| 2014-04-02T17:50:25.578-0400 [Balancer] creating new connection to:localhost:30000 m30998| 2014-04-02T17:50:25.578-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30000| 2014-04-02T17:50:25.579-0400 [initandlisten] connection accepted from 127.0.0.1:35627 #11 (9 connections now open) m30998| 2014-04-02T17:50:25.579-0400 [Balancer] connected to server localhost:30000 (127.0.0.1) m30998| 2014-04-02T17:50:25.579-0400 [Balancer] connected connection! m30998| 2014-04-02T17:50:25.579-0400 [Balancer] found 0 shards listed on config server(s): localhost:30000 (127.0.0.1) m30998| 2014-04-02T17:50:25.579-0400 [Balancer] Refreshing MaxChunkSize: 50MB m30998| 2014-04-02T17:50:25.579-0400 [Balancer] creating new connection to:localhost:30000 m30998| 2014-04-02T17:50:25.580-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30000| 2014-04-02T17:50:25.580-0400 [initandlisten] connection accepted from 127.0.0.1:35628 #12 (10 connections now open) m30998| 2014-04-02T17:50:25.580-0400 [Balancer] connected to server localhost:30000 (127.0.0.1) m30998| 2014-04-02T17:50:25.580-0400 [Balancer] connected connection! m30998| 2014-04-02T17:50:25.581-0400 [Balancer] trying to acquire new distributed lock for balancer on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : ubuntu:30998:1396475425:1804289383 ) m30998| 2014-04-02T17:50:25.581-0400 [LockPinger] creating distributed lock ping thread for localhost:30000 and process ubuntu:30998:1396475425:1804289383 (sleeping for 30000ms) m30998| 2014-04-02T17:50:25.581-0400 [Balancer] about to acquire distributed lock 'balancer/ubuntu:30998:1396475425:1804289383' m30998| 2014-04-02T17:50:25.586-0400 [Balancer] distributed lock 'balancer/ubuntu:30998:1396475425:1804289383' acquired, ts : 533c8621296bf2b260136648 m30998| 2014-04-02T17:50:25.586-0400 [Balancer] *** start balancing round m30998| 2014-04-02T17:50:25.586-0400 [Balancer] waitForDelete: 0 m30998| 2014-04-02T17:50:25.586-0400 [Balancer] secondaryThrottle: 1 m30998| 2014-04-02T17:50:25.587-0400 [LockPinger] cluster localhost:30000 pinged successfully at Wed Apr 2 17:50:25 2014 by distributed lock pinger 'localhost:30000/ubuntu:30998:1396475425:1804289383', sleeping for 30000ms m30998| 2014-04-02T17:50:25.587-0400 [Balancer] no collections to balance m30998| 2014-04-02T17:50:25.587-0400 [Balancer] no need to move any chunk m30998| 2014-04-02T17:50:25.587-0400 [Balancer] *** end of balancing round m30998| 2014-04-02T17:50:25.587-0400 [Balancer] distributed lock 'balancer/ubuntu:30998:1396475425:1804289383' unlocked. m30998| 2014-04-02T17:50:25.629-0400 [mongosMain] connection accepted from 127.0.0.1:47517 #1 (1 connection now open) ShardingTest undefined going to add shard : localhost:30000 m30999| 2014-04-02T17:50:25.637-0400 [conn1] couldn't find database [admin] in config db m30000| 2014-04-02T17:50:25.638-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:25.712-0400 [conn6] build index on: config.databases properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.databases" } m30000| 2014-04-02T17:50:25.712-0400 [conn6] added index to empty collection m30999| 2014-04-02T17:50:25.712-0400 [conn1] put [admin] on: config:localhost:30000 m30999| 2014-04-02T17:50:25.715-0400 [conn1] going to add shard: { _id: "shard0000", host: "localhost:30000" } m30000| 2014-04-02T17:50:25.715-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:25.813-0400 [conn1] found 1 shards listed on config server(s): localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:25.813-0400 [conn1] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:25-533c862120b8d10b157f75fb", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475425813), what: "addShard", ns: "", details: { name: "shard0000", host: "localhost:30000" } } m30000| 2014-04-02T17:50:25.814-0400 [conn6] CMD fsync: sync:1 lock:0 { "shardAdded" : "shard0000", "ok" : 1 } ShardingTest undefined going to add shard : localhost:30001 m30999| 2014-04-02T17:50:25.894-0400 [conn1] creating new connection to:localhost:30001 m30999| 2014-04-02T17:50:25.895-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30001| 2014-04-02T17:50:25.895-0400 [initandlisten] connection accepted from 127.0.0.1:56320 #2 (2 connections now open) m30999| 2014-04-02T17:50:25.895-0400 [conn1] connected to server localhost:30001 (127.0.0.1) m30999| 2014-04-02T17:50:25.895-0400 [conn1] connected connection! m30999| 2014-04-02T17:50:25.897-0400 [conn1] going to add shard: { _id: "shard0001", host: "localhost:30001" } m30000| 2014-04-02T17:50:25.897-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:25.961-0400 [conn1] found 2 shards listed on config server(s): localhost:30000 (127.0.0.1) m30999| 2014-04-02T17:50:25.961-0400 [conn1] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:25-533c862120b8d10b157f75fc", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475425961), what: "addShard", ns: "", details: { name: "shard0001", host: "localhost:30001" } } m30000| 2014-04-02T17:50:25.961-0400 [conn6] CMD fsync: sync:1 lock:0 { "shardAdded" : "shard0001", "ok" : 1 } m30000| 2014-04-02T17:50:26.030-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:26.086-0400 [conn1] creating new connection to:localhost:30001 m30999| 2014-04-02T17:50:26.086-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30999| 2014-04-02T17:50:26.087-0400 [conn1] connected to server localhost:30001 (127.0.0.1) m30999| 2014-04-02T17:50:26.087-0400 [conn1] connected connection! m30999| 2014-04-02T17:50:26.087-0400 [conn1] creating WriteBackListener for: localhost:30001 serverID: 533c862120b8d10b157f75f9 m30001| 2014-04-02T17:50:26.086-0400 [initandlisten] connection accepted from 127.0.0.1:56321 #3 (3 connections now open) m30999| 2014-04-02T17:50:26.087-0400 [conn1] initializing shard connection to localhost:30001 (127.0.0.1) m30999| 2014-04-02T17:50:26.087-0400 [WriteBackListener-localhost:30001] BackgroundJob starting: WriteBackListener-localhost:30001 m30001| 2014-04-02T17:50:26.087-0400 [conn3] first cluster operation detected, adding sharding hook to enable versioning and authentication to remote servers Waiting for active hosts... Waiting for the balancer lock... Waiting again for active hosts after balancer is off... 2 shard system setup m30000| 2014-04-02T17:50:26.102-0400 [conn6] CMD fsync: sync:1 lock:0 Waiting for active hosts... Waiting for the balancer lock... Waiting again for active hosts after balancer is off... m30999| 2014-04-02T17:50:26.166-0400 [conn1] couldn't find database [test] in config db m30999| 2014-04-02T17:50:26.168-0400 [conn1] creating new connection to:localhost:30001 m30999| 2014-04-02T17:50:26.168-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30001| 2014-04-02T17:50:26.168-0400 [initandlisten] connection accepted from 127.0.0.1:56322 #4 (4 connections now open) m30999| 2014-04-02T17:50:26.168-0400 [conn1] connected to server localhost:30001 (127.0.0.1) m30999| 2014-04-02T17:50:26.168-0400 [conn1] connected connection! m30999| 2014-04-02T17:50:26.169-0400 [conn1] best shard for new allocation is shard: shard0001:localhost:30001 mapped: 80 writeLock: 0 version: 2.7.0-pre- m30000| 2014-04-02T17:50:26.169-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:26.170-0400 [conn1] put [test] on: shard0001:localhost:30001 m30001| 2014-04-02T17:50:26.170-0400 [conn3] opening db: test m30001| 2014-04-02T17:50:26.170-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection1/test.ns, filling with zeroes... m30001| 2014-04-02T17:50:26.196-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection1/test.ns, size: 16MB, took 0.025 secs m30001| 2014-04-02T17:50:26.197-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection1/test.0, filling with zeroes... m30001| 2014-04-02T17:50:26.213-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection1/test.0, size: 64MB, took 0.015 secs m30001| 2014-04-02T17:50:26.213-0400 [conn3] datafileheader::init initializing /data/db/auth_add_shard_collection1/test.0 n:0 m30001| 2014-04-02T17:50:26.215-0400 [conn3] build index on: test.bork properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "test.bork" } m30001| 2014-04-02T17:50:26.215-0400 [conn3] added index to empty collection m30001| 2014-04-02T17:50:26.221-0400 [conn3] build index on: test.bork2 properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "test.bork2" } m30001| 2014-04-02T17:50:26.221-0400 [conn3] added index to empty collection 10 10 primaryShard for test is shard0001 ---- Sharding test.bork2 with mongos1 ---- m30999| 2014-04-02T17:50:26.235-0400 [conn1] enabling sharding on: test m30000| 2014-04-02T17:50:26.235-0400 [conn6] CMD fsync: sync:1 lock:0 { "ok" : 1 } m30999| 2014-04-02T17:50:26.269-0400 [conn1] CMD: shardcollection: { shardCollection: "test.bork2", key: { _id: 1.0 } } m30999| 2014-04-02T17:50:26.270-0400 [conn1] enable sharding on: test.bork2 with shard key: { _id: 1.0 } m30999| 2014-04-02T17:50:26.270-0400 [conn1] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:26-533c862220b8d10b157f75fd", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475426270), what: "shardCollection.start", ns: "test.bork2", details: { shardKey: { _id: 1.0 }, collection: "test.bork2", primary: "shard0001:localhost:30001", initShards: [], numChunks: 1 } } m30000| 2014-04-02T17:50:26.270-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:26.298-0400 [conn1] going to create 1 chunk(s) for: test.bork2 using new epoch 533c862220b8d10b157f75fe m30000| 2014-04-02T17:50:26.299-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:26.374-0400 [conn1] ChunkManager: time to load chunks for test.bork2: 2ms sequenceNumber: 2 version: 1|0||533c862220b8d10b157f75fe based on: (empty) m30000| 2014-04-02T17:50:26.374-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:26.434-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:26.436-0400 [conn6] build index on: config.collections properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "config.collections" } m30000| 2014-04-02T17:50:26.436-0400 [conn6] added index to empty collection m30999| 2014-04-02T17:50:26.436-0400 [conn1] setShardVersion shard0001 localhost:30001 test.bork2 { setShardVersion: "test.bork2", configdb: "localhost:30000", version: Timestamp 1000|0, versionEpoch: ObjectId('533c862220b8d10b157f75fe'), serverID: ObjectId('533c862120b8d10b157f75f9'), shard: "shard0001", shardHost: "localhost:30001" } 0x7f5089aa67a0 2 m30001| 2014-04-02T17:50:26.436-0400 [conn3] remote client 127.0.0.1:56321 initialized this host (localhost:30001) as shard shard0001 m30999| 2014-04-02T17:50:26.436-0400 [conn1] setShardVersion failed! m30999| { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ns: "test.bork2", need_authoritative: true, ok: 0.0, errmsg: "first time for collection 'test.bork2'" } m30999| 2014-04-02T17:50:26.438-0400 [conn1] setShardVersion shard0001 localhost:30001 test.bork2 { setShardVersion: "test.bork2", configdb: "localhost:30000", version: Timestamp 1000|0, versionEpoch: ObjectId('533c862220b8d10b157f75fe'), serverID: ObjectId('533c862120b8d10b157f75f9'), authoritative: true, shard: "shard0001", shardHost: "localhost:30001" } 0x7f5089aa67a0 2 m30001| 2014-04-02T17:50:26.438-0400 [conn3] remotely refreshing metadata for test.bork2 with requested shard version 1|0||533c862220b8d10b157f75fe, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 m30000| 2014-04-02T17:50:26.439-0400 [initandlisten] connection accepted from 127.0.0.1:35633 #13 (11 connections now open) m30001| 2014-04-02T17:50:26.440-0400 [conn3] collection test.bork2 was previously unsharded, new metadata loaded with shard version 1|0||533c862220b8d10b157f75fe m30001| 2014-04-02T17:50:26.440-0400 [conn3] collection version was loaded at version 1|0||533c862220b8d10b157f75fe, took 1ms m30999| 2014-04-02T17:50:26.440-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } m30999| 2014-04-02T17:50:26.440-0400 [conn1] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:26-533c862220b8d10b157f75ff", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475426440), what: "shardCollection", ns: "test.bork2", details: { version: "1|0||533c862220b8d10b157f75fe" } } m30000| 2014-04-02T17:50:26.440-0400 [conn6] CMD fsync: sync:1 lock:0 { "collectionsharded" : "test.bork2", "ok" : 1 } m30999| 2014-04-02T17:50:26.543-0400 [conn1] CMD: movechunk: { moveChunk: "test.bork2", find: { _id: 1.0 }, to: "shard0000" } m30999| 2014-04-02T17:50:26.543-0400 [conn1] moving chunk ns: test.bork2 moving ( ns: test.bork2, shard: shard0001:localhost:30001, lastmod: 1|0||000000000000000000000000, min: { _id: MinKey }, max: { _id: MaxKey }) shard0001:localhost:30001 -> shard0000:localhost:30000 m30001| 2014-04-02T17:50:26.544-0400 [conn4] received moveChunk request: { moveChunk: "test.bork2", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { _id: MinKey }, max: { _id: MaxKey }, maxChunkSizeBytes: 52428800, shardId: "test.bork2-_id_MinKey", configdb: "localhost:30000", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0 } m30000| 2014-04-02T17:50:26.544-0400 [initandlisten] connection accepted from 127.0.0.1:35634 #14 (12 connections now open) m30001| 2014-04-02T17:50:26.546-0400 [LockPinger] creating distributed lock ping thread for localhost:30000 and process ubuntu:30001:1396475426:584580941 (sleeping for 30000ms) m30000| 2014-04-02T17:50:26.546-0400 [initandlisten] connection accepted from 127.0.0.1:35635 #15 (13 connections now open) m30001| 2014-04-02T17:50:26.549-0400 [LockPinger] cluster localhost:30000 pinged successfully at Wed Apr 2 17:50:26 2014 by distributed lock pinger 'localhost:30000/ubuntu:30001:1396475426:584580941', sleeping for 30000ms m30001| 2014-04-02T17:50:26.549-0400 [conn4] distributed lock 'test.bork2/ubuntu:30001:1396475426:584580941' acquired, ts : 533c8622e2a4a9630f1c9af9 m30001| 2014-04-02T17:50:26.549-0400 [conn4] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:26-533c8622e2a4a9630f1c9afa", server: "ubuntu", clientAddr: "127.0.0.1:56322", time: new Date(1396475426549), what: "moveChunk.start", ns: "test.bork2", details: { min: { _id: MinKey }, max: { _id: MaxKey }, from: "shard0001", to: "shard0000" } } m30000| 2014-04-02T17:50:26.549-0400 [initandlisten] connection accepted from 127.0.0.1:35636 #16 (14 connections now open) m30000| 2014-04-02T17:50:26.549-0400 [conn16] CMD fsync: sync:1 lock:0 m30001| 2014-04-02T17:50:26.639-0400 [conn4] remotely refreshing metadata for test.bork2 based on current shard version 1|0||533c862220b8d10b157f75fe, current metadata version is 1|0||533c862220b8d10b157f75fe m30001| 2014-04-02T17:50:26.640-0400 [conn4] metadata of collection test.bork2 already up to date (shard version : 1|0||533c862220b8d10b157f75fe, took 0ms) m30001| 2014-04-02T17:50:26.640-0400 [conn4] moveChunk request accepted at version 1|0||533c862220b8d10b157f75fe m30001| 2014-04-02T17:50:26.640-0400 [conn4] moveChunk number of documents: 10 m30000| 2014-04-02T17:50:26.640-0400 [conn14] remote client 127.0.0.1:35634 initialized this host as shard shard0000 m30000| 2014-04-02T17:50:26.640-0400 [conn14] remotely refreshing metadata for test.bork2, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 m30000| 2014-04-02T17:50:26.640-0400 [initandlisten] connection accepted from 127.0.0.1:35637 #17 (15 connections now open) m30000| 2014-04-02T17:50:26.641-0400 [conn14] collection test.bork2 was previously unsharded, new metadata loaded with shard version 0|0||533c862220b8d10b157f75fe m30000| 2014-04-02T17:50:26.641-0400 [conn14] collection version was loaded at version 1|0||533c862220b8d10b157f75fe, took 1ms m30000| 2014-04-02T17:50:26.642-0400 [migrateThread] starting receiving-end of migration of chunk { _id: MinKey } -> { _id: MaxKey } for collection test.bork2 from localhost:30001 at epoch 533c862220b8d10b157f75fe m30001| 2014-04-02T17:50:26.642-0400 [initandlisten] connection accepted from 127.0.0.1:56328 #5 (5 connections now open) m30000| 2014-04-02T17:50:26.642-0400 [migrateThread] opening db: test m30000| 2014-04-02T17:50:26.643-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection0/test.ns, filling with zeroes... m30001| 2014-04-02T17:50:26.643-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork2", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| 2014-04-02T17:50:26.645-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork2", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| 2014-04-02T17:50:26.650-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork2", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| 2014-04-02T17:50:26.658-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork2", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30000| 2014-04-02T17:50:26.672-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection0/test.ns, size: 16MB, took 0.029 secs m30000| 2014-04-02T17:50:26.673-0400 [FileAllocator] allocating new datafile /data/db/auth_add_shard_collection0/test.0, filling with zeroes... m30001| 2014-04-02T17:50:26.674-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork2", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30000| 2014-04-02T17:50:26.689-0400 [FileAllocator] done allocating datafile /data/db/auth_add_shard_collection0/test.0, size: 64MB, took 0.015 secs m30000| 2014-04-02T17:50:26.689-0400 [migrateThread] datafileheader::init initializing /data/db/auth_add_shard_collection0/test.0 n:0 m30000| 2014-04-02T17:50:26.690-0400 [migrateThread] build index on: test.bork2 properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "test.bork2" } m30000| 2014-04-02T17:50:26.691-0400 [migrateThread] added index to empty collection m30000| 2014-04-02T17:50:26.693-0400 [migrateThread] Waiting for replication to catch up before entering critical section m30000| 2014-04-02T17:50:26.693-0400 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.bork2' { _id: MinKey } -> { _id: MaxKey } m30001| 2014-04-02T17:50:26.707-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork2", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "steady", counts: { cloned: 10, clonedBytes: 180, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| 2014-04-02T17:50:26.707-0400 [conn4] About to check if it is safe to enter critical section m30001| 2014-04-02T17:50:26.707-0400 [conn4] About to enter migrate critical section m30001| 2014-04-02T17:50:26.707-0400 [conn4] moveChunk setting version to: 2|0||533c862220b8d10b157f75fe m30000| 2014-04-02T17:50:26.707-0400 [initandlisten] connection accepted from 127.0.0.1:35639 #18 (16 connections now open) m30000| 2014-04-02T17:50:26.714-0400 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.bork2' { _id: MinKey } -> { _id: MaxKey } m30000| 2014-04-02T17:50:26.714-0400 [migrateThread] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:26-533c86226a5567a70cd6e851", server: "ubuntu", clientAddr: ":27017", time: new Date(1396475426714), what: "moveChunk.to", ns: "test.bork2", details: { min: { _id: MinKey }, max: { _id: MaxKey }, step 1 of 5: 49, step 2 of 5: 0, step 3 of 5: 1, step 4 of 5: 0, step 5 of 5: 20 } } m30000| 2014-04-02T17:50:26.715-0400 [initandlisten] connection accepted from 127.0.0.1:35640 #19 (17 connections now open) m30000| 2014-04-02T17:50:26.715-0400 [conn19] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:26.854-0400 [conn19] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 reslen:51 138ms m30000| 2014-04-02T17:50:26.855-0400 [conn18] command admin.$cmd command: _recvChunkCommit { _recvChunkCommit: 1 } ntoreturn:1 keyUpdates:0 numYields:0 reslen:255 147ms m30001| 2014-04-02T17:50:26.855-0400 [conn4] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.bork2", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "done", counts: { cloned: 10, clonedBytes: 180, catchup: 0, steady: 0 }, ok: 1.0 } m30001| 2014-04-02T17:50:26.855-0400 [conn4] moveChunk moved last chunk out for collection 'test.bork2' m30000| 2014-04-02T17:50:26.856-0400 [initandlisten] connection accepted from 127.0.0.1:35641 #20 (18 connections now open) m30001| 2014-04-02T17:50:26.857-0400 [conn4] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:26-533c8622e2a4a9630f1c9afb", server: "ubuntu", clientAddr: "127.0.0.1:56322", time: new Date(1396475426857), what: "moveChunk.commit", ns: "test.bork2", details: { min: { _id: MinKey }, max: { _id: MaxKey }, from: "shard0001", to: "shard0000", cloned: 10, clonedBytes: 180, catchup: 0, steady: 0 } } m30000| 2014-04-02T17:50:26.857-0400 [conn16] CMD fsync: sync:1 lock:0 m30001| 2014-04-02T17:50:26.930-0400 [conn4] MigrateFromStatus::done About to acquire global write lock to exit critical section m30001| 2014-04-02T17:50:26.930-0400 [conn4] MigrateFromStatus::done Global lock acquired m30001| 2014-04-02T17:50:26.930-0400 [conn4] forking for cleanup of chunk data m30001| 2014-04-02T17:50:26.930-0400 [conn4] MigrateFromStatus::done About to acquire global write lock to exit critical section m30001| 2014-04-02T17:50:26.930-0400 [conn4] MigrateFromStatus::done Global lock acquired m30001| 2014-04-02T17:50:26.930-0400 [RangeDeleter] Deleter starting delete for: test.bork2 from { _id: MinKey } -> { _id: MaxKey }, with opId: 8 m30001| 2014-04-02T17:50:26.931-0400 [conn4] distributed lock 'test.bork2/ubuntu:30001:1396475426:584580941' unlocked. m30001| 2014-04-02T17:50:26.931-0400 [conn4] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:26-533c8622e2a4a9630f1c9afc", server: "ubuntu", clientAddr: "127.0.0.1:56322", time: new Date(1396475426931), what: "moveChunk.from", ns: "test.bork2", details: { min: { _id: MinKey }, max: { _id: MaxKey }, step 1 of 6: 0, step 2 of 6: 95, step 3 of 6: 1, step 4 of 6: 65, step 5 of 6: 223, step 6 of 6: 0 } } m30000| 2014-04-02T17:50:26.931-0400 [conn16] CMD fsync: sync:1 lock:0 m30001| 2014-04-02T17:50:26.932-0400 [RangeDeleter] rangeDeleter deleted 10 documents for test.bork2 from { _id: MinKey } -> { _id: MaxKey } m30001| 2014-04-02T17:50:27.004-0400 [conn4] command admin.$cmd command: moveChunk { moveChunk: "test.bork2", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { _id: MinKey }, max: { _id: MaxKey }, maxChunkSizeBytes: 52428800, shardId: "test.bork2-_id_MinKey", configdb: "localhost:30000", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0 } ntoreturn:1 keyUpdates:0 numYields:0 locks(micros) W:54 r:234 w:41 reslen:37 460ms m30999| 2014-04-02T17:50:27.005-0400 [conn1] moveChunk result: { ok: 1.0 } m30999| 2014-04-02T17:50:27.006-0400 [conn1] ChunkManager: time to load chunks for test.bork2: 0ms sequenceNumber: 3 version: 2|0||533c862220b8d10b157f75fe based on: 1|0||533c862220b8d10b157f75fe { "millis" : 463, "ok" : 1 } ---- Sharding test.bork with mongos2 ---- m30999| 2014-04-02T17:50:29.011-0400 [conn1] CMD: shardcollection: { shardCollection: "test.bork", key: { _id: 1.0 } } m30999| 2014-04-02T17:50:29.012-0400 [conn1] enable sharding on: test.bork with shard key: { _id: 1.0 } m30999| 2014-04-02T17:50:29.012-0400 [conn1] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:29-533c862520b8d10b157f7600", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475429012), what: "shardCollection.start", ns: "test.bork", details: { shardKey: { _id: 1.0 }, collection: "test.bork", primary: "shard0001:localhost:30001", initShards: [], numChunks: 1 } } m30000| 2014-04-02T17:50:29.012-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:29.089-0400 [conn1] going to create 1 chunk(s) for: test.bork using new epoch 533c862520b8d10b157f7601 m30000| 2014-04-02T17:50:29.090-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:29.156-0400 [conn1] ChunkManager: time to load chunks for test.bork: 0ms sequenceNumber: 4 version: 1|0||533c862520b8d10b157f7601 based on: (empty) m30000| 2014-04-02T17:50:29.156-0400 [conn6] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:29.210-0400 [conn6] CMD fsync: sync:1 lock:0 m30999| 2014-04-02T17:50:29.211-0400 [conn1] setShardVersion shard0001 localhost:30001 test.bork { setShardVersion: "test.bork", configdb: "localhost:30000", version: Timestamp 1000|0, versionEpoch: ObjectId('533c862520b8d10b157f7601'), serverID: ObjectId('533c862120b8d10b157f75f9'), shard: "shard0001", shardHost: "localhost:30001" } 0x7f5089aa67a0 4 m30999| 2014-04-02T17:50:29.211-0400 [conn1] setShardVersion failed! m30999| { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ns: "test.bork", need_authoritative: true, ok: 0.0, errmsg: "first time for collection 'test.bork'" } m30999| 2014-04-02T17:50:29.212-0400 [conn1] setShardVersion shard0001 localhost:30001 test.bork { setShardVersion: "test.bork", configdb: "localhost:30000", version: Timestamp 1000|0, versionEpoch: ObjectId('533c862520b8d10b157f7601'), serverID: ObjectId('533c862120b8d10b157f75f9'), authoritative: true, shard: "shard0001", shardHost: "localhost:30001" } 0x7f5089aa67a0 4 m30001| 2014-04-02T17:50:29.212-0400 [conn3] remotely refreshing metadata for test.bork with requested shard version 1|0||533c862520b8d10b157f7601, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 m30001| 2014-04-02T17:50:29.213-0400 [conn3] collection test.bork was previously unsharded, new metadata loaded with shard version 1|0||533c862520b8d10b157f7601 m30001| 2014-04-02T17:50:29.213-0400 [conn3] collection version was loaded at version 1|0||533c862520b8d10b157f7601, took 0ms m30999| 2014-04-02T17:50:29.213-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } m30999| 2014-04-02T17:50:29.213-0400 [conn1] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:29-533c862520b8d10b157f7602", server: "ubuntu", clientAddr: "N/A", time: new Date(1396475429213), what: "shardCollection", ns: "test.bork", details: { version: "1|0||533c862520b8d10b157f7601" } } m30000| 2014-04-02T17:50:29.213-0400 [conn6] CMD fsync: sync:1 lock:0 { "collectionsharded" : "test.bork", "ok" : 1 } m30999| 2014-04-02T17:50:29.270-0400 [conn1] CMD: movechunk: { moveChunk: "test.bork", find: { _id: 1.0 }, to: "shard0000" } m30999| 2014-04-02T17:50:29.270-0400 [conn1] moving chunk ns: test.bork moving ( ns: test.bork, shard: shard0001:localhost:30001, lastmod: 1|0||000000000000000000000000, min: { _id: MinKey }, max: { _id: MaxKey }) shard0001:localhost:30001 -> shard0000:localhost:30000 m30001| 2014-04-02T17:50:29.270-0400 [conn4] received moveChunk request: { moveChunk: "test.bork", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { _id: MinKey }, max: { _id: MaxKey }, maxChunkSizeBytes: 52428800, shardId: "test.bork-_id_MinKey", configdb: "localhost:30000", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0 } m30001| 2014-04-02T17:50:29.273-0400 [conn4] distributed lock 'test.bork/ubuntu:30001:1396475426:584580941' acquired, ts : 533c8625e2a4a9630f1c9afd m30001| 2014-04-02T17:50:29.273-0400 [conn4] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:29-533c8625e2a4a9630f1c9afe", server: "ubuntu", clientAddr: "127.0.0.1:56322", time: new Date(1396475429273), what: "moveChunk.start", ns: "test.bork", details: { min: { _id: MinKey }, max: { _id: MaxKey }, from: "shard0001", to: "shard0000" } } m30000| 2014-04-02T17:50:29.273-0400 [conn16] CMD fsync: sync:1 lock:0 m30001| 2014-04-02T17:50:29.347-0400 [conn4] remotely refreshing metadata for test.bork based on current shard version 1|0||533c862520b8d10b157f7601, current metadata version is 1|0||533c862520b8d10b157f7601 m30001| 2014-04-02T17:50:29.348-0400 [conn4] metadata of collection test.bork already up to date (shard version : 1|0||533c862520b8d10b157f7601, took 0ms) m30001| 2014-04-02T17:50:29.348-0400 [conn4] moveChunk request accepted at version 1|0||533c862520b8d10b157f7601 m30001| 2014-04-02T17:50:29.348-0400 [conn4] moveChunk number of documents: 10 m30000| 2014-04-02T17:50:29.349-0400 [conn14] remotely refreshing metadata for test.bork, current shard version is 0|0||000000000000000000000000, current metadata version is 0|0||000000000000000000000000 m30000| 2014-04-02T17:50:29.349-0400 [conn14] collection test.bork was previously unsharded, new metadata loaded with shard version 0|0||533c862520b8d10b157f7601 m30000| 2014-04-02T17:50:29.350-0400 [conn14] collection version was loaded at version 1|0||533c862520b8d10b157f7601, took 0ms m30000| 2014-04-02T17:50:29.350-0400 [migrateThread] starting receiving-end of migration of chunk { _id: MinKey } -> { _id: MaxKey } for collection test.bork from localhost:30001 at epoch 533c862520b8d10b157f7601 m30001| 2014-04-02T17:50:29.351-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30000| 2014-04-02T17:50:29.351-0400 [migrateThread] build index on: test.bork properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "test.bork" } m30000| 2014-04-02T17:50:29.351-0400 [migrateThread] added index to empty collection m30001| 2014-04-02T17:50:29.353-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "clone", counts: { cloned: 7, clonedBytes: 126, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30000| 2014-04-02T17:50:29.354-0400 [migrateThread] Waiting for replication to catch up before entering critical section m30000| 2014-04-02T17:50:29.354-0400 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.bork' { _id: MinKey } -> { _id: MaxKey } m30001| 2014-04-02T17:50:29.357-0400 [conn4] moveChunk data transfer progress: { active: true, ns: "test.bork", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "steady", counts: { cloned: 10, clonedBytes: 180, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| 2014-04-02T17:50:29.358-0400 [conn4] About to check if it is safe to enter critical section m30001| 2014-04-02T17:50:29.358-0400 [conn4] About to enter migrate critical section m30001| 2014-04-02T17:50:29.358-0400 [conn4] moveChunk setting version to: 2|0||533c862520b8d10b157f7601 m30000| 2014-04-02T17:50:29.364-0400 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.bork' { _id: MinKey } -> { _id: MaxKey } m30000| 2014-04-02T17:50:29.365-0400 [migrateThread] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:29-533c86256a5567a70cd6e852", server: "ubuntu", clientAddr: ":27017", time: new Date(1396475429365), what: "moveChunk.to", ns: "test.bork", details: { min: { _id: MinKey }, max: { _id: MaxKey }, step 1 of 5: 1, step 2 of 5: 0, step 3 of 5: 1, step 4 of 5: 0, step 5 of 5: 10 } } m30000| 2014-04-02T17:50:29.365-0400 [conn19] CMD fsync: sync:1 lock:0 m30000| 2014-04-02T17:50:29.480-0400 [conn19] command admin.$cmd command: fsync { fsync: true } ntoreturn:1 keyUpdates:0 numYields:0 locks(micros) W:1 reslen:51 114ms m30000| 2014-04-02T17:50:29.480-0400 [conn18] command admin.$cmd command: _recvChunkCommit { _recvChunkCommit: 1 } ntoreturn:1 keyUpdates:0 numYields:0 reslen:254 122ms m30001| 2014-04-02T17:50:29.480-0400 [conn4] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.bork", from: "localhost:30001", min: { _id: MinKey }, max: { _id: MaxKey }, shardKeyPattern: { _id: 1.0 }, state: "done", counts: { cloned: 10, clonedBytes: 180, catchup: 0, steady: 0 }, ok: 1.0 } m30001| 2014-04-02T17:50:29.481-0400 [conn4] moveChunk moved last chunk out for collection 'test.bork' m30001| 2014-04-02T17:50:29.482-0400 [conn4] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:29-533c8625e2a4a9630f1c9aff", server: "ubuntu", clientAddr: "127.0.0.1:56322", time: new Date(1396475429482), what: "moveChunk.commit", ns: "test.bork", details: { min: { _id: MinKey }, max: { _id: MaxKey }, from: "shard0001", to: "shard0000", cloned: 10, clonedBytes: 180, catchup: 0, steady: 0 } } m30000| 2014-04-02T17:50:29.482-0400 [conn16] CMD fsync: sync:1 lock:0 m30001| 2014-04-02T17:50:29.574-0400 [conn4] MigrateFromStatus::done About to acquire global write lock to exit critical section m30001| 2014-04-02T17:50:29.574-0400 [conn4] MigrateFromStatus::done Global lock acquired m30001| 2014-04-02T17:50:29.574-0400 [conn4] forking for cleanup of chunk data m30001| 2014-04-02T17:50:29.575-0400 [conn4] MigrateFromStatus::done About to acquire global write lock to exit critical section m30001| 2014-04-02T17:50:29.575-0400 [conn4] MigrateFromStatus::done Global lock acquired m30001| 2014-04-02T17:50:29.575-0400 [RangeDeleter] Deleter starting delete for: test.bork from { _id: MinKey } -> { _id: MaxKey }, with opId: 8 m30001| 2014-04-02T17:50:29.576-0400 [conn4] distributed lock 'test.bork/ubuntu:30001:1396475426:584580941' unlocked. m30001| 2014-04-02T17:50:29.576-0400 [conn4] about to log metadata event: { _id: "ubuntu-2014-04-02T21:50:29-533c8625e2a4a9630f1c9b00", server: "ubuntu", clientAddr: "127.0.0.1:56322", time: new Date(1396475429576), what: "moveChunk.from", ns: "test.bork", details: { min: { _id: MinKey }, max: { _id: MaxKey }, step 1 of 6: 0, step 2 of 6: 77, step 3 of 6: 1, step 4 of 6: 7, step 5 of 6: 216, step 6 of 6: 0 } } m30000| 2014-04-02T17:50:29.576-0400 [conn16] CMD fsync: sync:1 lock:0 m30001| 2014-04-02T17:50:29.576-0400 [RangeDeleter] rangeDeleter deleted 10 documents for test.bork from { _id: MinKey } -> { _id: MaxKey } m30001| 2014-04-02T17:50:29.646-0400 [conn4] command admin.$cmd command: moveChunk { moveChunk: "test.bork", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { _id: MinKey }, max: { _id: MaxKey }, maxChunkSizeBytes: 52428800, shardId: "test.bork-_id_MinKey", configdb: "localhost:30000", secondaryThrottle: false, waitForDelete: false, maxTimeMS: 0 } ntoreturn:1 keyUpdates:0 numYields:0 locks(micros) W:53 r:221 w:27 reslen:37 376ms m30999| 2014-04-02T17:50:29.646-0400 [conn1] moveChunk result: { ok: 1.0 } m30999| 2014-04-02T17:50:29.648-0400 [conn1] ChunkManager: time to load chunks for test.bork: 0ms sequenceNumber: 5 version: 2|0||533c862520b8d10b157f7601 based on: 1|0||533c862520b8d10b157f7601 { "millis" : 379, "ok" : 1 } m30000| 2014-04-02T17:50:29.900-0400 [conn6] command config.$cmd command: group { group: { cond: { ns: "test.bork" }, key: { shard: 1.0 }, initial: { nChunks: 0.0 }, ns: "chunks", $reduce: function ( doc , out ){ out.nChunks++; } } } ntoreturn:1 keyUpdates:0 numYields:0 locks(micros) r:224462 reslen:121 224ms --- Sharding Status --- sharding version: { "_id" : 1, "version" : 4, "minCompatibleVersion" : 4, "currentVersion" : 5, "clusterId" : ObjectId("533c862020b8d10b157f75f7") } shards: { "_id" : "shard0000", "host" : "localhost:30000" } { "_id" : "shard0001", "host" : "localhost:30001" } databases: { "_id" : "admin", "partitioned" : false, "primary" : "config" } { "_id" : "test", "partitioned" : true, "primary" : "shard0001" } test.bork shard key: { "_id" : 1 } chunks: shard0000 1 { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shard0000 Timestamp(2, 0) test.bork2 shard key: { "_id" : 1 } chunks: shard0000 1 { "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : shard0000 Timestamp(2, 0) undefined { "_id" : "test.bork-_id_MinKey", "lastmod" : Timestamp(2, 0), "lastmodEpoch" : ObjectId("533c862520b8d10b157f7601"), "ns" : "test.bork", "min" : { "_id" : { "$minKey" : 1 } }, "max" : { "_id" : { "$maxKey" : 1 } }, "shard" : "shard0000" } { "_id" : "test.bork2-_id_MinKey", "lastmod" : Timestamp(2, 0), "lastmodEpoch" : ObjectId("533c862220b8d10b157f75fe"), "ns" : "test.bork2", "min" : { "_id" : { "$minKey" : 1 } }, "max" : { "_id" : { "$maxKey" : 1 } }, "shard" : "shard0000" } m30999| 2014-04-02T17:50:30.007-0400 [conn1] setShardVersion shard0000 localhost:30000 test.bork { setShardVersion: "test.bork", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('533c862520b8d10b157f7601'), serverID: ObjectId('533c862120b8d10b157f75f9'), shard: "shard0000", shardHost: "localhost:30000" } 0x7f508b335220 5 m30999| 2014-04-02T17:50:30.008-0400 [conn1] setShardVersion failed! m30999| { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ns: "test.bork", need_authoritative: true, ok: 0.0, errmsg: "first time for collection 'test.bork'" } m30999| 2014-04-02T17:50:30.008-0400 [conn1] setShardVersion shard0000 localhost:30000 test.bork { setShardVersion: "test.bork", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('533c862520b8d10b157f7601'), serverID: ObjectId('533c862120b8d10b157f75f9'), authoritative: true, shard: "shard0000", shardHost: "localhost:30000" } 0x7f508b335220 5 m30000| 2014-04-02T17:50:30.008-0400 [conn6] remotely refreshing metadata for test.bork with requested shard version 2|0||533c862520b8d10b157f7601 based on current shard version 0|0||533c862520b8d10b157f7601, current metadata version is 1|0||533c862520b8d10b157f7601 m30000| 2014-04-02T17:50:30.009-0400 [conn6] updating metadata for test.bork from shard version 0|0||533c862520b8d10b157f7601 to shard version 2|0||533c862520b8d10b157f7601 m30000| 2014-04-02T17:50:30.009-0400 [conn6] collection version was loaded at version 2|0||533c862520b8d10b157f7601, took 0ms m30999| 2014-04-02T17:50:30.010-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } m30999| 2014-04-02T17:50:30.013-0400 [conn1] setShardVersion shard0000 localhost:30000 test.bork2 { setShardVersion: "test.bork2", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('533c862220b8d10b157f75fe'), serverID: ObjectId('533c862120b8d10b157f75f9'), shard: "shard0000", shardHost: "localhost:30000" } 0x7f508b335220 3 m30999| 2014-04-02T17:50:30.013-0400 [conn1] setShardVersion failed! m30999| { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ns: "test.bork2", need_authoritative: true, ok: 0.0, errmsg: "first time for collection 'test.bork2'" } m30999| 2014-04-02T17:50:30.013-0400 [conn1] setShardVersion shard0000 localhost:30000 test.bork2 { setShardVersion: "test.bork2", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('533c862220b8d10b157f75fe'), serverID: ObjectId('533c862120b8d10b157f75f9'), authoritative: true, shard: "shard0000", shardHost: "localhost:30000" } 0x7f508b335220 3 m30000| 2014-04-02T17:50:30.013-0400 [conn6] remotely refreshing metadata for test.bork2 with requested shard version 2|0||533c862220b8d10b157f75fe based on current shard version 0|0||533c862220b8d10b157f75fe, current metadata version is 1|0||533c862220b8d10b157f75fe m30000| 2014-04-02T17:50:30.014-0400 [conn6] updating metadata for test.bork2 from shard version 0|0||533c862220b8d10b157f75fe to shard version 2|0||533c862220b8d10b157f75fe m30000| 2014-04-02T17:50:30.014-0400 [conn6] collection version was loaded at version 2|0||533c862220b8d10b157f75fe, took 0ms m30999| 2014-04-02T17:50:30.014-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } m30998| 2014-04-02T17:50:30.024-0400 [conn1] DBConfig unserialize: test { _id: "test", partitioned: true, primary: "shard0001" } m30998| 2014-04-02T17:50:30.025-0400 [conn1] found 2 shards listed on config server(s): localhost:30000 (127.0.0.1) m30998| 2014-04-02T17:50:30.026-0400 [conn1] ChunkManager: time to load chunks for test.bork: 0ms sequenceNumber: 2 version: 2|0||533c862520b8d10b157f7601 based on: (empty) m30998| 2014-04-02T17:50:30.027-0400 [conn1] ChunkManager: time to load chunks for test.bork2: 0ms sequenceNumber: 3 version: 2|0||533c862220b8d10b157f75fe based on: (empty) m30998| 2014-04-02T17:50:30.027-0400 [conn1] setShardVersion shard0000 localhost:30000 test.bork { setShardVersion: "test.bork", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('533c862520b8d10b157f7601'), serverID: ObjectId('533c8621296bf2b260136647'), shard: "shard0000", shardHost: "localhost:30000" } 0x7fd88cf42620 2 m30998| 2014-04-02T17:50:30.027-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } m30998| 2014-04-02T17:50:30.027-0400 [conn1] creating new connection to:localhost:30001 m30998| 2014-04-02T17:50:30.027-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30001| 2014-04-02T17:50:30.028-0400 [initandlisten] connection accepted from 127.0.0.1:56332 #6 (6 connections now open) m30998| 2014-04-02T17:50:30.028-0400 [conn1] connected to server localhost:30001 (127.0.0.1) m30998| 2014-04-02T17:50:30.028-0400 [conn1] connected connection! m30998| 2014-04-02T17:50:30.028-0400 [conn1] creating WriteBackListener for: localhost:30001 serverID: 533c8621296bf2b260136647 m30998| 2014-04-02T17:50:30.028-0400 [conn1] initializing shard connection to localhost:30001 (127.0.0.1) m30998| 2014-04-02T17:50:30.028-0400 [WriteBackListener-localhost:30001] BackgroundJob starting: WriteBackListener-localhost:30001 m30998| 2014-04-02T17:50:30.028-0400 [WriteBackListener-localhost:30001] creating new connection to:localhost:30001 m30998| 2014-04-02T17:50:30.028-0400 [ConnectBG] BackgroundJob starting: ConnectBG m30998| 2014-04-02T17:50:30.028-0400 [conn1] resetting shard version of test.bork on localhost:30001, version is zero m30998| 2014-04-02T17:50:30.028-0400 [conn1] setShardVersion shard0001 localhost:30001 test.bork { setShardVersion: "test.bork", configdb: "localhost:30000", version: Timestamp 0|0, versionEpoch: ObjectId('533c862520b8d10b157f7601'), serverID: ObjectId('533c8621296bf2b260136647'), shard: "shard0001", shardHost: "localhost:30001" } 0x7fd88cf43b20 2 m30001| 2014-04-02T17:50:30.028-0400 [initandlisten] connection accepted from 127.0.0.1:56333 #7 (7 connections now open) m30998| 2014-04-02T17:50:30.028-0400 [WriteBackListener-localhost:30001] connected to server localhost:30001 (127.0.0.1) m30998| 2014-04-02T17:50:30.028-0400 [WriteBackListener-localhost:30001] connected connection! m30998| 2014-04-02T17:50:30.028-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } m30998| 2014-04-02T17:50:30.032-0400 [conn1] setShardVersion shard0000 localhost:30000 test.bork2 { setShardVersion: "test.bork2", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('533c862220b8d10b157f75fe'), serverID: ObjectId('533c8621296bf2b260136647'), shard: "shard0000", shardHost: "localhost:30000" } 0x7fd88cf42620 3 m30998| 2014-04-02T17:50:30.032-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } m30998| 2014-04-02T17:50:30.032-0400 [conn1] resetting shard version of test.bork2 on localhost:30001, version is zero m30998| 2014-04-02T17:50:30.032-0400 [conn1] setShardVersion shard0001 localhost:30001 test.bork2 { setShardVersion: "test.bork2", configdb: "localhost:30000", version: Timestamp 0|0, versionEpoch: ObjectId('533c862220b8d10b157f75fe'), serverID: ObjectId('533c8621296bf2b260136647'), shard: "shard0001", shardHost: "localhost:30001" } 0x7fd88cf43b20 3 m30998| 2014-04-02T17:50:30.032-0400 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId('000000000000000000000000'), ok: 1.0 } Counts for two collections were: 10 10 10 10 Stats show sharded for two collections were: true true true true For other user: { "sharded" : true, "systemFlags" : 1, "userFlags" : 1, "ns" : "test.bork", "count" : 10, "numExtents" : 1, "size" : 480, "storageSize" : 8192, "totalIndexSize" : 8176, "indexSizes" : { "_id_" : 8176 }, "avgObjSize" : 48, "nindexes" : 1, "nchunks" : 1, "shards" : { "shard0000" : { "ns" : "test.bork", "count" : 10, "size" : 480, "avgObjSize" : 48, "storageSize" : 8192, "numExtents" : 1, "nindexes" : 1, "lastExtentSize" : 8192, "paddingFactor" : 1, "systemFlags" : 1, "userFlags" : 1, "totalIndexSize" : 8176, "indexSizes" : { "_id_" : 8176 }, "ok" : 1 } }, "ok" : 1 } { "sharded" : true, "systemFlags" : 1, "userFlags" : 1, "ns" : "test.bork2", "count" : 10, "numExtents" : 1, "size" : 480, "storageSize" : 8192, "totalIndexSize" : 8176, "indexSizes" : { "_id_" : 8176 }, "avgObjSize" : 48, "nindexes" : 1, "nchunks" : 1, "shards" : { "shard0000" : { "ns" : "test.bork2", "count" : 10, "size" : 480, "avgObjSize" : 48, "storageSize" : 8192, "numExtents" : 1, "nindexes" : 1, "lastExtentSize" : 8192, "paddingFactor" : 1, "systemFlags" : 1, "userFlags" : 1, "totalIndexSize" : 8176, "indexSizes" : { "_id_" : 8176 }, "ok" : 1 } }, "ok" : 1 } After re-authing, Stats show sharded for two sharded collections as: true true m30999| 2014-04-02T17:50:30.068-0400 [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends m30999| 2014-04-02T17:50:30.068-0400 [signalProcessingThread] dbexit: rc:0 m30000| 2014-04-02T17:50:30.069-0400 [conn5] end connection 127.0.0.1:35613 (17 connections now open) m30001| 2014-04-02T17:50:30.069-0400 [conn4] end connection 127.0.0.1:56322 (6 connections now open) m30000| 2014-04-02T17:50:30.069-0400 [conn6] end connection 127.0.0.1:35615 (17 connections now open) m30000| 2014-04-02T17:50:30.069-0400 [conn4] end connection 127.0.0.1:35612 (17 connections now open) m30000| 2014-04-02T17:50:30.069-0400 [conn6] thread conn6 stack usage was 32408 bytes, which is the most so far m30000| 2014-04-02T17:50:30.069-0400 [conn7] end connection 127.0.0.1:35621 (17 connections now open) m30001| 2014-04-02T17:50:30.069-0400 [conn3] end connection 127.0.0.1:56321 (6 connections now open) m30001| 2014-04-02T17:50:30.069-0400 [conn4] thread conn4 stack usage was 34808 bytes, which is the most so far 2014-04-02T17:50:31.068-0400 shell: stopped mongo program on port 30999 m30998| 2014-04-02T17:50:31.068-0400 [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends m30998| 2014-04-02T17:50:31.068-0400 [signalProcessingThread] dbexit: rc:0 m30000| 2014-04-02T17:50:31.069-0400 [conn10] end connection 127.0.0.1:35626 (13 connections now open) m30001| 2014-04-02T17:50:31.069-0400 [conn6] end connection 127.0.0.1:56332 (4 connections now open) m30000| 2014-04-02T17:50:31.069-0400 [conn9] end connection 127.0.0.1:35625 (13 connections now open) m30000| 2014-04-02T17:50:31.069-0400 [conn11] end connection 127.0.0.1:35627 (13 connections now open) m30000| 2014-04-02T17:50:31.069-0400 [conn12] end connection 127.0.0.1:35628 (13 connections now open) 2014-04-02T17:50:32.068-0400 shell: stopped mongo program on port 30998 m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] now exiting m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] dbexit: m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] shutdown: going to close listening sockets... m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] closing listening socket: 8 m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] closing listening socket: 9 m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] removing socket file: /tmp/mongodb-30000.sock m30000| 2014-04-02T17:50:32.068-0400 [signalProcessingThread] shutdown: going to flush diaglog... m30000| 2014-04-02T17:50:32.069-0400 [signalProcessingThread] shutdown: going to close sockets... m30000| 2014-04-02T17:50:32.069-0400 [signalProcessingThread] shutdown: waiting for fs preallocator... m30000| 2014-04-02T17:50:32.069-0400 [signalProcessingThread] shutdown: closing all files... m30000| 2014-04-02T17:50:32.069-0400 [conn19] end connection 127.0.0.1:35640 (9 connections now open) m30000| 2014-04-02T17:50:32.069-0400 [conn17] end connection 127.0.0.1:35637 (9 connections now open) m30000| 2014-04-02T17:50:32.069-0400 [conn16] end connection 127.0.0.1:35636 (9 connections now open) m30000| 2014-04-02T17:50:32.069-0400 [conn18] end connection 127.0.0.1:35639 (9 connections now open) m30000| 2014-04-02T17:50:32.069-0400 [conn14] end connection 127.0.0.1:35634 (9 connections now open) m30000| 2014-04-02T17:50:32.069-0400 [conn1] end connection 127.0.0.1:35606 (9 connections now open) m30000| 2014-04-02T17:50:32.070-0400 [conn2] end connection 127.0.0.1:35609 (8 connections now open) m30000| 2014-04-02T17:50:32.070-0400 [conn15] end connection 127.0.0.1:35635 (7 connections now open) m30000| 2014-04-02T17:50:32.070-0400 [conn20] end connection 127.0.0.1:35641 (6 connections now open) m30000| 2014-04-02T17:50:32.070-0400 [conn13] end connection 127.0.0.1:35633 (8 connections now open) m30001| 2014-04-02T17:50:32.070-0400 [conn5] end connection 127.0.0.1:56328 (3 connections now open) m30000| 2014-04-02T17:50:32.071-0400 [signalProcessingThread] closeAllFiles() finished m30000| 2014-04-02T17:50:32.071-0400 [signalProcessingThread] shutdown: removing fs lock... m30000| 2014-04-02T17:50:32.071-0400 [signalProcessingThread] dbexit: really exiting now 2014-04-02T17:50:33.068-0400 shell: stopped mongo program on port 30000 m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] now exiting m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] dbexit: m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] shutdown: going to close listening sockets... m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] closing listening socket: 11 m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] closing listening socket: 12 m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] removing socket file: /tmp/mongodb-30001.sock m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] shutdown: going to flush diaglog... m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] shutdown: going to close sockets... m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] shutdown: waiting for fs preallocator... m30001| 2014-04-02T17:50:33.069-0400 [signalProcessingThread] shutdown: closing all files... m30001| 2014-04-02T17:50:33.069-0400 [conn1] end connection 127.0.0.1:56298 (2 connections now open) m30001| 2014-04-02T17:50:33.070-0400 [signalProcessingThread] closeAllFiles() finished m30001| 2014-04-02T17:50:33.070-0400 [signalProcessingThread] shutdown: removing fs lock... m30001| 2014-04-02T17:50:33.070-0400 [signalProcessingThread] dbexit: really exiting now 2014-04-02T17:50:34.069-0400 shell: stopped mongo program on port 30001 *** ShardingTest auth_add_shard_collection completed successfully in 10.531 seconds *** 10.8612 seconds 2014-04-02T17:50:34.081-0400 [initandlisten] connection accepted from 127.0.0.1:55213 #3 (1 connection now open) 2014-04-02T17:50:34.081-0400 [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2014-04-02T17:50:34.081-0400 [signalProcessingThread] now exiting 2014-04-02T17:50:34.081-0400 [signalProcessingThread] dbexit: 2014-04-02T17:50:34.081-0400 [signalProcessingThread] shutdown: going to close listening sockets... 2014-04-02T17:50:34.081-0400 [signalProcessingThread] closing listening socket: 5 2014-04-02T17:50:34.081-0400 [signalProcessingThread] closing listening socket: 6 2014-04-02T17:50:34.081-0400 [signalProcessingThread] closing listening socket: 10 2014-04-02T17:50:34.081-0400 [signalProcessingThread] removing socket file: /tmp/mongodb-27999.sock 2014-04-02T17:50:34.081-0400 [signalProcessingThread] shutdown: going to flush diaglog... 2014-04-02T17:50:34.081-0400 [signalProcessingThread] shutdown: going to close sockets... 2014-04-02T17:50:34.081-0400 [signalProcessingThread] shutdown: waiting for fs preallocator... 2014-04-02T17:50:34.081-0400 [signalProcessingThread] shutdown: closing all files... 2014-04-02T17:50:34.082-0400 [signalProcessingThread] closeAllFiles() finished 2014-04-02T17:50:34.082-0400 [signalProcessingThread] shutdown: removing fs lock... 2014-04-02T17:50:34.082-0400 [signalProcessingThread] dbexit: really exiting now 2014-04-02T17:50:34.082-0400 [signalProcessingThread] thread signalProcessingThread stack usage was 5936 bytes, which is the most so far 1 tests succeeded