cwd [/home/greg/Workspaces/Mongo Workspace/mongo] num procs:358 removing: /data/db/sconsTests//mongod.lock running /home/greg/Workspaces/Mongo Workspace/mongo/mongod --port 27999 --dbpath /data/db/sconsTests/ --nopreallocj Wed Aug 1 16:10:25 [initandlisten] MongoDB starting : pid=16679 port=27999 dbpath=/data/db/sconsTests/ 64-bit host=ubuntu Wed Aug 1 16:10:25 [initandlisten] db version v2.2.0-rc1-pre-, pdfile version 4.5 Wed Aug 1 16:10:25 [initandlisten] git version: 95bdb0df18bf8d1ddee7e6cf200f8021d4256c86 Wed Aug 1 16:10:25 [initandlisten] build info: Linux ubuntu 2.6.35-27-generic #48-Ubuntu SMP Tue Feb 22 20:25:46 UTC 2011 x86_64 BOOST_LIB_VERSION=1_49 Wed Aug 1 16:10:25 [initandlisten] options: { dbpath: "/data/db/sconsTests/", nopreallocj: true, port: 27999 } Wed Aug 1 16:10:25 [initandlisten] journal dir=/data/db/sconsTests/journal Wed Aug 1 16:10:25 [initandlisten] recover : no journal files present, no recovery needed Wed Aug 1 16:10:25 [websvr] admin web console waiting for connections on port 28999 Wed Aug 1 16:10:25 [initandlisten] waiting for connections on port 27999 Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:43578 #1 (1 connection now open) ******************************************* Test : 6_cluster_multi_version_passthrough.js ... Wed Aug 1 16:10:26 [conn1] end connection 127.0.0.1:43578 (0 connections now open) Command : /home/greg/Workspaces/Mongo Workspace/mongo/mongo --port 27999 /home/greg/Workspaces/Mongo Workspace/mongo/jstests/multiVersion/6_cluster_multi_version_passthrough.js --eval TestData = new Object();TestData.testPath = "/home/greg/Workspaces/Mongo Workspace/mongo/jstests/multiVersion/6_cluster_multi_version_passthrough.js";TestData.testFile = "6_cluster_multi_version_passthrough.js";TestData.testName = "6_cluster_multi_version_passthrough";TestData.noJournal = false;TestData.noJournalPrealloc = true;TestData.auth = false;TestData.keyFile = null;TestData.keyFileData = null; Date : Wed Aug 1 16:10:26 2012 MongoDB shell version: 2.2.0-rc1-pre- connecting to: 127.0.0.1:27999/test Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:43579 #2 (1 connection now open) null ---- Running multi-version 2.0/2.2 mongod/mongos cluster tests... ---- >>>>>>>>> skipping excluded test multi_mongos2a >>>>>>>>> skipping excluded test names >>>>>>>>> skipping excluded test sync1 >>>>>>>>> skipping excluded test moveprimary_ignore_sharded >>>>>>>>> skipping excluded test gle_with_conf_servers >>>>>>>>> skipping excluded test error1 >>>>>>>>> skipping excluded test prefix_shard_key >>>>>>>>> skipping excluded test multi_mongos1 >>>>>>>>> skipping excluded test geo_near_random1 >>>>>>>>> skipping excluded test sync2 >>>>>>>>> skipping excluded test sync6 >>>>>>>>> skipping excluded test geo_near_random2 >>>>>>>>> skipping excluded test auth >>>>>>>>> skipping excluded test inTiming >>>>>>>>> skipping excluded test movePrimary1 >>>>>>>>> skipping excluded test passthrough1 >>>>>>>>> skipping excluded test coll_epoch_test1 >>>>>>>>> skipping excluded test disable_autosplit >>>>>>>>> skipping excluded test stats >>>>>>>>> skipping excluded test addshard1 >>>>>>>>> skipping excluded test features1 >>>>>>>>> skipping excluded test reset_shard_version >>>>>>>>> skipping excluded test limit_push >>>>>>>>> skipping excluded test user_flags_sharded >>>>>>>>> skipping excluded test mongos_no_detect_sharding >>>>>>>>> skipping excluded test presplit >>>>>>>>> skipping excluded test remove2 >>>>>>>> skipping jstests/sharding/sharding_with_keyfile.key >>>>>>>>> skipping excluded test mrShardedOutput >>>>>>>>> skipping excluded test features2 >>>>>>>>> skipping excluded test bouncing_count >>>>>>>>> skipping excluded test shard_existing >>>>>>>>> skipping excluded test drop_configdb >>>>>>>>> skipping excluded test mongos_validate_backoff >>>>>>>>> skipping excluded test writeback_shard_version >>>>>>>>> skipping excluded test addshard4 >>>>>>>>> skipping excluded test auth_add_shard >>>>>>>>> skipping excluded test complex_sharding >>>>>>>>> skipping excluded test sync4 >>>>>>>>> skipping excluded test mapReduce >>>>>>>>> skipping excluded test updated_existing >>>>>>>>> skipping excluded test key_many >>>>>>>>> skipping excluded test no_empty_reset >>>>>>>>> skipping excluded test version1 >>>>>>>>> skipping excluded test jumbo1 >>>>>>>>> skipping excluded test migrateBig >>>>>>>>> skipping excluded test shard_keycount >>>>>>>>> skipping excluded test auth_slaveok_routing >>>>>>>>> skipping excluded test sync3 >>>>>>>>> skipping excluded test sync7 >>>>>>>>> skipping excluded test repl_monitor_refresh >>>>>>>>> skipping excluded test sort1 >>>>>>>>> skipping excluded test auto1 >>>>>>>>> skipping excluded test cursor1 >>>>>>>>> skipping excluded test refresh_syncclusterconn >>>>>>>>> skipping excluded test shard4 >>>>>>>>> skipping excluded test addshard2 >>>>>>>>> skipping excluded test auth_repl >>>>>>>>> skipping excluded test features3 >>>>>>>>> skipping excluded test parallel >>>>>>>>> skipping excluded test shard_with_special_db_names >>>>>>>>> skipping excluded test shard2 >>>>>>>>> skipping excluded test inserts_consistent >>>>>>>>> skipping excluded test shard6 >>>>>>>>> skipping excluded test auth_ro >>>>>>>>> skipping excluded test bad_config_load >>>>>>>>> skipping excluded test zbigMapReduce >>>>>>>>> skipping excluded test auto2 >>>>>>>>> skipping excluded test shard5 >>>>>>>>> skipping excluded test rename >>>>>>>>> skipping excluded test index1 >>>>>>>>> skipping excluded test remove1 >>>>>>>>> skipping excluded test version2 >>>>>>>>> skipping excluded test gridfs >>>>>>>>> skipping excluded test mongos_validate_writes >>>>>>>>> skipping excluded test coll_epoch_test0 >>>>>>>>> skipping excluded test findandmodify2 >>>>>>>>> skipping excluded test multi_mongos2 >>>>>>>>> skipping excluded test auth2 >>>>>>>>> skipping excluded test key_string ******************************************* Test : jstests/sharding/shard3.js ... Resetting db path '/data/db/shard30' Wed Aug 1 16:10:26 shell: started program mongod-2.0.6 --port 30000 --dbpath /data/db/shard30 --nopreallocj m30000| Wed Aug 1 16:10:26 [initandlisten] MongoDB starting : pid=16693 port=30000 dbpath=/data/db/shard30 64-bit host=ubuntu m30000| Wed Aug 1 16:10:26 [initandlisten] db version v2.0.6, pdfile version 4.5 m30000| Wed Aug 1 16:10:26 [initandlisten] git version: e1c0cbc25863f6356aa4e31375add7bb49fb05bc m30000| Wed Aug 1 16:10:26 [initandlisten] build info: Linux ip-10-110-9-236 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41 m30000| Wed Aug 1 16:10:26 [initandlisten] options: { dbpath: "/data/db/shard30", nopreallocj: true, port: 30000 } m30000| Wed Aug 1 16:10:26 [initandlisten] journal dir=/data/db/shard30/journal m30000| Wed Aug 1 16:10:26 [initandlisten] recover : no journal files present, no recovery needed m30000| Wed Aug 1 16:10:26 [initandlisten] waiting for connections on port 30000 m30000| Wed Aug 1 16:10:26 [websvr] admin web console waiting for connections on port 31000 m30000| Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:42778 #1 Resetting db path '/data/db/shard31' Wed Aug 1 16:10:26 shell: started program mongod-2.0.6 --port 30001 --dbpath /data/db/shard31 --nopreallocj m30001| Wed Aug 1 16:10:26 [initandlisten] MongoDB starting : pid=16706 port=30001 dbpath=/data/db/shard31 64-bit host=ubuntu m30001| Wed Aug 1 16:10:26 [initandlisten] db version v2.0.6, pdfile version 4.5 m30001| Wed Aug 1 16:10:26 [initandlisten] git version: e1c0cbc25863f6356aa4e31375add7bb49fb05bc m30001| Wed Aug 1 16:10:26 [initandlisten] build info: Linux ip-10-110-9-236 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41 m30001| Wed Aug 1 16:10:26 [initandlisten] options: { dbpath: "/data/db/shard31", nopreallocj: true, port: 30001 } m30001| Wed Aug 1 16:10:26 [initandlisten] journal dir=/data/db/shard31/journal m30001| Wed Aug 1 16:10:26 [initandlisten] recover : no journal files present, no recovery needed m30001| Wed Aug 1 16:10:26 [websvr] admin web console waiting for connections on port 31001 m30001| Wed Aug 1 16:10:26 [initandlisten] waiting for connections on port 30001 m30001| Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:53201 #1 "localhost:30000" m30000| Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:42781 #2 ShardingTest shard3 : { "config" : "localhost:30000", "shards" : [ connection to localhost:30000, connection to localhost:30001 ] } Wed Aug 1 16:10:26 shell: started program /home/greg/Workspaces/Mongo Workspace/mongo/mongos --port 30999 --configdb localhost:30000 -v --chunkSize 50 m30999| Wed Aug 1 16:10:26 warning: running with 1 config server should be done only for testing purposes and is not recommended for production m30999| Wed Aug 1 16:10:26 [mongosMain] MongoS version 2.2.0-rc1-pre- starting: pid=16721 port=30999 64-bit host=ubuntu (--help for usage) m30999| Wed Aug 1 16:10:26 [mongosMain] git version: 95bdb0df18bf8d1ddee7e6cf200f8021d4256c86 m30999| Wed Aug 1 16:10:26 [mongosMain] build info: Linux ubuntu 2.6.35-27-generic #48-Ubuntu SMP Tue Feb 22 20:25:46 UTC 2011 x86_64 BOOST_LIB_VERSION=1_49 m30999| Wed Aug 1 16:10:26 [mongosMain] options: { chunkSize: 50, configdb: "localhost:30000", port: 30999, verbose: true } m30999| Wed Aug 1 16:10:26 [mongosMain] config string : localhost:30000 m30999| Wed Aug 1 16:10:26 [mongosMain] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:26 BackgroundJob starting: ConnectBG m30999| Wed Aug 1 16:10:26 [mongosMain] connected connection! m30000| Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:42783 #3 m30999| Wed Aug 1 16:10:26 BackgroundJob starting: CheckConfigServers m30999| Wed Aug 1 16:10:26 [CheckConfigServers] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:26 BackgroundJob starting: ConnectBG m30999| Wed Aug 1 16:10:26 [CheckConfigServers] connected connection! m30000| Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:42784 #4 m30999| Wed Aug 1 16:10:26 [mongosMain] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:26 BackgroundJob starting: ConnectBG m30000| Wed Aug 1 16:10:26 [initandlisten] connection accepted from 127.0.0.1:42785 #5 m30999| Wed Aug 1 16:10:26 [mongosMain] connected connection! m30000| Wed Aug 1 16:10:26 [FileAllocator] allocating new datafile /data/db/shard30/config.ns, filling with zeroes... m30000| Wed Aug 1 16:10:26 [FileAllocator] creating directory /data/db/shard30/_tmp m30000| Wed Aug 1 16:10:26 [FileAllocator] done allocating datafile /data/db/shard30/config.ns, size: 16MB, took 0.238 secs m30000| Wed Aug 1 16:10:26 [FileAllocator] allocating new datafile /data/db/shard30/config.0, filling with zeroes... m30000| Wed Aug 1 16:10:27 [FileAllocator] done allocating datafile /data/db/shard30/config.0, size: 64MB, took 0.634 secs m30000| Wed Aug 1 16:10:27 [FileAllocator] allocating new datafile /data/db/shard30/config.1, filling with zeroes... m30000| Wed Aug 1 16:10:27 [conn5] build index config.version { _id: 1 } m30000| Wed Aug 1 16:10:27 [conn5] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn5] insert config.version 888ms m30999| Wed Aug 1 16:10:27 [mongosMain] fd limit hard:65536 soft:65536 max conn: 52428 m30999| Wed Aug 1 16:10:27 [websvr] fd limit hard:65536 soft:65536 max conn: 52428 m30999| Wed Aug 1 16:10:27 BackgroundJob starting: Balancer m30999| Wed Aug 1 16:10:27 BackgroundJob starting: cursorTimeout m30999| Wed Aug 1 16:10:27 [Balancer] about to contact config servers and shards m30999| Wed Aug 1 16:10:27 [websvr] admin web console waiting for connections on port 31999 m30999| Wed Aug 1 16:10:27 BackgroundJob starting: PeriodicTask::Runner m30000| Wed Aug 1 16:10:27 [conn3] build index config.settings { _id: 1 } m30999| Wed Aug 1 16:10:27 [mongosMain] waiting for connections on port 30999 m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn3] build index config.chunks { _id: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn3] info: creating collection config.chunks on add index m30000| Wed Aug 1 16:10:27 [conn3] build index config.chunks { ns: 1, min: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn3] build index config.chunks { ns: 1, shard: 1, min: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn3] build index config.chunks { ns: 1, lastmod: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn3] build index config.shards { _id: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn3] info: creating collection config.shards on add index m30000| Wed Aug 1 16:10:27 [conn3] build index config.shards { host: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30999| Wed Aug 1 16:10:27 [Balancer] config servers and shards contacted successfully m30999| Wed Aug 1 16:10:27 [Balancer] balancer id: ubuntu:30999 started at Aug 1 16:10:27 m30999| Wed Aug 1 16:10:27 [Balancer] created new distributed lock for balancer on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30999| Wed Aug 1 16:10:27 [Balancer] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:27 BackgroundJob starting: ConnectBG m30000| Wed Aug 1 16:10:27 [initandlisten] connection accepted from 127.0.0.1:42792 #6 m30999| Wed Aug 1 16:10:27 [Balancer] connected connection! m30000| Wed Aug 1 16:10:27 [conn5] build index config.mongos { _id: 1 } m30000| Wed Aug 1 16:10:27 [conn5] build index done 0 records 0 secs m30999| Wed Aug 1 16:10:27 [Balancer] Refreshing MaxChunkSize: 50 m30999| Wed Aug 1 16:10:27 [LockPinger] creating distributed lock ping thread for localhost:30000 and process ubuntu:30999:1343851827:1804289383 (sleeping for 30000ms) m30999| Wed Aug 1 16:10:27 [Balancer] inserting initial doc in config.locks for lock balancer m30999| Wed Aug 1 16:10:27 [Balancer] about to acquire distributed lock 'balancer/ubuntu:30999:1343851827:1804289383: m30999| { "state" : 1, m30999| "who" : "ubuntu:30999:1343851827:1804289383:Balancer:846930886", m30999| "process" : "ubuntu:30999:1343851827:1804289383", m30999| "when" : { "$date" : "Wed Aug 1 16:10:27 2012" }, m30999| "why" : "doing balance round", m30999| "ts" : { "$oid" : "50198d3337b68b99c028581e" } } m30999| { "_id" : "balancer", m30999| "state" : 0 } m30000| Wed Aug 1 16:10:27 [conn3] build index config.lockpings { _id: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:27 [conn6] build index config.locks { _id: 1 } m30000| Wed Aug 1 16:10:27 [conn6] build index done 0 records 0 secs m30999| Wed Aug 1 16:10:27 [Balancer] distributed lock 'balancer/ubuntu:30999:1343851827:1804289383' acquired, ts : 50198d3337b68b99c028581e m30999| Wed Aug 1 16:10:27 [Balancer] *** start balancing round m30999| Wed Aug 1 16:10:27 [LockPinger] cluster localhost:30000 pinged successfully at Wed Aug 1 16:10:27 2012 by distributed lock pinger 'localhost:30000/ubuntu:30999:1343851827:1804289383', sleeping for 30000ms m30999| Wed Aug 1 16:10:27 [Balancer] no collections to balance m30999| Wed Aug 1 16:10:27 [Balancer] no need to move any chunk m30999| Wed Aug 1 16:10:27 [Balancer] *** end of balancing round m30000| Wed Aug 1 16:10:27 [conn3] build index config.lockpings { ping: 1 } m30000| Wed Aug 1 16:10:27 [conn3] build index done 1 records 0 secs m30999| Wed Aug 1 16:10:27 [Balancer] distributed lock 'balancer/ubuntu:30999:1343851827:1804289383' unlocked. m30999| Wed Aug 1 16:10:27 [mongosMain] connection accepted from 127.0.0.1:52202 #1 (1 connection now open) Wed Aug 1 16:10:27 shell: started program /home/greg/Workspaces/Mongo Workspace/mongo/mongos --port 30998 --configdb localhost:30000 -v --chunkSize 50 m30998| Wed Aug 1 16:10:27 warning: running with 1 config server should be done only for testing purposes and is not recommended for production m30998| Wed Aug 1 16:10:27 [mongosMain] MongoS version 2.2.0-rc1-pre- starting: pid=16746 port=30998 64-bit host=ubuntu (--help for usage) m30998| Wed Aug 1 16:10:27 [mongosMain] git version: 95bdb0df18bf8d1ddee7e6cf200f8021d4256c86 m30998| Wed Aug 1 16:10:27 [mongosMain] build info: Linux ubuntu 2.6.35-27-generic #48-Ubuntu SMP Tue Feb 22 20:25:46 UTC 2011 x86_64 BOOST_LIB_VERSION=1_49 m30998| Wed Aug 1 16:10:27 [mongosMain] options: { chunkSize: 50, configdb: "localhost:30000", port: 30998, verbose: true } m30998| Wed Aug 1 16:10:27 [mongosMain] config string : localhost:30000 m30998| Wed Aug 1 16:10:27 [mongosMain] creating new connection to:localhost:30000 m30998| Wed Aug 1 16:10:27 BackgroundJob starting: ConnectBG m30000| Wed Aug 1 16:10:27 [initandlisten] connection accepted from 127.0.0.1:42795 #7 m30998| Wed Aug 1 16:10:27 [mongosMain] connected connection! m30998| Wed Aug 1 16:10:28 BackgroundJob starting: CheckConfigServers m30998| Wed Aug 1 16:10:28 [CheckConfigServers] creating new connection to:localhost:30000 m30998| Wed Aug 1 16:10:28 BackgroundJob starting: ConnectBG m30000| Wed Aug 1 16:10:28 [initandlisten] connection accepted from 127.0.0.1:42796 #8 m30998| Wed Aug 1 16:10:28 [CheckConfigServers] connected connection! m30998| Wed Aug 1 16:10:28 [mongosMain] MaxChunkSize: 50 m30998| Wed Aug 1 16:10:28 BackgroundJob starting: cursorTimeout m30998| Wed Aug 1 16:10:28 [websvr] fd limit hard:65536 soft:65536 max conn: 52428 m30998| Wed Aug 1 16:10:28 BackgroundJob starting: PeriodicTask::Runner m30998| Wed Aug 1 16:10:28 [mongosMain] fd limit hard:65536 soft:65536 max conn: 52428 m30998| Wed Aug 1 16:10:28 BackgroundJob starting: Balancer m30998| Wed Aug 1 16:10:28 [websvr] admin web console waiting for connections on port 31998 m30998| Wed Aug 1 16:10:28 [Balancer] about to contact config servers and shards m30998| Wed Aug 1 16:10:28 [Balancer] creating new connection to:localhost:30000 m30998| Wed Aug 1 16:10:28 [mongosMain] waiting for connections on port 30998 m30998| Wed Aug 1 16:10:28 BackgroundJob starting: ConnectBG m30000| Wed Aug 1 16:10:28 [initandlisten] connection accepted from 127.0.0.1:42797 #9 m30998| Wed Aug 1 16:10:28 [Balancer] connected connection! m30998| Wed Aug 1 16:10:28 [Balancer] config servers and shards contacted successfully m30998| Wed Aug 1 16:10:28 [Balancer] balancer id: ubuntu:30998 started at Aug 1 16:10:28 m30998| Wed Aug 1 16:10:28 [Balancer] created new distributed lock for balancer on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30998| Wed Aug 1 16:10:28 [Balancer] creating new connection to:localhost:30000 m30998| Wed Aug 1 16:10:28 BackgroundJob starting: ConnectBG m30998| Wed Aug 1 16:10:28 [Balancer] connected connection! m30000| Wed Aug 1 16:10:28 [initandlisten] connection accepted from 127.0.0.1:42798 #10 m30998| Wed Aug 1 16:10:28 [Balancer] Refreshing MaxChunkSize: 50 m30998| Wed Aug 1 16:10:28 [LockPinger] creating distributed lock ping thread for localhost:30000 and process ubuntu:30998:1343851828:1804289383 (sleeping for 30000ms) m30998| Wed Aug 1 16:10:28 [Balancer] about to acquire distributed lock 'balancer/ubuntu:30998:1343851828:1804289383: m30998| { "state" : 1, m30998| "who" : "ubuntu:30998:1343851828:1804289383:Balancer:846930886", m30998| "process" : "ubuntu:30998:1343851828:1804289383", m30998| "when" : { "$date" : "Wed Aug 1 16:10:28 2012" }, m30998| "why" : "doing balance round", m30998| "ts" : { "$oid" : "50198d3413c9681140515231" } } m30998| { "_id" : "balancer", m30998| "state" : 0, m30998| "ts" : { "$oid" : "50198d3337b68b99c028581e" } } m30998| Wed Aug 1 16:10:28 [LockPinger] cluster localhost:30000 pinged successfully at Wed Aug 1 16:10:28 2012 by distributed lock pinger 'localhost:30000/ubuntu:30998:1343851828:1804289383', sleeping for 30000ms m30998| Wed Aug 1 16:10:28 [Balancer] distributed lock 'balancer/ubuntu:30998:1343851828:1804289383' acquired, ts : 50198d3413c9681140515231 m30998| Wed Aug 1 16:10:28 [Balancer] *** start balancing round m30998| Wed Aug 1 16:10:28 [Balancer] no collections to balance m30998| Wed Aug 1 16:10:28 [Balancer] no need to move any chunk m30998| Wed Aug 1 16:10:28 [Balancer] *** end of balancing round m30998| Wed Aug 1 16:10:28 [Balancer] distributed lock 'balancer/ubuntu:30998:1343851828:1804289383' unlocked. ShardingTest undefined going to add shard : localhost:30000 m30998| Wed Aug 1 16:10:28 [mongosMain] connection accepted from 127.0.0.1:56542 #1 (1 connection now open) m30999| Wed Aug 1 16:10:28 [conn1] couldn't find database [admin] in config db m30000| Wed Aug 1 16:10:28 [conn3] build index config.databases { _id: 1 } m30000| Wed Aug 1 16:10:28 [conn3] build index done 0 records 0 secs m30999| Wed Aug 1 16:10:28 [conn1] put [admin] on: config:localhost:30000 m30000| Wed Aug 1 16:10:29 [FileAllocator] done allocating datafile /data/db/shard30/config.1, size: 128MB, took 1.826 secs m30000| Wed Aug 1 16:10:29 [conn5] command admin.$cmd command: { listDatabases: 1 } ntoreturn:1 reslen:177 1116ms m30999| Wed Aug 1 16:10:29 [conn1] going to add shard: { _id: "shard0000", host: "localhost:30000" } { "shardAdded" : "shard0000", "ok" : 1 } ShardingTest undefined going to add shard : localhost:30001 m30999| Wed Aug 1 16:10:29 [conn1] creating new connection to:localhost:30001 m30999| Wed Aug 1 16:10:29 BackgroundJob starting: ConnectBG m30001| Wed Aug 1 16:10:29 [initandlisten] connection accepted from 127.0.0.1:53221 #2 m30999| Wed Aug 1 16:10:29 [conn1] connected connection! m30999| Wed Aug 1 16:10:29 [conn1] going to add shard: { _id: "shard0001", host: "localhost:30001" } { "shardAdded" : "shard0001", "ok" : 1 } m30999| Wed Aug 1 16:10:29 [conn1] couldn't find database [test] in config db m30999| Wed Aug 1 16:10:29 [conn1] best shard for new allocation is shard: shard0001:localhost:30001 mapped: 0 writeLock: 0 m30999| Wed Aug 1 16:10:29 [conn1] put [test] on: shard0001:localhost:30001 m30999| Wed Aug 1 16:10:29 [conn1] enabling sharding on: test m30999| Wed Aug 1 16:10:29 [conn1] CMD: shardcollection: { shardcollection: "test.foo", key: { num: 1.0 } } m30999| Wed Aug 1 16:10:29 [conn1] enable sharding on: test.foo with shard key: { num: 1.0 } m30001| Wed Aug 1 16:10:29 [FileAllocator] allocating new datafile /data/db/shard31/test.ns, filling with zeroes... m30001| Wed Aug 1 16:10:29 [FileAllocator] creating directory /data/db/shard31/_tmp m30001| Wed Aug 1 16:10:29 [FileAllocator] done allocating datafile /data/db/shard31/test.ns, size: 16MB, took 0.219 secs m30001| Wed Aug 1 16:10:29 [FileAllocator] allocating new datafile /data/db/shard31/test.0, filling with zeroes... m30001| Wed Aug 1 16:10:31 [FileAllocator] done allocating datafile /data/db/shard31/test.0, size: 64MB, took 1.875 secs m30001| Wed Aug 1 16:10:31 [FileAllocator] allocating new datafile /data/db/shard31/test.1, filling with zeroes... m30001| Wed Aug 1 16:10:31 [conn2] build index test.foo { _id: 1 } m30001| Wed Aug 1 16:10:31 [conn2] build index done 0 records 0 secs m30001| Wed Aug 1 16:10:31 [conn2] info: creating collection test.foo on add index m30001| Wed Aug 1 16:10:31 [conn2] build index test.foo { num: 1.0 } m30001| Wed Aug 1 16:10:31 [conn2] build index done 0 records 0 secs m30001| Wed Aug 1 16:10:31 [conn2] insert test.system.indexes 2112ms m30999| Wed Aug 1 16:10:32 [conn1] going to create 1 chunk(s) for: test.foo using new epoch 50198d3837b68b99c028581f m30999| Wed Aug 1 16:10:32 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 2 version: 1|0||50198d3837b68b99c028581f based on: (empty) m30000| Wed Aug 1 16:10:32 [conn3] build index config.collections { _id: 1 } m30000| Wed Aug 1 16:10:32 [conn3] build index done 0 records 0 secs m30999| Wed Aug 1 16:10:32 [conn1] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:32 BackgroundJob starting: ConnectBG m30000| Wed Aug 1 16:10:32 [initandlisten] connection accepted from 127.0.0.1:42802 #11 m30999| Wed Aug 1 16:10:32 [conn1] connected connection! m30999| Wed Aug 1 16:10:32 [conn1] creating WriteBackListener for: localhost:30000 serverID: 50198d3337b68b99c028581d m30999| Wed Aug 1 16:10:32 [conn1] initializing shard connection to localhost:30000 m30999| Wed Aug 1 16:10:32 BackgroundJob starting: WriteBackListener-localhost:30000 m30999| Wed Aug 1 16:10:32 [conn1] resetting shard version of test.foo on localhost:30000, version is zero m30999| Wed Aug 1 16:10:32 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 0|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3337b68b99c028581d'), shard: "shard0000", shardHost: "localhost:30000" } 0xd54100 m30999| Wed Aug 1 16:10:32 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, ok: 1.0 } m30999| Wed Aug 1 16:10:32 [conn1] creating new connection to:localhost:30001 m30999| Wed Aug 1 16:10:32 BackgroundJob starting: ConnectBG m30999| Wed Aug 1 16:10:32 [conn1] connected connection! m30999| Wed Aug 1 16:10:32 [conn1] creating WriteBackListener for: localhost:30001 serverID: 50198d3337b68b99c028581d m30001| Wed Aug 1 16:10:32 [initandlisten] connection accepted from 127.0.0.1:53224 #3 m30999| Wed Aug 1 16:10:32 [conn1] initializing shard connection to localhost:30001 m30999| Wed Aug 1 16:10:32 BackgroundJob starting: WriteBackListener-localhost:30001 m30999| Wed Aug 1 16:10:32 [conn1] setShardVersion shard0001 localhost:30001 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 1000|0, versionEpoch: ObjectId('50198d3837b68b99c028581f'), serverID: ObjectId('50198d3337b68b99c028581d'), shard: "shard0001", shardHost: "localhost:30001" } 0x7f6d18001060 m30999| Wed Aug 1 16:10:32 [conn1] setShardVersion failed! m30999| { oldVersion: Timestamp 0|0, ns: "test.foo", need_authoritative: true, errmsg: "first time for collection 'test.foo'", ok: 0.0 } m30999| Wed Aug 1 16:10:32 [conn1] setShardVersion shard0001 localhost:30001 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 1000|0, versionEpoch: ObjectId('50198d3837b68b99c028581f'), serverID: ObjectId('50198d3337b68b99c028581d'), authoritative: true, shard: "shard0001", shardHost: "localhost:30001" } 0x7f6d18001060 m30000| Wed Aug 1 16:10:32 [initandlisten] connection accepted from 127.0.0.1:42804 #12 m30999| Wed Aug 1 16:10:32 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, ok: 1.0 } { "_id" : "admin", "partitioned" : false, "primary" : "config" } { "_id" : "test", "partitioned" : true, "primary" : "shard0001" } m30999| Wed Aug 1 16:10:32 [conn1] about to initiate autosplit: ns:test.foo at: shard0001:localhost:30001 lastmod: 1|0||000000000000000000000000 min: { num: MinKey } max: { num: MaxKey } dataWritten: 7396468 splitThreshold: 921 m30999| Wed Aug 1 16:10:32 [conn1] creating new connection to:localhost:30001 m30999| Wed Aug 1 16:10:32 BackgroundJob starting: ConnectBG m30999| Wed Aug 1 16:10:32 [conn1] connected connection! m30001| Wed Aug 1 16:10:32 [initandlisten] connection accepted from 127.0.0.1:53226 #4 m30999| Wed Aug 1 16:10:33 [Balancer] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:33 BackgroundJob starting: ConnectBG m30999| Wed Aug 1 16:10:33 [Balancer] connected connection! m30000| Wed Aug 1 16:10:33 [initandlisten] connection accepted from 127.0.0.1:42806 #13 m30999| Wed Aug 1 16:10:33 [Balancer] Refreshing MaxChunkSize: 50 m30999| Wed Aug 1 16:10:33 [Balancer] skipping balancing round because balancing is disabled m30998| Wed Aug 1 16:10:34 [Balancer] Refreshing MaxChunkSize: 50 m30998| Wed Aug 1 16:10:34 [Balancer] skipping balancing round because balancing is disabled m30001| Wed Aug 1 16:10:34 [FileAllocator] done allocating datafile /data/db/shard31/test.1, size: 128MB, took 3.167 secs m30001| Wed Aug 1 16:10:34 [conn4] command admin.$cmd command: { splitVector: "test.foo", keyPattern: { num: 1.0 }, min: { num: MinKey }, max: { num: MaxKey }, maxChunkSizeBytes: 1024, maxSplitPoints: 2, maxChunkObjects: 250000 } ntoreturn:1 reslen:53 2372ms m30999| Wed Aug 1 16:10:34 [conn1] chunk not full enough to trigger auto-split no split entry m30998| Wed Aug 1 16:10:34 [conn1] DBConfig unserialize: test { _id: "test", partitioned: true, primary: "shard0001" } m30998| Wed Aug 1 16:10:34 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 2 version: 1|0||50198d3837b68b99c028581f based on: (empty) m30998| Wed Aug 1 16:10:34 [conn1] creating new connection to:localhost:30000 m30998| Wed Aug 1 16:10:34 BackgroundJob starting: ConnectBG m30998| Wed Aug 1 16:10:34 [conn1] connected connection! m30000| Wed Aug 1 16:10:34 [initandlisten] connection accepted from 127.0.0.1:42807 #14 m30998| Wed Aug 1 16:10:34 [conn1] creating WriteBackListener for: localhost:30000 serverID: 50198d3413c9681140515230 m30998| Wed Aug 1 16:10:34 [conn1] initializing shard connection to localhost:30000 m30998| Wed Aug 1 16:10:34 BackgroundJob starting: WriteBackListener-localhost:30000 m30998| Wed Aug 1 16:10:34 [conn1] resetting shard version of test.foo on localhost:30000, version is zero m30998| Wed Aug 1 16:10:34 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 0|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3413c9681140515230'), shard: "shard0000", shardHost: "localhost:30000" } 0x13c01f0 m30998| Wed Aug 1 16:10:34 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, ok: 1.0 } m30998| Wed Aug 1 16:10:34 [conn1] creating new connection to:localhost:30001 m30998| Wed Aug 1 16:10:34 BackgroundJob starting: ConnectBG m30001| Wed Aug 1 16:10:34 [initandlisten] connection accepted from 127.0.0.1:53229 #5 m30998| Wed Aug 1 16:10:34 [conn1] connected connection! m30998| Wed Aug 1 16:10:34 [conn1] creating WriteBackListener for: localhost:30001 serverID: 50198d3413c9681140515230 m30998| Wed Aug 1 16:10:34 [conn1] initializing shard connection to localhost:30001 m30998| Wed Aug 1 16:10:34 BackgroundJob starting: WriteBackListener-localhost:30001 m30998| Wed Aug 1 16:10:34 [WriteBackListener-localhost:30001] creating new connection to:localhost:30001 m30998| Wed Aug 1 16:10:34 [conn1] setShardVersion shard0001 localhost:30001 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 1000|0, versionEpoch: ObjectId('50198d3837b68b99c028581f'), serverID: ObjectId('50198d3413c9681140515230'), shard: "shard0001", shardHost: "localhost:30001" } 0x7f2d78009d00 m30998| Wed Aug 1 16:10:34 BackgroundJob starting: ConnectBG m30998| Wed Aug 1 16:10:34 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, ok: 1.0 } m30001| Wed Aug 1 16:10:34 [initandlisten] connection accepted from 127.0.0.1:53230 #6 m30998| Wed Aug 1 16:10:34 [WriteBackListener-localhost:30001] connected connection! m30999| Wed Aug 1 16:10:34 [conn1] splitting: test.foo shard: ns:test.foo at: shard0001:localhost:30001 lastmod: 1|0||000000000000000000000000 min: { num: MinKey } max: { num: MaxKey } m30000| Wed Aug 1 16:10:34 [initandlisten] connection accepted from 127.0.0.1:42810 #15 m30001| Wed Aug 1 16:10:34 [conn4] received splitChunk request: { splitChunk: "test.foo", keyPattern: { num: 1.0 }, min: { num: MinKey }, max: { num: MaxKey }, from: "shard0001", splitKeys: [ { num: 2.0 } ], shardId: "test.foo-num_MinKey", configdb: "localhost:30000" } m30001| Wed Aug 1 16:10:34 [conn4] created new distributed lock for test.foo on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30001| Wed Aug 1 16:10:34 [LockPinger] creating distributed lock ping thread for localhost:30000 and process ubuntu:30001:1343851834:1283441877 (sleeping for 30000ms) m30001| Wed Aug 1 16:10:34 [conn4] distributed lock 'test.foo/ubuntu:30001:1343851834:1283441877' acquired, ts : 50198d3a2d802155e45e6d0a m30001| Wed Aug 1 16:10:34 [conn4] splitChunk accepted at version 1|0 m30001| Wed Aug 1 16:10:34 [conn4] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:34-0", server: "ubuntu", clientAddr: "127.0.0.1:53226", time: new Date(1343851834641), what: "split", ns: "test.foo", details: { before: { min: { num: MinKey }, max: { num: MaxKey }, lastmod: Timestamp 1000|0 }, left: { min: { num: MinKey }, max: { num: 2.0 }, lastmod: Timestamp 1000|1 }, right: { min: { num: 2.0 }, max: { num: MaxKey }, lastmod: Timestamp 1000|2 } } } m30001| Wed Aug 1 16:10:34 [conn4] distributed lock 'test.foo/ubuntu:30001:1343851834:1283441877' unlocked. m30999| Wed Aug 1 16:10:34 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 3 version: 1|2||000000000000000000000000 based on: 1|0||50198d3837b68b99c028581f m30999| Wed Aug 1 16:10:34 [conn1] CMD: movechunk: { movechunk: "test.foo", find: { num: 3.0 }, to: "localhost:30000" } m30999| Wed Aug 1 16:10:34 [conn1] moving chunk ns: test.foo moving ( ns:test.foo at: shard0001:localhost:30001 lastmod: 1|2||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey }) shard0001:localhost:30001 -> shard0000:localhost:30000 m30001| Wed Aug 1 16:10:34 [conn4] received moveChunk request: { moveChunk: "test.foo", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { num: 2.0 }, max: { num: MaxKey }, maxChunkSizeBytes: 52428800, shardId: "test.foo-num_2.0", configdb: "localhost:30000", secondaryThrottle: false } m30001| Wed Aug 1 16:10:34 [conn4] created new distributed lock for test.foo on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30001| Wed Aug 1 16:10:34 [conn4] distributed lock 'test.foo/ubuntu:30001:1343851834:1283441877' acquired, ts : 50198d3a2d802155e45e6d0b m30001| Wed Aug 1 16:10:34 [conn4] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:34-1", server: "ubuntu", clientAddr: "127.0.0.1:53226", time: new Date(1343851834644), what: "moveChunk.start", ns: "test.foo", details: { min: { num: 2.0 }, max: { num: MaxKey }, from: "shard0001", to: "shard0000" } } m30001| Wed Aug 1 16:10:34 [conn4] moveChunk request accepted at version 1|2 m30001| Wed Aug 1 16:10:34 [conn4] moveChunk number of documents: 2 m30001| Wed Aug 1 16:10:34 [initandlisten] connection accepted from 127.0.0.1:53232 #7 m30000| Wed Aug 1 16:10:34 [FileAllocator] allocating new datafile /data/db/shard30/test.ns, filling with zeroes... m30000| Wed Aug 1 16:10:34 [FileAllocator] done allocating datafile /data/db/shard30/test.ns, size: 16MB, took 0.339 secs m30000| Wed Aug 1 16:10:34 [FileAllocator] allocating new datafile /data/db/shard30/test.0, filling with zeroes... m30001| Wed Aug 1 16:10:35 [conn4] moveChunk data transfer progress: { active: true, ns: "test.foo", from: "localhost:30001", min: { num: 2.0 }, max: { num: MaxKey }, state: "ready", counts: { cloned: 0, clonedBytes: 0, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30000| Wed Aug 1 16:10:35 [FileAllocator] done allocating datafile /data/db/shard30/test.0, size: 64MB, took 0.67 secs m30000| Wed Aug 1 16:10:35 [FileAllocator] allocating new datafile /data/db/shard30/test.1, filling with zeroes... m30000| Wed Aug 1 16:10:35 [migrateThread] build index test.foo { _id: 1 } m30000| Wed Aug 1 16:10:35 [migrateThread] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:35 [migrateThread] info: creating collection test.foo on add index m30000| Wed Aug 1 16:10:35 [migrateThread] build index test.foo { num: 1.0 } m30000| Wed Aug 1 16:10:35 [migrateThread] build index done 0 records 0 secs m30000| Wed Aug 1 16:10:36 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.foo' { num: 2.0 } -> { num: MaxKey } m30001| Wed Aug 1 16:10:36 [conn4] moveChunk data transfer progress: { active: true, ns: "test.foo", from: "localhost:30001", min: { num: 2.0 }, max: { num: MaxKey }, state: "catchup", counts: { cloned: 2, clonedBytes: 70, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| Wed Aug 1 16:10:37 [conn4] moveChunk data transfer progress: { active: true, ns: "test.foo", from: "localhost:30001", min: { num: 2.0 }, max: { num: MaxKey }, state: "catchup", counts: { cloned: 2, clonedBytes: 70, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30000| Wed Aug 1 16:10:37 [FileAllocator] done allocating datafile /data/db/shard30/test.1, size: 128MB, took 2.22 secs m30000| Wed Aug 1 16:10:37 [migrateThread] migrate commit flushed to journal for 'test.foo' { num: 2.0 } -> { num: MaxKey } m30001| Wed Aug 1 16:10:38 [conn4] moveChunk data transfer progress: { active: true, ns: "test.foo", from: "localhost:30001", min: { num: 2.0 }, max: { num: MaxKey }, state: "steady", counts: { cloned: 2, clonedBytes: 70, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| Wed Aug 1 16:10:38 [conn4] moveChunk setting version to: 2|0 m30000| Wed Aug 1 16:10:38 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.foo' { num: 2.0 } -> { num: MaxKey } m30000| Wed Aug 1 16:10:38 [migrateThread] migrate commit flushed to journal for 'test.foo' { num: 2.0 } -> { num: MaxKey } m30000| Wed Aug 1 16:10:38 [migrateThread] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:38-0", server: "ubuntu", clientAddr: "", time: new Date(1343851838655), what: "moveChunk.to", ns: "test.foo", details: { min: { num: 2.0 }, max: { num: MaxKey }, step1: 1016, step2: 0, step3: 834, step4: 0, step5: 2158 } } m30000| Wed Aug 1 16:10:38 [initandlisten] connection accepted from 127.0.0.1:42812 #16 m30001| Wed Aug 1 16:10:38 [conn4] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.foo", from: "localhost:30001", min: { num: 2.0 }, max: { num: MaxKey }, state: "done", counts: { cloned: 2, clonedBytes: 70, catchup: 0, steady: 0 }, ok: 1.0 } m30001| Wed Aug 1 16:10:38 [conn4] moveChunk updating self version to: 2|1 through { num: MinKey } -> { num: 2.0 } for collection 'test.foo' m30001| Wed Aug 1 16:10:38 [conn4] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:38-2", server: "ubuntu", clientAddr: "127.0.0.1:53226", time: new Date(1343851838657), what: "moveChunk.commit", ns: "test.foo", details: { min: { num: 2.0 }, max: { num: MaxKey }, from: "shard0001", to: "shard0000" } } m30001| Wed Aug 1 16:10:38 [conn4] doing delete inline m30001| Wed Aug 1 16:10:38 [conn4] moveChunk deleted: 2 m30001| Wed Aug 1 16:10:38 [conn4] distributed lock 'test.foo/ubuntu:30001:1343851834:1283441877' unlocked. m30001| Wed Aug 1 16:10:38 [conn4] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:38-3", server: "ubuntu", clientAddr: "127.0.0.1:53226", time: new Date(1343851838657), what: "moveChunk.from", ns: "test.foo", details: { min: { num: 2.0 }, max: { num: MaxKey }, step1: 0, step2: 1, step3: 0, step4: 4001, step5: 10, step6: 0 } } m30001| Wed Aug 1 16:10:38 [conn4] command admin.$cmd command: { moveChunk: "test.foo", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { num: 2.0 }, max: { num: MaxKey }, maxChunkSizeBytes: 52428800, shardId: "test.foo-num_2.0", configdb: "localhost:30000", secondaryThrottle: false } ntoreturn:1 reslen:37 4013ms m30999| Wed Aug 1 16:10:38 [conn1] moveChunk result: { ok: 1.0 } m30999| Wed Aug 1 16:10:38 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 4 version: 2|1||000000000000000000000000 based on: 1|2||000000000000000000000000 m30999| Wed Aug 1 16:10:38 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3337b68b99c028581d'), shard: "shard0000", shardHost: "localhost:30000" } 0xd54100 m30999| Wed Aug 1 16:10:38 [conn1] setShardVersion failed! m30999| { oldVersion: Timestamp 0|0, ns: "test.foo", need_authoritative: true, errmsg: "first time for collection 'test.foo'", ok: 0.0 } m30999| Wed Aug 1 16:10:38 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3337b68b99c028581d'), authoritative: true, shard: "shard0000", shardHost: "localhost:30000" } 0xd54100 m30999| Wed Aug 1 16:10:38 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, ok: 1.0 } m30999| Wed Aug 1 16:10:38 [conn1] setShardVersion shard0001 localhost:30001 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 2000|1, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3337b68b99c028581d'), shard: "shard0001", shardHost: "localhost:30001" } 0x7f6d18001060 m30999| Wed Aug 1 16:10:38 [conn1] setShardVersion success: { oldVersion: Timestamp 1000|0, ok: 1.0 } m30998| Wed Aug 1 16:10:38 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:38 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:38 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:38 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:38 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 3 version: 2|1||000000000000000000000000 based on: 1|0||50198d3837b68b99c028581f m30998| Wed Aug 1 16:10:38 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 2000|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3413c9681140515230'), shard: "shard0000", shardHost: "localhost:30000" } 0x13c01f0 m30998| Wed Aug 1 16:10:38 [conn1] setShardVersion success: { oldVersion: Timestamp 0|0, ok: 1.0 } m30998| Wed Aug 1 16:10:38 [conn1] setShardVersion shard0001 localhost:30001 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 2000|1, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3413c9681140515230'), shard: "shard0001", shardHost: "localhost:30001" } 0x7f2d78009d00 m30998| Wed Aug 1 16:10:38 [conn1] setShardVersion success: { oldVersion: Timestamp 1000|0, ok: 1.0 } { "enabled" : true, "configServer" : "localhost:30000", "shardName" : "shard0001", "shardHost" : "localhost:30001", "versions" : { "test.foo" : Timestamp(2000, 1) }, "ok" : 1 } null MOVE ALL TO 1 m30999| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0001:localhost:30001 lastmod: 2|1||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30999| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } m30998| Wed Aug 1 16:10:38 [conn1] DBConfig unserialize: admin { _id: "admin", partitioned: false, primary: "config" } m30998| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0001:localhost:30001 lastmod: 2|1||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30998| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } ShardingTest sharding collection info: test.foo mongod connection to localhost:30000 { "configServer" : "localhost:30000", "global" : Timestamp(2000, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongod connection to localhost:30001 { "configServer" : "localhost:30000", "global" : Timestamp(2000, 1), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongos connection to localhost:30999 { "version" : Timestamp(2000, 1), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } mongos connection to localhost:30998 { "version" : Timestamp(2000, 1), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } test.foo-num_MinKey 2000|1 { "num" : { $minKey : 1 } } -> { "num" : 2 } shard0001 test.foo test.foo-num_2.0 2000|0 { "num" : 2 } -> { "num" : { $maxKey : 1 } } shard0000 test.foo GOING TO MOVE m30999| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0001:localhost:30001 lastmod: 2|1||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30999| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } m30998| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0001:localhost:30001 lastmod: 2|1||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30998| Wed Aug 1 16:10:38 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } ShardingTest sharding collection info: test.foo mongod connection to localhost:30000 { "configServer" : "localhost:30000", "global" : Timestamp(2000, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongod connection to localhost:30001 { "configServer" : "localhost:30000", "global" : Timestamp(2000, 1), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongos connection to localhost:30999 { "version" : Timestamp(2000, 1), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } mongos connection to localhost:30998 { "version" : Timestamp(2000, 1), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } test.foo-num_MinKey 2000|1 { "num" : { $minKey : 1 } } -> { "num" : 2 } shard0001 test.foo test.foo-num_2.0 2000|0 { "num" : 2 } -> { "num" : { $maxKey : 1 } } shard0000 test.foo counts before move: { "0" : 3, "1" : 1 } m30999| Wed Aug 1 16:10:38 [conn1] CMD: movechunk: { movechunk: "test.foo", find: { num: 1.0 }, to: "localhost:30000" } m30999| Wed Aug 1 16:10:38 [conn1] moving chunk ns: test.foo moving ( ns:test.foo at: shard0001:localhost:30001 lastmod: 2|1||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 }) shard0001:localhost:30001 -> shard0000:localhost:30000 m30001| Wed Aug 1 16:10:38 [conn4] received moveChunk request: { moveChunk: "test.foo", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { num: MinKey }, max: { num: 2.0 }, maxChunkSizeBytes: 52428800, shardId: "test.foo-num_MinKey", configdb: "localhost:30000", secondaryThrottle: false } m30001| Wed Aug 1 16:10:38 [conn4] created new distributed lock for test.foo on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30001| Wed Aug 1 16:10:38 [conn4] distributed lock 'test.foo/ubuntu:30001:1343851834:1283441877' acquired, ts : 50198d3e2d802155e45e6d0c m30001| Wed Aug 1 16:10:38 [conn4] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:38-4", server: "ubuntu", clientAddr: "127.0.0.1:53226", time: new Date(1343851838681), what: "moveChunk.start", ns: "test.foo", details: { min: { num: MinKey }, max: { num: 2.0 }, from: "shard0001", to: "shard0000" } } m30001| Wed Aug 1 16:10:38 [conn4] moveChunk request accepted at version 2|1 m30001| Wed Aug 1 16:10:38 [conn4] moveChunk number of documents: 1 m30000| Wed Aug 1 16:10:38 [migrateThread] warning: moveChunkCmd deleted data already in chunk # objects: 1 m30000| Wed Aug 1 16:10:38 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.foo' { num: MinKey } -> { num: 2.0 } m30000| Wed Aug 1 16:10:38 [migrateThread] migrate commit flushed to journal for 'test.foo' { num: MinKey } -> { num: 2.0 } m30001| Wed Aug 1 16:10:39 [conn4] moveChunk data transfer progress: { active: true, ns: "test.foo", from: "localhost:30001", min: { num: MinKey }, max: { num: 2.0 }, state: "steady", counts: { cloned: 1, clonedBytes: 35, catchup: 0, steady: 0 }, ok: 1.0 } my mem used: 0 m30001| Wed Aug 1 16:10:39 [conn4] moveChunk setting version to: 3|0 m30000| Wed Aug 1 16:10:39 [migrateThread] migrate commit succeeded flushing to secondaries for 'test.foo' { num: MinKey } -> { num: 2.0 } m30000| Wed Aug 1 16:10:39 [migrateThread] migrate commit flushed to journal for 'test.foo' { num: MinKey } -> { num: 2.0 } m30000| Wed Aug 1 16:10:39 [migrateThread] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:39-1", server: "ubuntu", clientAddr: "", time: new Date(1343851839691), what: "moveChunk.to", ns: "test.foo", details: { min: { num: MinKey }, max: { num: 2.0 }, step1: 0, step2: 0, step3: 0, step4: 0, step5: 1007 } } m30001| Wed Aug 1 16:10:39 [conn4] moveChunk migrate commit accepted by TO-shard: { active: false, ns: "test.foo", from: "localhost:30001", min: { num: MinKey }, max: { num: 2.0 }, state: "done", counts: { cloned: 1, clonedBytes: 35, catchup: 0, steady: 0 }, ok: 1.0 } m30001| Wed Aug 1 16:10:39 [conn4] moveChunk moved last chunk out for collection 'test.foo' m30001| Wed Aug 1 16:10:39 [conn4] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:39-5", server: "ubuntu", clientAddr: "127.0.0.1:53226", time: new Date(1343851839691), what: "moveChunk.commit", ns: "test.foo", details: { min: { num: MinKey }, max: { num: 2.0 }, from: "shard0001", to: "shard0000" } } m30001| Wed Aug 1 16:10:39 [conn4] doing delete inline m30001| Wed Aug 1 16:10:39 [conn4] moveChunk deleted: 1 m30001| Wed Aug 1 16:10:39 [conn4] distributed lock 'test.foo/ubuntu:30001:1343851834:1283441877' unlocked. m30001| Wed Aug 1 16:10:39 [conn4] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:39-6", server: "ubuntu", clientAddr: "127.0.0.1:53226", time: new Date(1343851839692), what: "moveChunk.from", ns: "test.foo", details: { min: { num: MinKey }, max: { num: 2.0 }, step1: 0, step2: 1, step3: 0, step4: 1000, step5: 9, step6: 0 } } m30001| Wed Aug 1 16:10:39 [conn4] command admin.$cmd command: { moveChunk: "test.foo", from: "localhost:30001", to: "localhost:30000", fromShard: "shard0001", toShard: "shard0000", min: { num: MinKey }, max: { num: 2.0 }, maxChunkSizeBytes: 52428800, shardId: "test.foo-num_MinKey", configdb: "localhost:30000", secondaryThrottle: false } ntoreturn:1 reslen:37 1011ms m30999| Wed Aug 1 16:10:39 [conn1] moveChunk result: { ok: 1.0 } m30999| Wed Aug 1 16:10:39 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 5 version: 3|0||000000000000000000000000 based on: 2|1||000000000000000000000000 counts after move: { "0" : 3, "1" : 0 } m30999| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 3|0||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30999| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } m30998| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0001:localhost:30001 lastmod: 2|1||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30998| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } ShardingTest sharding collection info: test.foo mongod connection to localhost:30000 { "configServer" : "localhost:30000", "global" : Timestamp(2000, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongod connection to localhost:30001 { "configServer" : "localhost:30000", "global" : Timestamp(0, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongos connection to localhost:30999 { "version" : Timestamp(3000, 0), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } mongos connection to localhost:30998 { "version" : Timestamp(2000, 1), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } test.foo-num_MinKey 3000|0 { "num" : { $minKey : 1 } } -> { "num" : 2 } shard0000 test.foo test.foo-num_2.0 2000|0 { "num" : 2 } -> { "num" : { $maxKey : 1 } } shard0000 test.foo m30999| Wed Aug 1 16:10:39 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 3000|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3337b68b99c028581d'), shard: "shard0000", shardHost: "localhost:30000" } 0xd54100 m30999| Wed Aug 1 16:10:39 [conn1] setShardVersion success: { oldVersion: Timestamp 2000|0, ok: 1.0 } m30998| Wed Aug 1 16:10:39 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:39 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:39 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:39 [conn1] warning: can't load version from element type (0) EOO m30998| Wed Aug 1 16:10:39 [conn1] ChunkManager: time to load chunks for test.foo: 0ms sequenceNumber: 4 version: 3|0||000000000000000000000000 based on: 2|1||000000000000000000000000 m30998| Wed Aug 1 16:10:39 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 3000|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3413c9681140515230'), shard: "shard0000", shardHost: "localhost:30000" } 0x13c01f0 m30998| Wed Aug 1 16:10:39 [conn1] setShardVersion success: { oldVersion: Timestamp 2000|0, ok: 1.0 } m30998| Wed Aug 1 16:10:39 [conn1] PCursor erasing empty state { state: {}, retryNext: false, init: false, finish: false, errored: false } *** drop m30999| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 3|0||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30999| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } m30998| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 3|0||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30998| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } ShardingTest before drop sharding collection info: test.foo mongod connection to localhost:30000 { "configServer" : "localhost:30000", "global" : Timestamp(3000, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongod connection to localhost:30001 { "configServer" : "localhost:30000", "global" : Timestamp(0, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongos connection to localhost:30999 { "version" : Timestamp(3000, 0), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } mongos connection to localhost:30998 { "version" : Timestamp(3000, 0), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } test.foo-num_MinKey 3000|0 { "num" : { $minKey : 1 } } -> { "num" : 2 } shard0000 test.foo test.foo-num_2.0 2000|0 { "num" : 2 } -> { "num" : { $maxKey : 1 } } shard0000 test.foo m30999| Wed Aug 1 16:10:39 [conn1] DROP: test.foo m30999| Wed Aug 1 16:10:39 [conn1] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:39-0", server: "ubuntu", clientAddr: "N/A", time: new Date(1343851839704), what: "dropCollection.start", ns: "test.foo", details: {} } m30999| Wed Aug 1 16:10:39 [conn1] created new distributed lock for test.foo on localhost:30000 ( lock timeout : 900000, ping interval : 30000, process : 0 ) m30999| Wed Aug 1 16:10:39 [conn1] about to acquire distributed lock 'test.foo/ubuntu:30999:1343851827:1804289383: m30999| { "state" : 1, m30999| "who" : "ubuntu:30999:1343851827:1804289383:conn1:1967513926", m30999| "process" : "ubuntu:30999:1343851827:1804289383", m30999| "when" : { "$date" : "Wed Aug 1 16:10:39 2012" }, m30999| "why" : "drop", m30999| "ts" : { "$oid" : "50198d3f37b68b99c0285820" } } m30999| { "_id" : "test.foo", m30999| "state" : 0, m30999| "ts" : { "$oid" : "50198d3e2d802155e45e6d0c" } } m30999| Wed Aug 1 16:10:39 [conn1] distributed lock 'test.foo/ubuntu:30999:1343851827:1804289383' acquired, ts : 50198d3f37b68b99c0285820 m30999| Wed Aug 1 16:10:39 [conn1] ChunkManager::drop : test.foo m30999| Wed Aug 1 16:10:39 [conn1] ChunkManager::drop : test.foo all locked m30000| Wed Aug 1 16:10:39 [conn13] CMD: drop test.foo m30999| Wed Aug 1 16:10:39 [conn1] ChunkManager::drop : test.foo removed shard data m30999| Wed Aug 1 16:10:39 [conn1] ChunkManager::drop : test.foo removed chunk data m30999| Wed Aug 1 16:10:39 [conn1] setShardVersion shard0000 localhost:30000 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 0|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3337b68b99c028581d'), authoritative: true, shard: "shard0000", shardHost: "localhost:30000" } 0x7f6d18009150 m30000| Wed Aug 1 16:10:39 [conn13] wiping data for: test.foo m30999| Wed Aug 1 16:10:39 [conn1] ChunkManager::drop : test.foo DONE m30999| Wed Aug 1 16:10:39 [conn1] about to log metadata event: { _id: "ubuntu-2012-08-01T20:10:39-1", server: "ubuntu", clientAddr: "N/A", time: new Date(1343851839708), what: "dropCollection", ns: "test.foo", details: {} } m30999| Wed Aug 1 16:10:39 [conn1] distributed lock 'test.foo/ubuntu:30999:1343851827:1804289383' unlocked. m30998| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 3|0||000000000000000000000000 min: { num: MinKey } max: { num: 2.0 } m30998| Wed Aug 1 16:10:39 [conn1] ns:test.foo at: shard0000:localhost:30000 lastmod: 2|0||000000000000000000000000 min: { num: 2.0 } max: { num: MaxKey } ShardingTest after drop sharding collection info: test.foo mongod connection to localhost:30000 { "configServer" : "localhost:30000", "global" : Timestamp(0, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongod connection to localhost:30001 { "configServer" : "localhost:30000", "global" : Timestamp(0, 0), "inShardedMode" : false, "mine" : Timestamp(0, 0), "ok" : 1 } mongos connection to localhost:30999 { "ok" : 0, "errmsg" : "ns not sharded." } mongos connection to localhost:30998 { "version" : Timestamp(3000, 0), "versionEpoch" : ObjectId("000000000000000000000000"), "ok" : 1 } m30999| Wed Aug 1 16:10:39 [conn1] resetting shard version of test.foo on localhost:30001, no longer sharded m30999| Wed Aug 1 16:10:39 [conn1] setShardVersion shard0001 localhost:30001 test.foo { setShardVersion: "test.foo", configdb: "localhost:30000", version: Timestamp 0|0, versionEpoch: ObjectId('000000000000000000000000'), serverID: ObjectId('50198d3337b68b99c028581d'), shard: "shard0001", shardHost: "localhost:30001" } 0x7f6d18001060 m30999| Wed Aug 1 16:10:39 [conn1] setShardVersion success: { oldVersion: Timestamp 2000|1, ok: 1.0 } m30000| Wed Aug 1 16:10:39 [conn14] Assertion: 13388:[test.foo] shard version not ok in Client::Context: collection was dropped or this shard no longer valid version: 0|0 clientVersion: 3|0 count failed: { "shards" : { }, "cause" : { "errmsg" : "exception: [test.foo] shard version not ok in Client::Context: collection was dropped or this shard no longer valid version: 0|0 clientVersion: 3|0", "code" : 13388, "ok" : 0 }, "ok" : 0, "errmsg" : "failed on : shard0000" } Wed Aug 1 16:10:39 Error: error loading js file: jstests/sharding/shard3.js /home/greg/Workspaces/Mongo Workspace/mongo/jstests/multiVersion/6_cluster_multi_version_passthrough.js:110 failed to load: /home/greg/Workspaces/Mongo Workspace/mongo/jstests/multiVersion/6_cluster_multi_version_passthrough.js m30000| Wed Aug 1 16:10:39 got kill or ctrl c or hup signal 15 (Terminated), will terminate after current cmd ends m30000| Wed Aug 1 16:10:39 [interruptThread] now exiting m30000| Wed Aug 1 16:10:39 dbexit: m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: going to close listening sockets... m30000| Wed Aug 1 16:10:39 [interruptThread] closing listening socket: 12 m30000| Wed Aug 1 16:10:39 [interruptThread] closing listening socket: 13 m30000| Wed Aug 1 16:10:39 [interruptThread] closing listening socket: 14 m30000| Wed Aug 1 16:10:39 [interruptThread] removing socket file: /tmp/mongodb-30000.sock m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: going to flush diaglog... m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: going to close sockets... m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: waiting for fs preallocator... m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: lock for final commit... m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: final commit... m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] SocketException: remote: 127.0.0.1:30000 error: 9001 socket exception [0] server [127.0.0.1:30000] m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] DBClientCursor::init call() failed m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] User Assertion: 10276:DBClientBase::findN: transport error: localhost:30000 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3413c9681140515230') } m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] SocketException: remote: 127.0.0.1:30000 error: 9001 socket exception [0] server [127.0.0.1:30000] m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] DBClientCursor::init call() failed m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] User Assertion: 10276:DBClientBase::findN: transport error: localhost:30000 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3337b68b99c028581d') } m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] WriteBackListener exception : DBClientBase::findN: transport error: localhost:30000 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3413c9681140515230') } m30001| Wed Aug 1 16:10:39 [conn7] end connection 127.0.0.1:53232 m30000| Wed Aug 1 16:10:39 [conn16] end connection 127.0.0.1:42812 m30000| Wed Aug 1 16:10:39 [conn10] end connection 127.0.0.1:42798 m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] Socket recv() errno:104 Connection reset by peer 127.0.0.1:30000 m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] SocketException: remote: 127.0.0.1:30000 error: 9001 socket exception [1] server [127.0.0.1:30000] m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] DBClientCursor::init call() failed m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] Assertion: 13632:couldn't get updated shard list from config server m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] WriteBackListener exception : DBClientBase::findN: transport error: localhost:30000 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3337b68b99c028581d') } m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] Socket recv() errno:104 Connection reset by peer 127.0.0.1:30000 m30000| Wed Aug 1 16:10:39 [conn13] end connection 127.0.0.1:42806 m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] SocketException: remote: 127.0.0.1:30000 error: 9001 socket exception [1] server [127.0.0.1:30000] m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] DBClientCursor::init call() failed m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] Assertion: 13632:couldn't get updated shard list from config server m30998| 0x64c316 0x541458 0x852088 0x7927ee 0x66e0a6 0x66f759 0x826b0c 0x7f2d81242971 0x7f2d805f6f3d m30999| 0x64c316 0x541458 0x852088 0x7927ee 0x66e0a6 0x66f759 0x826b0c 0x7f6d1fb32971 0x7f6d1eee6f3d m30998| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0x64c316] m30998| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo11msgassertedEiPKc+0x98) [0x541458] m30998| /home/greg/Workspaces/Mongo Workspace/mongo/mongos() [0x852088] m30998| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo17WriteBackListener3runEv+0x2f1e) [0x7927ee] m30998| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo13BackgroundJob7jobBodyEN5boost10shared_ptrINS0_9JobStatusEEE+0xc6) [0x66e0a6] m30998| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5boost6detail11thread_dataINS_3_bi6bind_tIvNS_4_mfi3mf1IvN5mongo13BackgroundJobENS_10shared_ptrINS7_9JobStatusEEEEENS2_5list2INS2_5valueIPS7_EENSD_ISA_EEEEEEE3runEv+0x79) [0x66f759] m30998| /home/greg/Workspaces/Mongo Workspace/mongo/mongos() [0x826b0c] m30998| /lib/libpthread.so.0(+0x7971) [0x7f2d81242971] m30998| /lib/libc.so.6(clone+0x6d) [0x7f2d805f6f3d] m30998| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] ERROR: backgroundjob WriteBackListener-localhost:30000error: couldn't get updated shard list from config server m30999| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0x64c316] m30999| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo11msgassertedEiPKc+0x98) [0x541458] m30999| /home/greg/Workspaces/Mongo Workspace/mongo/mongos() [0x852088] m30999| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo17WriteBackListener3runEv+0x2f1e) [0x7927ee] m30999| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5mongo13BackgroundJob7jobBodyEN5boost10shared_ptrINS0_9JobStatusEEE+0xc6) [0x66e0a6] m30999| /home/greg/Workspaces/Mongo Workspace/mongo/mongos(_ZN5boost6detail11thread_dataINS_3_bi6bind_tIvNS_4_mfi3mf1IvN5mongo13BackgroundJobENS_10shared_ptrINS7_9JobStatusEEEEENS2_5list2INS2_5valueIPS7_EENSD_ISA_EEEEEEE3runEv+0x79) [0x66f759] m30999| /home/greg/Workspaces/Mongo Workspace/mongo/mongos() [0x826b0c] m30999| /lib/libpthread.so.0(+0x7971) [0x7f6d1fb32971] m30999| /lib/libc.so.6(clone+0x6d) [0x7f6d1eee6f3d] m30999| Wed Aug 1 16:10:39 [WriteBackListener-localhost:30000] ERROR: backgroundjob WriteBackListener-localhost:30000error: couldn't get updated shard list from config server m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: closing all files... m30000| Wed Aug 1 16:10:39 [interruptThread] closeAllFiles() finished m30000| Wed Aug 1 16:10:39 [interruptThread] journalCleanup... m30000| Wed Aug 1 16:10:39 [interruptThread] removeJournalFiles m30000| Wed Aug 1 16:10:39 [interruptThread] shutdown: removing fs lock... m30000| Wed Aug 1 16:10:39 dbexit: really exiting now m30999| Wed Aug 1 16:10:39 [Balancer] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:39 BackgroundJob starting: ConnectBG m30999| Wed Aug 1 16:10:39 [Balancer] scoped connection to localhost:30000 not being returned to the pool m30999| Wed Aug 1 16:10:39 [Balancer] caught exception while doing balance: socket exception m30999| Wed Aug 1 16:10:39 [Balancer] *** End of balancing round m30998| Wed Aug 1 16:10:40 [Balancer] creating new connection to:localhost:30000 m30998| Wed Aug 1 16:10:40 BackgroundJob starting: ConnectBG m30998| Wed Aug 1 16:10:40 [Balancer] caught exception while doing balance: socket exception m30998| Wed Aug 1 16:10:40 [Balancer] *** End of balancing round m30001| Wed Aug 1 16:10:40 got kill or ctrl c or hup signal 15 (Terminated), will terminate after current cmd ends m30001| Wed Aug 1 16:10:40 [interruptThread] now exiting m30001| Wed Aug 1 16:10:40 dbexit: m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: going to close listening sockets... m30001| Wed Aug 1 16:10:40 [interruptThread] closing listening socket: 15 m30001| Wed Aug 1 16:10:40 [interruptThread] closing listening socket: 16 m30001| Wed Aug 1 16:10:40 [interruptThread] closing listening socket: 17 m30001| Wed Aug 1 16:10:40 [interruptThread] removing socket file: /tmp/mongodb-30001.sock m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: going to flush diaglog... m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: going to close sockets... m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: waiting for fs preallocator... m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: lock for final commit... m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: final commit... m30999| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] SocketException: remote: 127.0.0.1:30001 error: 9001 socket exception [0] server [127.0.0.1:30001] m30998| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] SocketException: remote: 127.0.0.1:30001 error: 9001 socket exception [0] server [127.0.0.1:30001] m30998| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] DBClientCursor::init call() failed m30998| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] User Assertion: 10276:DBClientBase::findN: transport error: localhost:30001 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3413c9681140515230') } m30999| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] DBClientCursor::init call() failed m30999| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] User Assertion: 10276:DBClientBase::findN: transport error: localhost:30001 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3337b68b99c028581d') } m30998| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] WriteBackListener exception : DBClientBase::findN: transport error: localhost:30001 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3413c9681140515230') } m30998| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] creating new connection to:localhost:30000 m30999| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] WriteBackListener exception : DBClientBase::findN: transport error: localhost:30001 ns: admin.$cmd query: { writebacklisten: ObjectId('50198d3337b68b99c028581d') } m30999| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] creating new connection to:localhost:30000 m30998| Wed Aug 1 16:10:40 BackgroundJob starting: ConnectBG m30999| Wed Aug 1 16:10:40 BackgroundJob starting: ConnectBG m30998| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] ERROR: backgroundjob WriteBackListener-localhost:30001error: socket exception m30999| Wed Aug 1 16:10:40 [WriteBackListener-localhost:30001] ERROR: backgroundjob WriteBackListener-localhost:30001error: socket exception m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: closing all files... m30001| Wed Aug 1 16:10:40 [interruptThread] closeAllFiles() finished m30001| Wed Aug 1 16:10:40 [interruptThread] journalCleanup... m30001| Wed Aug 1 16:10:40 [interruptThread] removeJournalFiles m30001| Wed Aug 1 16:10:40 [interruptThread] shutdown: removing fs lock... m30001| Wed Aug 1 16:10:40 dbexit: really exiting now m30998| Wed Aug 1 16:10:41 [mongosMain] dbexit: received signal 15 rc:0 received signal 15 m30999| Wed Aug 1 16:10:42 [mongosMain] dbexit: received signal 15 rc:0 received signal 15 Wed Aug 1 16:10:43 [conn2] end connection 127.0.0.1:43579 (0 connections now open) 17678.225994ms test /home/greg/Workspaces/Mongo Workspace/mongo/jstests/multiVersion/6_cluster_multi_version_passthrough.js exited with status 253 Wed Aug 1 16:10:43 got signal 15 (Terminated), will terminate after current cmd ends Wed Aug 1 16:10:43 [interruptThread] now exiting Wed Aug 1 16:10:43 dbexit: Wed Aug 1 16:10:43 [interruptThread] shutdown: going to close listening sockets... Wed Aug 1 16:10:43 [interruptThread] closing listening socket: 6 Wed Aug 1 16:10:43 [interruptThread] closing listening socket: 7 Wed Aug 1 16:10:43 [interruptThread] closing listening socket: 8 Wed Aug 1 16:10:43 [interruptThread] removing socket file: /tmp/mongodb-27999.sock Wed Aug 1 16:10:43 [interruptThread] shutdown: going to flush diaglog... Wed Aug 1 16:10:43 [interruptThread] shutdown: going to close sockets... Wed Aug 1 16:10:43 [interruptThread] shutdown: waiting for fs preallocator... Wed Aug 1 16:10:43 [interruptThread] shutdown: lock for final commit... Wed Aug 1 16:10:43 [interruptThread] shutdown: final commit... Wed Aug 1 16:10:43 [interruptThread] shutdown: closing all files... Wed Aug 1 16:10:43 [interruptThread] closeAllFiles() finished Wed Aug 1 16:10:43 [interruptThread] journalCleanup... Wed Aug 1 16:10:43 [interruptThread] removeJournalFiles Wed Aug 1 16:10:43 [interruptThread] shutdown: removing fs lock... Wed Aug 1 16:10:43 dbexit: really exiting now 0 tests succeeded The following tests failed (with exit code): /home/greg/Workspaces/Mongo Workspace/mongo/jstests/multiVersion/6_cluster_multi_version_passthrough.js 253 Traceback (most recent call last): File "buildscripts/smoke.py", line 861, in main() File "buildscripts/smoke.py", line 857, in main report() File "buildscripts/smoke.py", line 546, in report raise Exception("Test failures") Exception: Test failures greg@ubuntu:~/Workspaces/Mongo Workspace/mongo$