2015-03-02T10:44:52.973-0500 I CONTROL [initandlisten] MongoDB starting : pid=1938 port=27017 dbpath=/root/wiredTiger 64-bit host=centos64vm 2015-03-02T10:44:52.973-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:44:52.973-0500 I CONTROL [initandlisten] 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T10:44:52.975-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T10:44:52.976-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "wiredTiger", engine: "wiredTiger" }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T10:44:52.976-0500 I STORAGE [initandlisten] exception in initAndListen: 10296 ********************************************************************* ERROR: dbpath (/root/wiredTiger) does not exist. Create this directory or give existing directory in --dbpath. See http://dochub.mongodb.org/core/startingandstoppingmongo ********************************************************************* , terminating 2015-03-02T10:44:52.976-0500 I CONTROL [initandlisten] dbexit: rc: 100 2015-03-02T10:45:22.683-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] MongoDB starting : pid=1947 port=27017 dbpath=/root/wiredTiger 64-bit host=centos64vm 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T10:45:22.689-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "wiredTiger", engine: "wiredTiger" }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T10:45:22.690-0500 I STORAGE [initandlisten] exception in initAndListen: 10296 ********************************************************************* ERROR: dbpath (/root/wiredTiger) does not exist. Create this directory or give existing directory in --dbpath. See http://dochub.mongodb.org/core/startingandstoppingmongo ********************************************************************* , terminating 2015-03-02T10:45:22.690-0500 I CONTROL [initandlisten] dbexit: rc: 100 2015-03-02T10:46:52.991-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] MongoDB starting : pid=1954 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T10:46:52.997-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T10:46:52.997-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T10:46:53.019-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T10:46:53.068-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T10:47:00.908-0500 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49591 #1 (1 connection now open) 2015-03-02T10:47:40.921-0500 I NETWORK [conn1] end connection 127.0.0.1:49591 (0 connections now open) 2015-03-02T10:47:44.687-0500 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2015-03-02T10:47:44.687-0500 I CONTROL [signalProcessingThread] now exiting 2015-03-02T10:47:44.687-0500 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2015-03-02T10:47:44.687-0500 I NETWORK [signalProcessingThread] closing listening socket: 6 2015-03-02T10:47:44.687-0500 I NETWORK [signalProcessingThread] closing listening socket: 7 2015-03-02T10:47:44.687-0500 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27017.sock 2015-03-02T10:47:44.687-0500 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2015-03-02T10:47:44.687-0500 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2015-03-02T10:47:44.687-0500 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2015-03-02T10:47:44.737-0500 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2015-03-02T10:47:44.738-0500 I CONTROL [signalProcessingThread] dbexit: rc: 0 2015-03-02T10:47:49.611-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] MongoDB starting : pid=1976 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T10:47:49.617-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, repair: true, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T10:47:49.617-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T10:47:49.636-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T10:47:49.658-0500 I STORAGE [initandlisten] Repairing size cache 2015-03-02T10:47:49.658-0500 I STORAGE [initandlisten] WiredTiger progress session.verify 2 2015-03-02T10:47:49.658-0500 I STORAGE [initandlisten] Verify succeeded on uri table:sizeStorer. Not salvaging. 2015-03-02T10:47:49.659-0500 I STORAGE [initandlisten] Repairing catalog metadata 2015-03-02T10:47:49.659-0500 I STORAGE [initandlisten] WiredTiger progress session.verify 2 2015-03-02T10:47:49.659-0500 I STORAGE [initandlisten] Verify succeeded on uri table:_mdb_catalog. Not salvaging. 2015-03-02T10:47:49.681-0500 I STORAGE [initandlisten] repairDatabase local 2015-03-02T10:47:49.681-0500 I STORAGE [initandlisten] Repairing collection local.startup_log 2015-03-02T10:47:49.681-0500 I STORAGE [initandlisten] WiredTiger progress session.verify 2 2015-03-02T10:47:49.681-0500 I STORAGE [initandlisten] Verify succeeded on uri table:collection-0--4913932331362297853. Not salvaging. 2015-03-02T10:47:49.683-0500 I INDEX [initandlisten] build index on: local.startup_log properties: { v: 1, key: { _id: 1 }, name: "_id_", ns: "local.startup_log" } 2015-03-02T10:47:49.683-0500 I INDEX [initandlisten] building index using bulk method 2015-03-02T10:47:49.685-0500 I STORAGE [initandlisten] finished checking dbs 2015-03-02T10:47:49.685-0500 I CONTROL [initandlisten] now exiting 2015-03-02T10:47:49.685-0500 I NETWORK [initandlisten] shutdown: going to close listening sockets... 2015-03-02T10:47:49.685-0500 I NETWORK [initandlisten] removing socket file: /tmp/mongodb-27017.sock 2015-03-02T10:47:49.685-0500 I NETWORK [initandlisten] shutdown: going to flush diaglog... 2015-03-02T10:47:49.685-0500 I NETWORK [initandlisten] shutdown: going to close sockets... 2015-03-02T10:47:49.685-0500 I STORAGE [initandlisten] WiredTigerKVEngine shutting down 2015-03-02T10:47:49.713-0500 I STORAGE [initandlisten] shutdown: removing fs lock... 2015-03-02T10:47:49.713-0500 I CONTROL [initandlisten] dbexit: rc: 0 2015-03-02T10:53:26.209-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] MongoDB starting : pid=2059 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:53:26.213-0500 I CONTROL [initandlisten] 2015-03-02T10:53:26.214-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T10:53:26.214-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T10:53:26.214-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T10:53:26.214-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T10:53:26.214-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T10:53:26.214-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T10:53:26.232-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T10:53:26.266-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T10:54:46.191-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T10:54:46.203-0500 I CONTROL [initandlisten] MongoDB starting : pid=1448 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T10:54:46.204-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T10:54:46.204-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T10:54:46.241-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T10:54:46.293-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T10:55:42.231-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] MongoDB starting : pid=1373 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T10:55:42.246-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T10:55:42.246-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T10:55:42.310-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T10:55:42.357-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T10:55:44.170-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58501 #1 (1 connection now open) 2015-03-02T10:55:44.184-0500 I INDEX [conn1] build index on: test.foo properties: { v: 1, key: { x: 1.0 }, name: "x_1", ns: "test.foo" } 2015-03-02T10:55:44.184-0500 I INDEX [conn1] building index using bulk method 2015-03-02T10:55:44.185-0500 I INDEX [conn1] build index done. scanned 0 total records. 0 secs 2015-03-02T10:55:44.197-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:44.197-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:44.198-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:44.201-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:44.202-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:44.202-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:44.205-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:44.205-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:44.205-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:44.208-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:44.208-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:44.208-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:44.210-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:44.211-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:44.211-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:44.212-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:44.213-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:44.213-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:50.143-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:50.363-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (9001 records 92467273 bytes) is inconsistent with full validation results (10000 records 102730000 bytes). Updating size storer with new values. 2015-03-02T10:55:50.363-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:50.364-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:50.366-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11442 locks:{} 222ms 2015-03-02T10:55:50.369-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:50.385-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:50.386-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:50.564-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7413.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5174 nscannedObjects:5174 nMatched:2587 nModified:2587 keyUpdates:1 writeConflicts:0 numYields:40 locks:{} 174ms 2015-03-02T10:55:50.564-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7413.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 174ms 2015-03-02T10:55:50.566-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:50.584-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (10000 records 102756013 bytes) is inconsistent with full validation results (10000 records 102763631 bytes). Updating size storer with new values. 2015-03-02T10:55:50.584-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:50.585-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:51.289-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T10:55:55.347-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:55.585-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (19414 records 199473653 bytes) is inconsistent with full validation results (20000 records 205493631 bytes). Updating size storer with new values. 2015-03-02T10:55:55.586-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:55.587-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:55.589-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11442 locks:{} 241ms 2015-03-02T10:55:56.246-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5716.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17136 nscannedObjects:17136 nMatched:8568 nModified:8568 keyUpdates:1 writeConflicts:0 numYields:134 locks:{} 655ms 2015-03-02T10:55:56.246-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5716.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 655ms 2015-03-02T10:55:56.248-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:56.296-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:56.299-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:56.308-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:56.357-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:56.359-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:57.004-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7783.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17136 nscannedObjects:17136 nMatched:8568 nModified:8568 keyUpdates:1 writeConflicts:0 numYields:134 locks:{} 641ms 2015-03-02T10:55:57.004-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7783.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 641ms 2015-03-02T10:55:57.005-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:57.047-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:57.050-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:57.061-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:57.107-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:57.110-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:55:57.115-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:55:57.165-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:55:57.168-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:56:02.170-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:56:02.479-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (29278 records 300884278 bytes) is inconsistent with full validation results (30000 records 308301384 bytes). Updating size storer with new values. 2015-03-02T10:56:02.479-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:56:02.485-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:56:02.489-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11442 locks:{} 319ms 2015-03-02T10:56:02.498-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:56:02.558-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:56:02.561-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:56:03.446-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5093.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29442 nscannedObjects:29442 nMatched:14721 nModified:14721 keyUpdates:1 writeConflicts:0 numYields:230 locks:{} 881ms 2015-03-02T10:56:03.446-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5093.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 881ms 2015-03-02T10:56:03.448-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:56:03.505-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:56:03.508-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:56:04.387-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5152.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29442 nscannedObjects:29442 nMatched:14721 nModified:14721 keyUpdates:1 writeConflicts:0 numYields:230 locks:{} 870ms 2015-03-02T10:56:04.387-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5152.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 870ms 2015-03-02T10:56:04.389-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:56:04.447-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:56:04.451-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:56:06.288-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58510 #2 (2 connections now open) 2015-03-02T10:56:06.811-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 5011.0 } } ndeleted:14967 keyUpdates:0 writeConflicts:0 numYields:116 locks:{} 513ms 2015-03-02T10:56:06.812-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5011.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 513ms 2015-03-02T10:56:06.818-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T10:56:06.967-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (19164 records 196873475 bytes) is inconsistent with full validation results (19033 records 195526009 bytes). Updating size storer with new values. 2015-03-02T10:56:06.968-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T10:56:06.976-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T10:56:06.980-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11442 locks:{} 161ms 2015-03-02T10:56:06.986-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T10:56:07.027-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T10:56:07.029-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T10:56:09.986-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:56:10.195-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (25902 records 266091246 bytes) is inconsistent with full validation results (26033 records 267437009 bytes). Updating size storer with new values. 2015-03-02T10:56:10.195-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T10:56:10.198-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T10:56:10.201-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11442 locks:{} 215ms 2015-03-02T10:56:14.900-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T10:56:16.627-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T10:56:48.023-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T10:56:48.034-0500 I CONTROL [initandlisten] MongoDB starting : pid=3363 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T10:56:48.034-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T10:56:48.034-0500 I CONTROL [initandlisten] 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] 2015-03-02T10:56:48.035-0500 I CONTROL [initandlisten] db version v3.2015-03-02T11:00:17.958-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:00:17.968-0500 I CONTROL [initandlisten] MongoDB starting : pid=2840 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:00:17.969-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:00:17.969-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:00:18.011-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:00:18.087-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:01:31.014-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] MongoDB starting : pid=2838 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:01:31.032-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:01:31.033-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:01:31.033-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:01:31.033-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:01:31.078-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:01:31.131-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:02:45.476-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] MongoDB starting : pid=2801 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:02:45.484-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:02:45.485-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:02:45.485-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:02:45.527-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:02:45.586-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:03:47.946-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:03:47.956-0500 I CONTROL [initandlisten] MongoDB starting : pid=2780 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:03:47.957-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:03:47.957-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:03:47.994-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:03:48.047-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:04:48.758-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:04:48.767-0500 I CONTROL [initandlisten] MongoDB starting : pid=2741 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:04:48.767-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:04:48.767-0500 I CONTROL [initandlisten] 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:04:48.768-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:04:48.768-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:04:48.807-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:04:48.863-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:05:05.738-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58628 #1 (1 connection now open) 2015-03-02T11:05:05.752-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:06.198-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:06.203-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:06.213-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 453ms 2015-03-02T11:05:07.800-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5291.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:57288 nscannedObjects:57288 nMatched:28644 nModified:28644 keyUpdates:1 writeConflicts:0 numYields:447 locks:{} 1583ms 2015-03-02T11:05:07.800-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5291.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1583ms 2015-03-02T11:05:07.803-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:07.899-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:07.904-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:07.910-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 106ms 2015-03-02T11:05:07.918-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:08.008-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:08.013-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:08.023-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:08.112-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:08.117-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:08.126-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:08.219-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:08.224-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:09.709-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9307.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:57288 nscannedObjects:57288 nMatched:28644 nModified:28644 keyUpdates:1 writeConflicts:0 numYields:447 locks:{} 1481ms 2015-03-02T11:05:09.709-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9307.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1481ms 2015-03-02T11:05:09.711-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:09.948-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:09.953-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:09.957-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 246ms 2015-03-02T11:05:10.662-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 8194.0 } } ndeleted:28644 keyUpdates:0 writeConflicts:0 numYields:223 locks:{} 702ms 2015-03-02T11:05:10.662-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8194.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 702ms 2015-03-02T11:05:10.664-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:10.724-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (17342 records 178166469 bytes) is inconsistent with full validation results (16411 records 168590203 bytes). Updating size storer with new values. 2015-03-02T11:05:10.724-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:10.730-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:10.737-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:10.765-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:10.768-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:10.772-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:10.801-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:10.803-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:10.807-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:10.838-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:10.840-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:10.847-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:10.879-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (16411 records 168590203 bytes) is inconsistent with full validation results (16412 records 168590249 bytes). Updating size storer with new values. 2015-03-02T11:05:10.879-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:10.881-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:16.706-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:16.815-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (25480 records 261745813 bytes) is inconsistent with full validation results (26412 records 271320249 bytes). Updating size storer with new values. 2015-03-02T11:05:16.815-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:16.818-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:16.820-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 113ms 2015-03-02T11:05:16.822-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:16.872-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:16.876-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:17.051-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4514.0 } } ndeleted:6264 keyUpdates:0 writeConflicts:0 numYields:48 locks:{} 171ms 2015-03-02T11:05:17.051-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4514.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T11:05:17.052-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:17.097-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (20344 records 208983685 bytes) is inconsistent with full validation results (20148 records 206980404 bytes). Updating size storer with new values. 2015-03-02T11:05:17.097-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:17.102-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:22.570-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:22.695-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (29952 records 307696896 bytes) is inconsistent with full validation results (30148 records 309710404 bytes). Updating size storer with new values. 2015-03-02T11:05:22.695-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:22.698-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:05:22.700-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 130ms 2015-03-02T11:05:22.708-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:05:22.763-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:05:22.767-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:06:03.992-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] MongoDB starting : pid=4199 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:06:04.002-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:06:04.002-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:06:04.040-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:06:04.109-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:06:39.296-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58644 #1 (1 connection now open) 2015-03-02T11:06:39.303-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:06:39.542-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:06:39.547-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:06:39.560-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11627 locks:{} 245ms 2015-03-02T11:06:39.563-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:06:39.607-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:06:39.610-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:06:39.614-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:06:39.658-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:06:39.661-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:07:07.841-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:07:07.853-0500 I CONTROL [initandlisten] MongoDB starting : pid=2089 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:07:07.853-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:07:07.853-0500 I CONTROL [initandlisten] 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:07:07.857-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:07:07.857-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:07:07.894-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:07:07.946-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:07:09.327-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58647 #1 (1 connection now open) 2015-03-02T11:07:09.334-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:07:09.573-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:07:09.577-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:07:09.579-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 244ms 2015-03-02T11:07:09.582-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:07:09.628-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:07:09.631-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:07:13.523-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:07:13.691-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (33149 records 340539677 bytes) is inconsistent with full validation results (34148 records 350802404 bytes). Updating size storer with new values. 2015-03-02T11:07:13.691-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:07:13.695-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:07:13.697-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 173ms 2015-03-02T11:07:13.705-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:07:13.767-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:07:13.771-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:07:13.778-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:07:13.841-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:07:13.845-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:07:13.849-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:07:13.918-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:07:13.922-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:07:16.686-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58651 #2 (2 connections now open) 2015-03-02T11:07:16.698-0500 I NETWORK [conn2] end connection 10.4.127.218:58651 (1 connection now open) 2015-03-02T11:07:16.702-0500 I NETWORK [conn1] end connection 10.4.127.218:58647 (0 connections now open) 2015-03-02T11:07:40.589-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58657 #3 (1 connection now open) 2015-03-02T11:07:40.603-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:07:40.745-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (39149 records 402177677 bytes) is inconsistent with full validation results (40148 records 412440404 bytes). Updating size storer with new values. 2015-03-02T11:07:40.745-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:07:40.749-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:07:40.751-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 148ms 2015-03-02T11:08:07.516-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] MongoDB starting : pid=2108 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:08:07.525-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:08:07.526-0500 I CONTROL [initandlisten] 2015-03-02T11:08:07.526-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:08:07.527-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:08:07.527-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:08:07.527-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:08:07.527-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:08:07.527-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:08:07.572-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:08:07.626-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:08:10.591-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58660 #1 (1 connection now open) 2015-03-02T11:08:10.598-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:08:10.837-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:08:10.840-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:08:10.843-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11627 locks:{} 244ms 2015-03-02T11:08:14.472-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:08:14.641-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (33153 records 340580769 bytes) is inconsistent with full validation results (34152 records 350843496 bytes). Updating size storer with new values. 2015-03-02T11:08:14.641-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:08:14.645-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:08:14.647-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 2015-03-02T11:09:09.114-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] MongoDB starting : pid=2104 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:09:09.124-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:09:09.124-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:09:09.166-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:09:09.195-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:09:12.483-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58673 #1 (1 connection now open) 2015-03-02T11:09:12.489-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:09:12.734-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:09:12.738-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:09:12.740-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11627 locks:{} 250ms 2015-03-02T11:09:13.088-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2314.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12172 nscannedObjects:12172 nMatched:6086 nModified:6086 keyUpdates:1 writeConflicts:0 numYields:95 locks:{} 343ms 2015-03-02T11:09:13.089-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2314.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 343ms 2015-03-02T11:09:13.091-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:09:13.138-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (24156 records 248232601 bytes) is inconsistent with full validation results (24156 records 248233706 bytes). Updating size storer with new values. 2015-03-02T11:09:13.138-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:09:13.141-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:09:13.147-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:09:13.193-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:09:13.197-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:09:17.109-0500 I NETWORK [conn1] end connection 10.4.127.218:58673 (0 connections now open) 2015-03-02T11:09:17.141-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58674 #2 (1 connection now open) 2015-03-02T11:09:17.153-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:17.295-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (32071 records 329544501 bytes) is inconsistent with full validation results (32156 records 330417706 bytes). Updating size storer with new values. 2015-03-02T11:09:17.296-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:17.299-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:17.301-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11627 locks:{} 148ms 2015-03-02T11:09:17.306-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:17.365-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:17.368-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:18.681-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 693.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44892 nscannedObjects:44892 nMatched:22446 nModified:22446 keyUpdates:1 writeConflicts:0 numYields:350 locks:{} 1306ms 2015-03-02T11:09:18.681-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 693.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1306ms 2015-03-02T11:09:18.684-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:18.749-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:18.753-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:20.008-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9876.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44892 nscannedObjects:44892 nMatched:22446 nModified:22446 keyUpdates:1 writeConflicts:0 numYields:350 locks:{} 1246ms 2015-03-02T11:09:20.008-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9876.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1246ms 2015-03-02T11:09:20.010-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:20.076-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:20.080-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:20.089-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:20.156-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:20.159-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:21.215-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3194.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44892 nscannedObjects:44892 nMatched:22446 nModified:22446 keyUpdates:1 writeConflicts:0 numYields:350 locks:{} 1052ms 2015-03-02T11:09:21.215-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3194.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1052ms 2015-03-02T11:09:21.218-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:21.286-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:21.290-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:22.338-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4128.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44892 nscannedObjects:44892 nMatched:22446 nModified:22446 keyUpdates:1 writeConflicts:0 numYields:350 locks:{} 1039ms 2015-03-02T11:09:22.339-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4128.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1039ms 2015-03-02T11:09:22.340-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:22.404-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:22.408-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:22.420-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:22.484-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:22.488-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:23.046-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 7629.0 } } ndeleted:22446 keyUpdates:0 writeConflicts:0 numYields:175 locks:{} 554ms 2015-03-02T11:09:23.046-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7629.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 554ms 2015-03-02T11:09:23.048-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:23.096-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (10025 records 102990920 bytes) is inconsistent with full validation results (9710 records 99750830 bytes). Updating size storer with new values. 2015-03-02T11:09:23.096-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:23.100-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:27.913-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:28.012-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (19395 records 199244835 bytes) is inconsistent with full validation results (19710 records 202480830 bytes). Updating size storer with new values. 2015-03-02T11:09:28.012-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:28.015-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:28.016-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11631 locks:{} 103ms 2015-03-02T11:09:28.020-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:28.058-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:28.062-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:28.219-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 3855.0 } } ndeleted:6145 keyUpdates:0 writeConflicts:0 numYields:48 locks:{} 153ms 2015-03-02T11:09:28.219-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3855.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T11:09:28.220-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:28.251-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (14025 records 144078825 bytes) is inconsistent with full validation results (13565 records 139353245 bytes). Updating size storer with new values. 2015-03-02T11:09:28.251-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:28.255-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:33.648-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:33.769-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (23105 records 237357665 bytes) is inconsistent with full validation results (23565 records 242083245 bytes). Updating size storer with new values. 2015-03-02T11:09:33.769-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:33.772-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:33.774-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11631 locks:{} 125ms 2015-03-02T11:09:34.023-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 5220.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9560 nscannedObjects:9560 nMatched:4780 nModified:4780 keyUpdates:1 writeConflicts:0 numYields:74 locks:{} 247ms 2015-03-02T11:09:34.023-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5220.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 247ms 2015-03-02T11:09:34.024-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:34.074-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (23565 records 242142265 bytes) is inconsistent with full validation results (23565 records 242145385 bytes). Updating size storer with new values. 2015-03-02T11:09:34.074-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:34.077-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:39.183-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:39.357-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (33325 records 342409865 bytes) is inconsistent with full validation results (33565 records 344875385 bytes). Updating size storer with new values. 2015-03-02T11:09:39.358-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:39.362-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:39.365-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11631 locks:{} 181ms 2015-03-02T11:09:40.139-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3160.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28750 nscannedObjects:28750 nMatched:14375 nModified:14375 keyUpdates:1 writeConflicts:0 numYields:225 locks:{} 771ms 2015-03-02T11:09:40.139-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3160.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 771ms 2015-03-02T11:09:40.142-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:40.233-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:40.237-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:40.246-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11631 locks:{} 103ms 2015-03-02T11:09:40.254-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:40.327-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:40.333-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:40.341-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:09:40.407-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:09:40.412-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:09:41.292-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7940.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28750 nscannedObjects:28750 nMatched:14375 nModified:14375 keyUpdates:1 writeConflicts:0 numYields:226 locks:{} 875ms 2015-03-02T11:09:41.292-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7940.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 875ms 2015-03-02T11:09:41.294-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:092015-03-02T11:10:24.415-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] MongoDB starting : pid=5067 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:10:24.429-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:10:24.429-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:10:24.466-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:10:24.508-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:10:25.551-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58684 #1 (1 connection now open) 2015-03-02T11:10:26.028-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 8296.0 } } ndeleted:14375 keyUpdates:0 writeConflicts:0 numYields:112 locks:{} 471ms 2015-03-02T11:10:26.028-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8296.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 471ms 2015-03-02T11:10:26.031-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.227-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (19564 records 200985834 bytes) is inconsistent with full validation results (19190 records 197138870 bytes). Updating size storer with new values. 2015-03-02T11:10:26.228-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.231-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.234-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 202ms 2015-03-02T11:10:26.238-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.272-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.275-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.281-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.317-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.319-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.323-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.357-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.359-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.363-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.399-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.402-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.406-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.442-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.445-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.450-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.483-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.486-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.489-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.526-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.528-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:26.535-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:26.571-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:26.573-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:28.147-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58685 #2 (2 connections now open) 2015-03-02T11:10:28.153-0500 I NETWORK [conn2] end connection 10.4.127.218:58685 (1 connection now open) 2015-03-02T11:10:28.825-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58686 #3 (2 connections now open) 2015-03-02T11:10:28.835-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:10:28.938-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (21816 records 224115768 bytes) is inconsistent with full validation results (22190 records 227957870 bytes). Updating size storer with new values. 2015-03-02T11:10:28.939-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:10:28.941-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:10:28.948-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 112ms 2015-03-02T11:10:33.138-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:33.289-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (30816 records 316572768 bytes) is inconsistent with full validation results (31190 records 320414870 bytes). Updating size storer with new values. 2015-03-02T11:10:33.289-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:33.298-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:33.300-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 161ms 2015-03-02T11:10:33.307-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:33.371-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:33.377-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:35.267-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58689 #4 (3 connections now open) 2015-03-02T11:10:37.105-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1728.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31018 nscannedObjects:31018 nMatched:15509 nModified:15509 keyUpdates:1 writeConflicts:0 numYields:254 locks:{} 1831ms 2015-03-02T11:10:37.105-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1728.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1831ms 2015-03-02T11:10:37.109-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:10:37.299-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (36370 records 373829808 bytes) is inconsistent with full validation results (37190 records 382254487 bytes). Updating size storer with new values. 2015-03-02T11:10:37.299-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:10:37.303-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:10:37.310-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 201ms 2015-03-02T11:10:37.317-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:10:37.543-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing record and data size counters (37459 records 385017924 bytes) are inconsistent with full validation results (37190 records 382254487 bytes). Updating counters with new values. 2015-03-02T11:10:37.543-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (37307 records 383456428 bytes) is inconsistent with full validation results (37190 records 382254487 bytes). Updating size storer with new values. 2015-03-02T11:10:37.543-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:10:37.555-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:10:37.560-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 243ms 2015-03-02T11:10:37.610-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T11:10:38.977-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:10:42.003-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:42.426-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (48921 records 502767050 bytes) are inconsistent with full validation results (49190 records 505530487 bytes). Updating counters with new values. 2015-03-02T11:10:42.426-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (48038 records 493695991 bytes) is inconsistent with full validation results (49190 records 505530487 bytes). Updating size storer with new values. 2015-03-02T11:10:42.426-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:42.431-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:42.434-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 430ms 2015-03-02T11:10:42.439-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:42.599-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:42.612-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:42.632-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 192ms 2015-03-02T11:10:42.641-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:42.737-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:42.743-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:42.747-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 106ms 2015-03-02T11:10:44.450-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:10:46.197-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:10:46.201-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:10:46.876-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing record and data size counters (59190 records 608260487 bytes) are inconsistent with full validation results (58190 records 597987487 bytes). Updating counters with new values. 2015-03-02T11:10:46.876-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (58307 records 599189428 bytes) is inconsistent with full validation results (58190 records 597987487 bytes). Updating size storer with new values. 2015-03-02T11:10:46.876-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:10:46.896-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:10:46.912-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 710ms 2015-03-02T11:10:46.943-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:10:47.052-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:10:47.298-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (58307 records 599189428 bytes) is inconsistent with full validation results (59190 records 608260487 bytes). Updating size storer with new values. 2015-03-02T11:10:47.298-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:10:47.317-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:10:47.333-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 389ms 2015-03-02T11:10:47.353-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:10:47.678-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing record and data size counters (59190 records 608260487 bytes) are inconsistent with full validation results (60190 records 618533487 bytes). Updating counters with new values. 2015-03-02T11:10:47.678-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (59190 records 608260487 bytes) is inconsistent with full validation results (60190 records 618533487 bytes). Updating size storer with new values. 2015-03-02T11:10:47.678-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:10:47.692-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:10:47.700-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 346ms 2015-03-02T11:10:47.858-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:10:48.257-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T11:10:48.831-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58695 #5 (4 connections now open) 2015-03-02T11:10:48.866-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:10:49.011-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T11:10:49.886-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 197ms 2015-03-02T11:10:49.999-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing record and data size counters (37345 records 383775822 bytes) are inconsistent with full validation results (45804 records 470746109 bytes). Updating counters with new values. 2015-03-02T11:10:49.999-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing data in size storer (38073 records 391264030 bytes) is inconsistent with full validation results (45804 records 470746109 bytes). Updating size storer with new values. 2015-03-02T11:10:49.999-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:10:50.027-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:10:50.046-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 1180ms 2015-03-02T11:10:50.827-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 8317.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11842 nscannedObjects:11842 nMatched:5905 nModified:5905 keyUpdates:1 writeConflicts:60 numYields:98 locks:{} 773ms 2015-03-02T11:10:50.827-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8317.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 773ms 2015-03-02T11:10:50.833-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:10:51.082-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T11:10:51.089-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:10:51.315-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing record and data size counters (35503 records 364803023 bytes) are inconsistent with full validation results (30636 records 314793048 bytes). Updating counters with new values. 2015-03-02T11:10:51.315-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing data in size storer (36447 records 374513007 bytes) is inconsistent with full validation results (30636 records 314793048 bytes). Updating size storer with new values. 2015-03-02T11:10:51.315-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:10:51.322-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing record and data size counters (30586 records 314278748 bytes) are inconsistent with full validation results (29460 records 302683712 bytes). Updating counters with new values. 2015-03-02T11:10:51.322-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (30636 records 314793048 bytes) is inconsistent with full validation results (29460 records 302683712 bytes). Updating size storer with new values. 2015-03-02T11:10:51.322-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:10:51.339-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:10:51.340-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:10:51.349-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 516ms 2015-03-02T11:10:51.353-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 263ms 2015-03-02T11:10:51.373-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:10:51.411-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 2406.0 } } ndeleted:6074 keyUpdates:0 writeConflicts:44 numYields:313 locks:{} 3705ms 2015-03-02T11:10:51.411-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2406.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3705ms 2015-03-02T11:10:51.411-0500 I NETWORK [conn3] end connection 10.4.127.218:58686 (3 connections now open) 2015-03-02T11:10:51.489-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing record and data size counters (28762 records 295504084 bytes) are inconsistent with full validation results (26608 records 273348040 bytes). Updating counters with new values. 2015-03-02T11:10:51.489-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (29454 records 302621996 bytes) is inconsistent with full validation results (26608 records 273348040 bytes). Updating size storer with new values. 2015-03-02T11:10:51.489-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:10:51.495-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:10:51.497-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 124ms 2015-03-02T11:10:51.501-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:10:51.602-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing record and data size counters (26608 records 273348040 bytes) are inconsistent with full validation results (26296 records 270138808 bytes). Updating counters with new values. 2015-03-02T11:10:51.602-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (26608 records 273348040 bytes) is inconsistent with full validation results (26296 records 270138808 bytes). Updating size storer with new values. 2015-03-02T11:10:51.602-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:10:51.613-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:10:51.620-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 118ms 2015-03-02T11:10:54.647-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:10:54.690-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:10:54.693-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:54.938-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T11:10:54.992-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (35296 records 362595808 bytes) are inconsistent with full validation results (34296 records 352322808 bytes). Updating counters with new values. 2015-03-02T11:10:54.992-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (34604 records 355486892 bytes) is inconsistent with full validation results (34296 records 352322808 bytes). Updating size storer with new values. 2015-03-02T11:10:54.992-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:55.003-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:55.010-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 317ms 2015-03-02T11:10:55.233-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9302.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2792 nscannedObjects:2792 nMatched:1396 nModified:1396 keyUpdates:1 writeConflicts:0 numYields:24 locks:{} 212ms 2015-03-02T11:10:55.233-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9302.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 212ms 2015-03-02T11:10:55.234-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:55.345-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (34296 records 352340956 bytes) are inconsistent with full validation results (35296 records 362613956 bytes). Updating counters with new values. 2015-03-02T11:10:55.345-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (34296 records 352339812 bytes) is inconsistent with full validation results (35296 records 362613956 bytes). Updating size storer with new values. 2015-03-02T11:10:55.345-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:55.350-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:55.355-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 120ms 2015-03-02T11:10:55.359-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:10:55.547-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:10:55.558-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:10:55.560-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 201ms 2015-03-02T11:10:55.565-0500 I NETWORK [conn1] end connection 10.4.127.218:58684 (2 connections now open) 2015-03-02T11:10:55.568-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58697 #6 (3 connections now open) 2015-03-02T11:10:55.579-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:10:55.736-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:10:55.745-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:10:55.752-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 173ms 2015-03-02T11:10:55.768-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:10:55.916-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:10:55.940-0500 W STORAGE [conn6] table:collection-0-8947135925839337956: Existing record and data size counters (36296 records 372886956 bytes) are inconsistent with full validation results (35296 records 362613956 bytes). Updating counters with new values. 2015-03-02T11:10:55.941-0500 W STORAGE [conn6] table:collection-0-8947135925839337956: Existing data in size storer (36208 records 371982932 bytes) is inconsistent with full validation results (35296 records 362613956 bytes). Updating size storer with new values. 2015-03-02T11:10:55.941-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:10:55.954-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:10:55.957-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 188ms 2015-03-02T11:10:55.963-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:10:56.105-0500 W STORAGE [conn6] table:collection-0-8947135925839337956: Existing record and data size counters (35296 records 362613956 bytes) are inconsistent with full validation results (36296 records 372886956 bytes). Updating counters with new values. 2015-03-02T11:10:56.105-0500 W STORAGE [conn6] table:collection-0-8947135925839337956: Existing data in size storer (35296 records 362613956 bytes) is inconsistent with full validation results (36296 records 372886956 bytes). Updating size storer with new values. 2015-03-02T11:10:56.106-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:10:56.113-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:10:56.115-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 151ms 2015-03-02T11:10:56.360-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 3334.0 } } ndeleted:5000 keyUpdates:0 writeConflicts:0 numYields:39 locks:{} 240ms 2015-03-02T11:10:56.360-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3334.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 240ms 2015-03-02T11:10:56.363-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:10:56.564-0500 W STORAGE [conn6] table:collection-0-8947135925839337956: Existing data in size storer (32276 records 331571790 bytes) is inconsistent with full validation results (32296 records 331776808 bytes). Updating size storer with new values. 2015-03-02T11:10:56.564-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:10:56.570-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:10:56.573-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 209ms 2015-03-02T11:10:56.576-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:10:56.695-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:10:56.707-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:10:56.717-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 141ms 2015-03-02T11:10:57.486-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:10:58.664-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 155ms 2015-03-02T11:11:00.153-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T11:11:01.003-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T11:11:01.047-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:11:01.961-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:11:02.316-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing data in size storer (45208 records 464421784 bytes) is inconsistent with full validation results (45296 records 465325808 bytes). Updating size storer with new values. 2015-03-02T11:11:02.317-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:11:02.322-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:11:02.330-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 368ms 2015-03-02T11:11:03.730-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:11:03.967-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (49208 records 505513784 bytes) is inconsistent with full validation results (49296 records 506417808 bytes). Updating size storer with new values. 2015-03-02T11:11:03.967-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:11:03.983-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:11:03.994-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11637 locks:{} 263ms 2015-03-02T11:11:04.865-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:11:05.015-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4658.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21368 nscannedObjects:21368 nMatched:10684 nModified:10684 keyUpdates:1 writeConflicts:0 numYields:170 locks:{} 1018ms 2015-03-02T11:11:05.016-0500 I CO2015-03-02T11:11:39.576-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] MongoDB starting : pid=4334 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:11:39.588-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:11:39.589-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:11:39.625-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:11:39.679-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:11:43.975-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58709 #1 (1 connection now open) 2015-03-02T11:11:43.989-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:11:44.370-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:11:44.375-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:11:44.378-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 388ms 2015-03-02T11:11:45.400-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58710 #2 (2 connections now open) 2015-03-02T11:11:45.405-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:11:45.477-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:11:45.481-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:11:45.699-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58711 #3 (3 connections now open) 2015-03-02T11:11:45.965-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 163ms 2015-03-02T11:11:46.231-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2416.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7325 nscannedObjects:7325 nMatched:7168 nModified:7168 keyUpdates:1 writeConflicts:0 numYields:61 locks:{} 735ms 2015-03-02T11:11:46.231-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2416.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 735ms 2015-03-02T11:11:46.234-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:11:46.238-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 8551.0 } } ndeleted:7168 keyUpdates:0 writeConflicts:0 numYields:57 locks:{} 525ms 2015-03-02T11:11:46.238-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8551.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 526ms 2015-03-02T11:11:46.245-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:11:46.389-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (31434 records 322925057 bytes) is inconsistent with full validation results (31129 records 319788217 bytes). Updating size storer with new values. 2015-03-02T11:11:46.390-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:11:46.392-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing record and data size counters (31129 records 319788217 bytes) are inconsistent with full validation results (31222 records 320744815 bytes). Updating counters with new values. 2015-03-02T11:11:46.392-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (31129 records 319788217 bytes) is inconsistent with full validation results (31222 records 320744815 bytes). Updating size storer with new values. 2015-03-02T11:11:46.392-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:11:46.399-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:11:46.401-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:11:46.404-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 170ms 2015-03-02T11:11:46.405-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 160ms 2015-03-02T11:11:46.410-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:11:46.410-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:11:46.549-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing record and data size counters (31223 records 320744861 bytes) are inconsistent with full validation results (31130 records 319788263 bytes). Updating counters with new values. 2015-03-02T11:11:46.549-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (31222 records 320744815 bytes) is inconsistent with full validation results (31130 records 319788263 bytes). Updating size storer with new values. 2015-03-02T11:11:46.549-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:11:46.551-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:11:46.557-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:11:46.559-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:11:46.563-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 152ms 2015-03-02T11:11:46.565-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 154ms 2015-03-02T11:11:46.575-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:11:46.587-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:11:46.740-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:11:46.749-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:11:46.752-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:11:46.758-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:11:46.761-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 186ms 2015-03-02T11:11:46.766-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 179ms 2015-03-02T11:11:46.768-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:11:46.780-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:11:46.928-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (31130 records 319788263 bytes) is inconsistent with full validation results (31129 records 319788217 bytes). Updating size storer with new values. 2015-03-02T11:11:46.929-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:11:46.934-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:11:46.938-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:11:46.946-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:11:46.948-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 177ms 2015-03-02T11:11:46.951-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 170ms 2015-03-02T11:11:46.957-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:11:47.085-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:11:47.089-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:11:47.092-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 134ms 2015-03-02T11:11:48.938-0500 I NETWORK [conn1] end connection 10.4.127.218:58709 (2 connections now open) 2015-03-02T11:11:48.969-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:11:48.970-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58712 #4 (3 connections now open) 2015-03-02T11:11:49.040-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:11:49.193-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (35792 records 367691216 bytes) is inconsistent with full validation results (36129 records 371157416 bytes). Updating size storer with new values. 2015-03-02T11:11:49.193-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:11:49.197-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:11:49.199-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 159ms 2015-03-02T11:11:49.202-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:11:49.303-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:11:49.307-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:11:49.310-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 108ms 2015-03-02T11:11:49.313-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:11:49.419-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:11:49.424-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:11:49.426-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 113ms 2015-03-02T11:11:50.639-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:11:51.443-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:11:52.025-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:11:52.872-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 121.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:70924 nscannedObjects:70924 nMatched:35462 nModified:35462 keyUpdates:1 writeConflicts:0 numYields:571 locks:{} 3443ms 2015-03-02T11:11:52.872-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 121.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3444ms 2015-03-02T11:11:52.874-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:11:53.055-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing record and data size counters (39509 records 406336963 bytes) are inconsistent with full validation results (39129 records 402433223 bytes). Updating counters with new values. 2015-03-02T11:11:53.055-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:11:53.064-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:11:53.076-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 202ms 2015-03-02T11:11:53.105-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:11:53.148-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T11:11:53.281-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 168ms 2015-03-02T11:11:53.356-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing record and data size counters (40749 records 419075483 bytes) are inconsistent with full validation results (39946 records 410826264 bytes). Updating counters with new values. 2015-03-02T11:11:53.356-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (40627 records 417822177 bytes) is inconsistent with full validation results (39946 records 410826264 bytes). Updating size storer with new values. 2015-03-02T11:11:53.356-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:11:53.372-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:11:53.379-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 273ms 2015-03-02T11:11:55.610-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:11:55.682-0500 I NETWORK [conn3] end connection 10.4.127.218:58711 (2 connections now open) 2015-03-02T11:11:55.711-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58715 #5 (3 connections now open) 2015-03-02T11:11:57.501-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:11:57.870-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing record and data size counters (47946 records 493010264 bytes) are inconsistent with full validation results (49129 records 505163223 bytes). Updating counters with new values. 2015-03-02T11:11:57.870-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (47824 records 491756958 bytes) is inconsistent with full validation results (49129 records 505163223 bytes). Updating size storer with new values. 2015-03-02T11:11:57.870-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:11:57.877-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:11:57.880-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 379ms 2015-03-02T11:12:04.456-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:12:05.394-0500 I NETWORK [conn2] end connection 10.4.127.218:58710 (2 connections now open) 2015-03-02T11:12:05.398-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58716 #6 (3 connections now open) 2015-03-02T11:12:06.034-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:12:08.397-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T11:12:08.403-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:12:08.838-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 839.0 } } ndeleted:62336 keyUpdates:0 writeConflicts:0 numYields:494 locks:{} 3430ms 2015-03-02T11:12:08.838-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 839.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3430ms 2015-03-02T11:12:08.845-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:12:08.980-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:12:09.148-0500 W STORAGE [conn6] table:collection-0-8947135925839337956: Existing record and data size counters (8793 records 90330489 bytes) are inconsistent with full validation results (7793 records 80057489 bytes). Updating counters with new values. 2015-03-02T11:12:09.148-0500 W STORAGE [conn6] table:collection-0-8947135925839337956: Existing data in size storer (8335 records 85625455 bytes) is inconsistent with full validation results (7793 records 80057489 bytes). Updating size storer with new values. 2015-03-02T11:12:09.149-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:12:09.153-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing record and data size counters (7793 records 80057489 bytes) are inconsistent with full validation results (13298 records 136681919 bytes). Updating counters with new values. 2015-03-02T11:12:09.153-0500 W STORAGE [conn4] table:collection-0-8947135925839337956: Existing data in size storer (7793 records 80057489 bytes) is inconsistent with full validation results (13298 records 136681919 bytes). Updating size storer with new values. 2015-03-02T11:12:09.153-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:12:09.164-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:12:09.165-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 761ms 2015-03-02T11:12:09.168-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:12:09.173-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 328ms 2015-03-02T11:12:12.275-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:12:12.403-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing record and data size counters (19298 records 198319919 bytes) are inconsistent with full validation results (14793 records 151968489 bytes). Updating counters with new values. 2015-03-02T11:12:12.403-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing data in size storer (18840 records 193614885 bytes) is inconsistent with full validation results (14793 records 151968489 bytes). Updating size storer with new values. 2015-03-02T11:12:12.403-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:12:12.410-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:12:12.412-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11633 locks:{} 136ms 2015-03-02T11:12:12.988-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4437.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12000 nscannedObjects:12000 nMatched:6000 nModified:6000 keyUpdates:1 writeConflicts:0 numYields:97 locks:{} 571ms 2015-03-02T11:12:12.988-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4437.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 571ms 2015-03-02T11:12:12.996-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:12:13.068-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing data in size storer (14793 records 152040535 bytes) is inconsistent with full validation results (14793 records 152046489 bytes). Updating size storer with new values. 2015-03-02T11:12:13.069-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:12:13.071-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:13:00.250-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] MongoDB starting : pid=5065 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] 2015-03-02T11:13:00.259-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:13:00.260-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:13:00.260-0500 I CONTROL [initandlisten] 2015-03-02T11:13:00.260-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:13:00.260-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:13:00.260-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:13:00.260-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:13:00.260-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:13:00.260-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:13:00.297-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:13:00.348-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:13:05.279-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58736 #1 (1 connection now open) 2015-03-02T11:13:05.288-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:05.473-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:05.477-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:05.484-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 189ms 2015-03-02T11:13:05.599-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58737 #2 (2 connections now open) 2015-03-02T11:13:05.612-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:13:05.652-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing record and data size counters (8896 records 91409018 bytes) are inconsistent with full validation results (9714 records 99822966 bytes). Updating counters with new values. 2015-03-02T11:13:05.652-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (9792 records 100625274 bytes) is inconsistent with full validation results (9714 records 99822966 bytes). Updating size storer with new values. 2015-03-02T11:13:05.653-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:13:05.657-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:13:05.692-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 810.0 } } ndeleted:7467 keyUpdates:0 writeConflicts:0 numYields:58 locks:{} 203ms 2015-03-02T11:13:05.692-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 810.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 203ms 2015-03-02T11:13:05.695-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:05.710-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (8144 records 83673946 bytes) are inconsistent with full validation results (7326 records 75259998 bytes). Updating counters with new values. 2015-03-02T11:13:05.710-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (8610 records 88467222 bytes) is inconsistent with full validation results (7326 records 75259998 bytes). Updating size storer with new values. 2015-03-02T11:13:05.710-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:05.712-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:05.725-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:05.742-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (7326 records 75259998 bytes) is inconsistent with full validation results (6981 records 71715813 bytes). Updating size storer with new values. 2015-03-02T11:13:05.742-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:05.743-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:05.748-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:05.763-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:05.765-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:05.771-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:05.786-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (6981 records 71715813 bytes) is inconsistent with full validation results (6982 records 71715859 bytes). Updating size storer with new values. 2015-03-02T11:13:05.787-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:05.788-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:05.800-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:05.822-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (6982 records 71715859 bytes) is inconsistent with full validation results (6981 records 71715813 bytes). Updating size storer with new values. 2015-03-02T11:13:05.822-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:05.826-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:08.871-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58738 #3 (3 connections now open) 2015-03-02T11:13:08.887-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:13:09.049-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (13168 records 135274864 bytes) is inconsistent with full validation results (13982 records 143626859 bytes). Updating size storer with new values. 2015-03-02T11:13:09.049-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:13:09.051-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:13:09.063-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 176ms 2015-03-02T11:13:09.610-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2269.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7464 nscannedObjects:7464 nMatched:3732 nModified:3732 keyUpdates:1 writeConflicts:0 numYields:63 locks:{} 542ms 2015-03-02T11:13:09.610-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2269.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 542ms 2015-03-02T11:13:09.614-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:13:09.688-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (14982 records 153941277 bytes) is inconsistent with full validation results (14982 records 153948362 bytes). Updating size storer with new values. 2015-03-02T11:13:09.692-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:13:09.697-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:13:10.212-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8151.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7464 nscannedObjects:7464 nMatched:3732 nModified:3732 keyUpdates:1 writeConflicts:0 numYields:62 locks:{} 508ms 2015-03-02T11:13:10.212-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8151.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 508ms 2015-03-02T11:13:10.217-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:13:10.306-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing record and data size counters (16456 records 169090764 bytes) are inconsistent with full validation results (15431 records 158560939 bytes). Updating counters with new values. 2015-03-02T11:13:10.306-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (15704 records 161365468 bytes) is inconsistent with full validation results (15431 records 158560939 bytes). Updating size storer with new values. 2015-03-02T11:13:10.306-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:13:10.308-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:13:10.326-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:13:10.332-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T11:13:10.337-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T11:13:10.443-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing record and data size counters (15957 records 163964537 bytes) are inconsistent with full validation results (16835 records 172984231 bytes). Updating counters with new values. 2015-03-02T11:13:10.443-0500 W STORAGE [conn3] table:collection-0-8947135925839337956: Existing data in size storer (15679 records 161108643 bytes) is inconsistent with full validation results (16835 records 172984231 bytes). Updating size storer with new values. 2015-03-02T11:13:10.443-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:13:10.448-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:13:10.450-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 123ms 2015-03-02T11:13:11.785-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:13:12.392-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:12.521-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (21835 records 224349231 bytes) are inconsistent with full validation results (21982 records 225859362 bytes). Updating counters with new values. 2015-03-02T11:13:12.521-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (21557 records 221493337 bytes) is inconsistent with full validation results (21982 records 225859362 bytes). Updating size storer with new values. 2015-03-02T11:13:12.522-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:12.524-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:12.526-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 133ms 2015-03-02T11:13:12.533-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:12.612-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:12.615-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:12.629-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:12.695-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:12.698-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:12.716-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:12.806-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:12.809-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:13.749-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1529.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21886 nscannedObjects:21886 nMatched:10943 nModified:10943 keyUpdates:1 writeConflicts:0 numYields:175 locks:{} 936ms 2015-03-02T11:13:13.749-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1529.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 936ms 2015-03-02T11:13:13.756-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:13.888-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (23982 records 246499105 bytes) are inconsistent with full validation results (22982 records 236226105 bytes). Updating counters with new values. 2015-03-02T11:13:13.888-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (23761 records 244228772 bytes) is inconsistent with full validation results (22982 records 236226105 bytes). Updating size storer with new values. 2015-03-02T11:13:13.888-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:13.891-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:13.896-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 140ms 2015-03-02T11:13:15.303-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:13:18.655-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:13:18.843-0500 I NETWORK [conn3] end connection 10.4.127.218:58738 (2 connections now open) 2015-03-02T11:13:18.880-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58740 #4 (3 connections now open) 2015-03-02T11:13:20.563-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T11:13:20.568-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:13:20.956-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T11:13:21.297-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:21.511-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing record and data size counters (42982 records 441686105 bytes) are inconsistent with full validation results (41982 records 431413105 bytes). Updating counters with new values. 2015-03-02T11:13:21.511-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (42761 records 439415772 bytes) is inconsistent with full validation results (41982 records 431413105 bytes). Updating size storer with new values. 2015-03-02T11:13:21.511-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:13:21.520-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:13:21.522-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (41982 records 431413105 bytes) are inconsistent with full validation results (43982 records 451959105 bytes). Updating counters with new values. 2015-03-02T11:13:21.522-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (41982 records 431413105 bytes) is inconsistent with full validation results (43982 records 451959105 bytes). Updating size storer with new values. 2015-03-02T11:13:21.522-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:21.528-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 959ms 2015-03-02T11:13:21.530-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:21.540-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 243ms 2015-03-02T11:13:22.630-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:13:22.823-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T11:13:23.426-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 8094.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29510 nscannedObjects:29510 nMatched:14755 nModified:14755 keyUpdates:1 writeConflicts:0 numYields:244 locks:{} 1892ms 2015-03-02T11:13:23.426-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8094.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1892ms 2015-03-02T11:13:23.430-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:13:23.624-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T11:13:23.750-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing record and data size counters (46982 records 482827661 bytes) are inconsistent with full validation results (45982 records 472554661 bytes). Updating counters with new values. 2015-03-02T11:13:23.750-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (46006 records 472801213 bytes) is inconsistent with full validation results (45982 records 472554661 bytes). Updating size storer with new values. 2015-03-02T11:13:23.750-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:13:23.755-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:13:23.774-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 344ms 2015-03-02T11:13:23.792-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:13:23.917-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing record and data size counters (45982 records 472554661 bytes) are inconsistent with full validation results (46982 records 482827661 bytes). Updating counters with new values. 2015-03-02T11:13:23.917-0500 W STORAGE [conn2] table:collection-0-8947135925839337956: Existing data in size storer (45982 records 472554661 bytes) is inconsistent with full validation results (46982 records 482827661 bytes). Updating size storer with new values. 2015-03-02T11:13:23.918-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:13:23.923-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:13:23.926-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 134ms 2015-03-02T11:13:24.583-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:13:24.680-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T11:13:25.445-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:13:25.613-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:58743 #5 (4 connections now open) 2015-03-02T11:13:26.790-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 222ms 2015-03-02T11:13:26.805-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6514.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:35830 nscannedObjects:35830 nMatched:17915 nModified:17915 keyUpdates:1 writeConflicts:0 numYields:302 locks:{} 2873ms 2015-03-02T11:13:26.805-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6514.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2873ms 2015-03-02T11:13:26.810-0500 I NETWORK [conn2] end connection 10.4.127.218:58737 (3 connections now open) 2015-03-02T11:13:26.833-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 199ms 2015-03-02T11:13:27.424-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 6339.0 } } ndeleted:18265 keyUpdates:0 writeConflicts:0 numYields:154 locks:{} 1786ms 2015-03-02T11:13:27.424-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6339.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1795ms 2015-03-02T11:13:27.428-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:13:27.729-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing record and data size counters (34717 records 356647741 bytes) are inconsistent with full validation results (33717 records 346374741 bytes). Updating counters with new values. 2015-03-02T11:13:27.729-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing data in size storer (34561 records 355045153 bytes) is inconsistent with full validation results (33717 records 346374741 bytes). Updating size storer with new values. 2015-03-02T11:13:27.730-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:13:27.737-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:13:27.742-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 313ms 2015-03-02T11:13:27.753-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:13:28.084-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing record and data size counters (33717 records 346374741 bytes) are inconsistent with full validation results (34717 records 356647741 bytes). Updating counters with new values. 2015-03-02T11:13:28.084-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing data in size storer (33717 records 346374741 bytes) is inconsistent with full validation results (34717 records 356647741 bytes). Updating size storer with new values. 2015-03-02T11:13:28.084-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:13:28.097-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:13:28.099-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 346ms 2015-03-02T11:13:28.110-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:13:28.294-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:13:28.301-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:13:28.313-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 203ms 2015-03-02T11:13:28.325-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:13:28.534-0500 W STORAGE [conn5] table:collection-0-8947135925839337956: Existing record and data size counters (35124 records 360828852 bytes) are inconsistent with full validation results (34717 records 356647741 bytes). Updating counters with new values. 2015-03-02T11:13:28.534-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:13:28.542-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:13:28.547-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 221ms 2015-03-02T11:13:30.501-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:30.812-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing record and data size counters (40310 records 414104630 bytes) are inconsistent with full validation results (40717 records 418285741 bytes). Updating counters with new values. 2015-03-02T11:13:30.812-0500 W STORAGE [conn1] table:collection-0-8947135925839337956: Existing data in size storer (40154 records 412502042 bytes) is inconsistent with full validation results (40717 records 418285741 bytes). Updating size storer with new values. 2015-03-02T11:13:30.812-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:30.821-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:30.825-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11625 locks:{} 323ms 2015-03-02T11:13:30.828-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:13:30.953-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:13:30.963-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:13:30.966-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writ2015-03-02T11:15:15.127-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] MongoDB starting : pid=2146 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:15:15.144-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:15:15.144-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:15:15.178-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T11:15:15.178-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T11:15:15.178-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:15:17.650-0500 E STORAGE [initandlisten] WiredTiger (-31802) [1425312917:650409][2146:0x7f8ad3eddb60]: journal/WiredTigerLog.0000000042 read error: failed to read 128 bytes at offset 0: WT_ERROR: non-specific WiredTiger error 2015-03-02T11:15:17.670-0500 I - [initandlisten] Assertion: 28595:-31802: WT_ERROR: non-specific WiredTiger error 2015-03-02T11:15:17.670-0500 I STORAGE [initandlisten] exception in initAndListen: 28595 -31802: WT_ERROR: non-specific WiredTiger error, terminating 2015-03-02T11:15:17.670-0500 I CONTROL [initandlisten] dbexit: rc: 100 2015-03-02T11:24:10.262-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] MongoDB starting : pid=3023 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:24:10.268-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:24:10.268-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:24:10.286-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:24:10.304-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:24:15.634-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59023 #1 (1 connection now open) 2015-03-02T11:24:15.643-0500 I INDEX [conn1] build index on: test.foo properties: { v: 1, key: { x: 1.0 }, name: "x_1", ns: "test.foo" } 2015-03-02T11:24:15.643-0500 I INDEX [conn1] building index using bulk method 2015-03-02T11:24:15.644-0500 I INDEX [conn1] build index done. scanned 0 total records. 0 secs 2015-03-02T11:24:15.648-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.648-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.648-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.656-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.656-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.656-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.658-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.659-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.659-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.661-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.661-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.662-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.665-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.665-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1 records 46 bytes) is inconsistent with full validation results (0 records 0 bytes). Updating size storer with new values. 2015-03-02T11:24:15.665-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.666-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.668-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.668-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.668-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.671-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.671-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.672-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.674-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.674-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.674-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.676-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.677-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.677-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.681-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.682-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.682-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.686-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.686-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (0 records 0 bytes) is inconsistent with full validation results (1 records 46 bytes). Updating size storer with new values. 2015-03-02T11:24:15.686-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.686-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.692-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.692-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.693-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.696-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.696-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.696-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.700-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.700-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.700-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.703-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:15.703-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:15.703-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:15.936-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59024 #2 (2 connections now open) 2015-03-02T11:24:15.942-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:24:15.942-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:24:15.943-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:24:15.945-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:24:15.946-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:24:15.946-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:24:15.948-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:24:15.948-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:24:15.948-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:24:19.241-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59025 #3 (3 connections now open) 2015-03-02T11:24:19.260-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:24:19.450-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (7001 records 71911046 bytes) are inconsistent with full validation results (6848 records 70339277 bytes). Updating counters with new values. 2015-03-02T11:24:19.451-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6996 records 71859681 bytes) is inconsistent with full validation results (6848 records 70339277 bytes). Updating size storer with new values. 2015-03-02T11:24:19.451-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:24:19.451-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:24:19.452-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 192ms 2015-03-02T11:24:19.726-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 4083.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3835 nscannedObjects:3835 nMatched:1918 nModified:1918 keyUpdates:1 writeConflicts:0 numYields:31 locks:{} 266ms 2015-03-02T11:24:19.726-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4083.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 266ms 2015-03-02T11:24:19.731-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:24:19.762-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (6848 records 70364198 bytes) are inconsistent with full validation results (7001 records 71935967 bytes). Updating counters with new values. 2015-03-02T11:24:19.762-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6848 records 70352212 bytes) is inconsistent with full validation results (7001 records 71935967 bytes). Updating size storer with new values. 2015-03-02T11:24:19.762-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:24:19.766-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:24:19.884-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 4919.0 } } ndeleted:1918 keyUpdates:0 writeConflicts:0 numYields:14 locks:{} 110ms 2015-03-02T11:24:19.884-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4919.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:24:19.889-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:24:19.909-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (5924 records 60857945 bytes) is inconsistent with full validation results (5083 records 52217659 bytes). Updating size storer with new values. 2015-03-02T11:24:19.909-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:24:19.918-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:24:19.930-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:24:19.953-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:24:19.954-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:24:19.961-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:24:19.979-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:24:19.979-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:24:19.982-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:24:19.991-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:24:19.991-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:24:22.235-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.360-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10242 records 105216066 bytes) is inconsistent with full validation results (11083 records 113855659 bytes). Updating size storer with new values. 2015-03-02T11:24:22.360-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.361-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.362-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 126ms 2015-03-02T11:24:22.531-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 3747.0 } } ndeleted:4336 keyUpdates:0 writeConflicts:0 numYields:34 locks:{} 165ms 2015-03-02T11:24:22.531-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3747.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T11:24:22.537-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.564-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6924 records 71130252 bytes) is inconsistent with full validation results (6747 records 69311931 bytes). Updating size storer with new values. 2015-03-02T11:24:22.564-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.566-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.578-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.595-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.596-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.598-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.611-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.612-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.615-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.627-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.628-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.635-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.647-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.647-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.650-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.663-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.664-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.666-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.678-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.679-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.682-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.696-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.697-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.705-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.720-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6747 records 69311931 bytes) is inconsistent with full validation results (6748 records 69311977 bytes). Updating size storer with new values. 2015-03-02T11:24:22.721-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.721-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.725-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.738-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.739-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.814-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.835-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6748 records 69322663 bytes) is inconsistent with full validation results (6748 records 69330034 bytes). Updating size storer with new values. 2015-03-02T11:24:22.835-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.836-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:22.914-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:22.941-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:22.949-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:23.234-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1095.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7116 nscannedObjects:7116 nMatched:3558 nModified:3558 keyUpdates:1 writeConflicts:0 numYields:56 locks:{} 279ms 2015-03-02T11:24:23.234-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1095.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 279ms 2015-03-02T11:24:23.235-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:23.251-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:23.252-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:25.901-0500 I NETWORK [conn2] end connection 10.4.127.218:59024 (2 connections now open) 2015-03-02T11:24:25.949-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59028 #4 (3 connections now open) 2015-03-02T11:24:25.960-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:24:26.225-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13232 records 135968350 bytes) is inconsistent with full validation results (13748 records 141269218 bytes). Updating size storer with new values. 2015-03-02T11:24:26.225-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:24:26.230-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:24:26.231-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 271ms 2015-03-02T11:24:26.245-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:24:26.304-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:24:26.316-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:24:26.328-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:24:26.395-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:24:26.397-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:24:26.402-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:24:26.496-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14234 records 146261896 bytes) are inconsistent with full validation results (13748 records 141269218 bytes). Updating counters with new values. 2015-03-02T11:24:26.497-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14232 records 146241350 bytes) is inconsistent with full validation results (13748 records 141269218 bytes). Updating size storer with new values. 2015-03-02T11:24:26.497-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:24:26.501-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:24:26.537-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T11:24:26.858-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8826.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7116 nscannedObjects:7116 nMatched:3558 nModified:3558 keyUpdates:1 writeConflicts:0 numYields:57 locks:{} 345ms 2015-03-02T11:24:26.858-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8826.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 345ms 2015-03-02T11:24:26.861-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:24:26.914-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14262 records 146549540 bytes) are inconsistent with full validation results (14748 records 151542218 bytes). Updating counters with new values. 2015-03-02T11:24:26.914-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14262 records 146549540 bytes) is inconsistent with full validation results (14748 records 151542218 bytes). Updating size storer with new values. 2015-03-02T11:24:26.914-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:24:26.916-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:24:27.373-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 184ms 2015-03-02T11:24:27.499-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:24:28.450-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1337.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:23768 nscannedObjects:23768 nMatched:11884 nModified:11884 keyUpdates:1 writeConflicts:0 numYields:196 locks:{} 1521ms 2015-03-02T11:24:28.450-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1337.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1522ms 2015-03-02T11:24:28.459-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:24:28.561-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (17419 records 179089639 bytes) are inconsistent with full validation results (16748 records 172196456 bytes). Updating counters with new values. 2015-03-02T11:24:28.562-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16790 records 172627922 bytes) is inconsistent with full validation results (16748 records 172196456 bytes). Updating size storer with new values. 2015-03-02T11:24:28.562-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:24:28.566-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:24:28.576-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 116ms 2015-03-02T11:24:28.586-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T11:24:29.310-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T11:24:30.019-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T11:24:31.450-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:24:31.674-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (25077 records 257760273 bytes) are inconsistent with full validation results (25748 records 264653456 bytes). Updating counters with new values. 2015-03-02T11:24:31.674-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (24119 records 247918739 bytes) is inconsistent with full validation results (25748 records 264653456 bytes). Updating size storer with new values. 2015-03-02T11:24:31.674-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:24:31.677-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:24:31.678-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 227ms 2015-03-02T11:24:34.420-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:24:35.354-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:24:35.610-0500 I NETWORK [conn1] end connection 10.4.127.218:59023 (2 connections now open) 2015-03-02T11:24:35.656-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59029 #5 (3 connections now open) 2015-03-02T11:24:35.666-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:24:36.034-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (34790 records 357541922 bytes) is inconsistent with full validation results (35748 records 367383456 bytes). Updating size storer with new values. 2015-03-02T11:24:36.034-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:24:36.043-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:24:36.061-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 394ms 2015-03-02T11:24:36.076-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:24:36.197-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T11:24:36.273-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (36748 records 377656456 bytes) are inconsistent with full validation results (35748 records 367383456 bytes). Updating counters with new values. 2015-03-02T11:24:36.273-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35790 records 367814922 bytes) is inconsistent with full validation results (35748 records 367383456 bytes). Updating size storer with new values. 2015-03-02T11:24:36.273-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:24:36.281-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:24:36.288-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 212ms 2015-03-02T11:24:36.312-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:24:37.001-0500 I WRITE [conn4] insert test.foo query: { _id: ObjectId('54f48ec3bd52258eed0cd41f'), x: 5020.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 6 } }, Database: { acquireCount: { w: 6 } }, Collection: { acquireCount: { w: 6 } } } 101ms 2015-03-02T11:24:49.235-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59034 #6 (4 connections now open) 2015-03-02T11:24:49.406-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f48ec4eeb6c2b8e95aa819'), x: 9141.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 142 } }, Database: { acquireCount: { w: 142 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 43258 } }, Collection: { acquireCount: { w: 142 } } } 128ms 2015-03-02T11:24:49.492-0500 I WRITE [conn4] insert test.foo query: { _id: ObjectId('54f48ec3bd52258eed0cd4b0'), x: 5165.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 151 } }, Database: { acquireCount: { w: 151 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 85257 } }, Collection: { acquireCount: { w: 151 } } } 170ms 2015-03-02T11:24:49.577-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f48ec4eeb6c2b8e95aa81a'), x: 9142.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 143 } }, Database: { acquireCount: { w: 143 }, acquireWaitCount: { w: 2 }, timeAcquiringMicros: { w: 128455 } }, Collection: { acquireCount: { w: 143 } } } 170ms 2015-03-02T11:24:49.664-0500 I WRITE [conn4] insert test.foo query: { _id: ObjectId('54f48ec3bd52258eed0cd4b1'), x: 5166.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 152 } }, Database: { acquireCount: { w: 152 }, acquireWaitCount: { w: 2 }, timeAcquiringMicros: { w: 171008 } }, Collection: { acquireCount: { w: 152 } } } 171ms 2015-03-02T11:24:49.750-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f48ec4eeb6c2b8e95a2015-03-02T11:25:41.890-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] MongoDB starting : pid=2610 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:25:41.912-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:25:41.916-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:25:41.916-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:25:41.916-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:25:41.916-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:25:41.977-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:25:42.022-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:25:44.091-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59056 #1 (1 connection now open) 2015-03-02T11:25:44.103-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:25:44.631-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:25:44.641-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:25:44.646-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 542ms 2015-03-02T11:25:45.506-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59059 #2 (2 connections now open) 2015-03-02T11:25:49.061-0500 I NETWORK [conn1] end connection 10.4.127.218:59056 (1 connection now open) 2015-03-02T11:25:49.093-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59060 #3 (2 connections now open) 2015-03-02T11:25:49.104-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:25:49.222-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40300 records 414146152 bytes) is inconsistent with full validation results (41299 records 424408879 bytes). Updating size storer with new values. 2015-03-02T11:25:49.222-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:25:49.227-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:25:49.230-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 126ms 2015-03-02T11:25:50.809-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59061 #4 (3 connections now open) 2015-03-02T11:25:50.822-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:25:50.964-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42300 records 434692152 bytes) is inconsistent with full validation results (43299 records 444954879 bytes). Updating size storer with new values. 2015-03-02T11:25:50.964-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:25:50.969-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:25:50.971-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 148ms 2015-03-02T11:25:55.802-0500 I NETWORK [conn4] end connection 10.4.127.218:59061 (2 connections now open) 2015-03-02T11:25:55.817-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59064 #5 (3 connections now open) 2015-03-02T11:25:56.865-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 193ms 2015-03-02T11:25:58.107-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 181ms 2015-03-02T11:25:59.175-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T11:25:59.517-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 56.0 } } ndeleted:54739 keyUpdates:0 writeConflicts:0 numYields:441 locks:{} 3693ms 2015-03-02T11:25:59.517-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 56.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3694ms 2015-03-02T11:25:59.521-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:25:59.678-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (2298 records 23606708 bytes) is inconsistent with full validation results (1560 records 16025880 bytes). Updating size storer with new values. 2015-03-02T11:25:59.678-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:25:59.701-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:25:59.739-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 217ms 2015-03-02T11:25:59.899-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4373.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2000 nscannedObjects:2000 nMatched:1000 nModified:1000 keyUpdates:1 writeConflicts:0 numYields:18 locks:{} 154ms 2015-03-02T11:25:59.899-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4373.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 154ms 2015-03-02T11:25:59.901-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:25:59.906-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (1560 records 16029286 bytes) is inconsistent with full validation results (1560 records 16038880 bytes). Updating size storer with new values. 2015-03-02T11:25:59.906-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:25:59.907-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.023-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3345.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2000 nscannedObjects:2000 nMatched:1000 nModified:1000 keyUpdates:1 writeConflicts:0 numYields:16 locks:{} 113ms 2015-03-02T11:26:00.024-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3345.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 113ms 2015-03-02T11:26:00.026-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.030-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.030-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.033-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.037-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.037-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.104-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.107-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (1298 records 13343948 bytes) is inconsistent with full validation results (560 records 5752880 bytes). Updating size storer with new values. 2015-03-02T11:26:00.108-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.108-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.111-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.113-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.114-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.116-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.117-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.118-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.124-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.125-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (560 records 5752880 bytes) is inconsistent with full validation results (561 records 5752926 bytes). Updating size storer with new values. 2015-03-02T11:26:00.125-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.126-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.130-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.131-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.132-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:00.139-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:00.140-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:00.141-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:02.818-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:26:02.896-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (5821 records 59788906 bytes) is inconsistent with full validation results (6561 records 67390926 bytes). Updating size storer with new values. 2015-03-02T11:26:02.896-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:26:02.898-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:26:03.836-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:26:03.900-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (6821 records 70061906 bytes) is inconsistent with full validation results (7561 records 77663926 bytes). Updating size storer with new values. 2015-03-02T11:26:03.900-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:26:03.908-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:26:04.551-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:26:05.496-0500 I NETWORK [conn2] end connection 10.4.127.218:59059 (2 connections now open) 2015-03-02T11:26:05.564-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59070 #6 (3 connections now open) 2015-03-02T11:26:08.414-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:26:10.772-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T11:26:12.170-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:26:12.370-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T11:26:14.566-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:26:14.571-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:14.577-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:26:15.077-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (31561 records 324215926 bytes) are inconsistent with full validation results (31484 records 323424905 bytes). Updating counters with new values. 2015-03-02T11:26:15.077-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (30821 records 316613906 bytes) is inconsistent with full validation results (31484 records 323424905 bytes). Updating size storer with new values. 2015-03-02T11:26:15.077-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:15.085-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:15.091-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 520ms 2015-03-02T11:26:15.096-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:15.217-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (31484 records 323424905 bytes) are inconsistent with full validation results (31561 records 324215926 bytes). Updating counters with new values. 2015-03-02T11:26:15.217-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (31484 records 323424905 bytes) is inconsistent with full validation results (31561 records 324215926 bytes). Updating size storer with new values. 2015-03-02T11:26:15.220-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:15.228-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:15.230-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 133ms 2015-03-02T11:26:15.237-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:15.357-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:15.360-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:15.362-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 125ms 2015-03-02T11:26:15.369-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:15.540-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:15.546-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:15.553-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 183ms 2015-03-02T11:26:15.559-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:15.657-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:15.661-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:15.664-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 104ms 2015-03-02T11:26:15.936-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:26:16.172-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:26:17.294-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:26:17.298-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:26:17.634-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (34561 records 355208957 bytes) are inconsistent with full validation results (34561 records 355180357 bytes). Updating counters with new values. 2015-03-02T11:26:17.635-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (34561 records 355207306 bytes) is inconsistent with full validation results (34561 records 355180357 bytes). Updating size storer with new values. 2015-03-02T11:26:17.635-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:26:17.644-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:26:17.654-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 356ms 2015-03-02T11:26:17.912-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T11:26:18.712-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4709.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39747 nscannedObjects:39747 nMatched:19874 nModified:19874 keyUpdates:1 writeConflicts:0 numYields:340 locks:{} 3045ms 2015-03-02T11:26:18.712-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4709.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3045ms 2015-03-02T11:26:18.719-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:26:18.905-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (35561 records 365537675 bytes) are inconsistent with full validation results (35561 records 365566275 bytes). Updating counters with new values. 2015-03-02T11:26:18.905-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35561 records 365529706 bytes) is inconsistent with full validation results (35561 records 365566275 bytes). Updating size storer with new values. 2015-03-02T11:26:18.905-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:26:18.920-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:26:18.934-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11678 locks:{} 214ms 2015-03-02T11:26:19.091-0500 I NETWORK [conn3] end connection 10.4.127.218:59060 (2 connections now open) 2015-03-02T11:26:19.123-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59076 #7 (3 connections now open) 2015-03-02T11:26:19.363-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 225ms 2015-03-02T11:26:19.367-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:26:49.029-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] MongoDB starting : pid=2530 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:26:49.042-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:26:49.042-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:26:49.090-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:26:49.143-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:26:50.534-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59086 #1 (1 connection now open) 2015-03-02T11:26:50.843-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59087 #2 (2 connections now open) 2015-03-02T11:26:55.129-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:26:55.810-0500 I NETWORK [conn2] end connection 10.4.127.218:59087 (1 connection now open) 2015-03-02T11:26:55.843-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59091 #3 (2 connections now open) 2015-03-02T11:26:55.873-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:26:56.775-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (49299 records 506592879 bytes) are inconsistent with full validation results (48299 records 496319879 bytes). Updating counters with new values. 2015-03-02T11:26:56.775-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (48300 records 496330152 bytes) is inconsistent with full validation results (48299 records 496319879 bytes). Updating size storer with new values. 2015-03-02T11:26:56.775-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:26:56.782-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:26:56.785-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 912ms 2015-03-02T11:26:56.790-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:26:56.964-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (48299 records 496319879 bytes) are incons2015-03-02T11:27:51.201-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] MongoDB starting : pid=2490 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:27:51.210-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:27:51.210-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:27:51.246-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:27:51.297-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:27:55.866-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59111 #1 (1 connection now open) 2015-03-02T11:27:57.228-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4771.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44244 nscannedObjects:44244 nMatched:22122 nModified:22122 keyUpdates:1 writeConflicts:0 numYields:345 locks:{} 1355ms 2015-03-02T11:27:57.228-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4771.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1355ms 2015-03-02T11:27:57.231-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:27:57.508-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:27:57.514-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:27:57.521-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 289ms 2015-03-02T11:27:57.529-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:27:57.601-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:27:57.605-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:27:57.614-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:27:57.683-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:27:57.686-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:27:59.131-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3536.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50726 nscannedObjects:50726 nMatched:25363 nModified:25363 keyUpdates:1 writeConflicts:0 numYields:396 locks:{} 1440ms 2015-03-02T11:27:59.131-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3536.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1440ms 2015-03-02T11:27:59.133-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:27:59.166-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59112 #2 (2 connections now open) 2015-03-02T11:27:59.252-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:27:59.256-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:27:59.270-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 137ms 2015-03-02T11:28:00.594-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59113 #3 (3 connections now open) 2015-03-02T11:28:01.338-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T11:28:02.069-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:28:02.705-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9504.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50726 nscannedObjects:50726 nMatched:25363 nModified:25363 keyUpdates:1 writeConflicts:0 numYields:404 locks:{} 2099ms 2015-03-02T11:28:02.706-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9504.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2100ms 2015-03-02T11:28:02.710-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:28:03.016-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:28:03.025-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:28:03.043-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 332ms 2015-03-02T11:28:03.056-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:28:03.336-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41983 records 431610838 bytes) are inconsistent with full validation results (41299 records 424584106 bytes). Updating counters with new values. 2015-03-02T11:28:03.336-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41452 records 426155875 bytes) is inconsistent with full validation results (41299 records 424584106 bytes). Updating size storer with new values. 2015-03-02T11:28:03.342-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:28:03.354-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:28:03.365-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 309ms 2015-03-02T11:28:03.367-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:28:03.383-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:28:03.560-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41615 records 427830374 bytes) are inconsistent with full validation results (42299 records 434857106 bytes). Updating counters with new values. 2015-03-02T11:28:03.560-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41381 records 425426492 bytes) is inconsistent with full validation results (42299 records 434857106 bytes). Updating size storer with new values. 2015-03-02T11:28:03.561-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:28:03.569-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:28:03.575-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 192ms 2015-03-02T11:28:03.709-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T11:28:05.394-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:28:05.592-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59116 #4 (4 connections now open) 2015-03-02T11:28:05.636-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:28:06.128-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:28:06.148-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:28:06.165-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 528ms 2015-03-02T11:28:06.611-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 6733.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50726 nscannedObjects:50726 nMatched:25363 nModified:25363 keyUpdates:1 writeConflicts:0 numYields:414 locks:{} 3032ms 2015-03-02T11:28:06.611-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6733.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3032ms 2015-03-02T11:28:06.615-0500 I NETWORK [conn3] end connection 10.4.127.218:59113 (3 connections now open) 2015-03-02T11:28:06.648-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T11:28:07.545-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:28:08.835-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8339.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50726 nscannedObjects:50726 nMatched:25363 nModified:25363 keyUpdates:1 writeConflicts:0 numYields:411 locks:{} 2660ms 2015-03-02T11:28:08.835-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8339.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2660ms 2015-03-02T11:28:08.843-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:28:09.264-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:28:09.270-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:28:09.274-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 430ms 2015-03-02T11:28:09.475-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:28:11.182-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:28:11.489-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (52726 records 541973677 bytes) is inconsistent with full validation results (53299 records 547860106 bytes). Updating size storer with new values. 2015-03-02T11:28:11.489-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:28:11.497-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:28:11.501-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 319ms 2015-03-02T11:28:11.516-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:28:11.836-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:28:11.842-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:28:11.853-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 337ms 2015-03-02T11:28:12.891-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:28:13.148-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:28:15.243-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 177ms 2015-03-02T11:28:15.258-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 186ms 2015-03-02T11:28:16.305-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 976.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:92982 nscannedObjects:92982 nMatched:46491 nModified:46491 keyUpdates:1 writeConflicts:0 numYields:750 locks:{} 4447ms 2015-03-02T11:28:16.305-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 976.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4447ms 2015-03-02T11:28:16.307-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:28:16.857-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:28:16.864-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:28:16.868-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 561ms 2015-03-02T11:28:16.891-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:28:17.186-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:28:17.196-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:28:17.201-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 309ms 2015-03-02T11:28:18.844-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:28:19.135-0500 I NETWORK [conn2] end connection 10.4.127.218:59112 (2 connections now open) 2015-03-02T11:28:19.173-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59118 #5 (3 connections now open) 2015-03-02T11:28:19.218-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (61235 records 629661298 bytes) is inconsistent with full validation results (61299 records 630318770 bytes). Updating size storer with new values. 2015-03-02T11:28:19.219-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:28:19.227-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:28:19.232-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 388ms 2015-03-02T11:28:19.256-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:28:19.266-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:28:19.518-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T11:28:19.626-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (62299 records 640591770 bytes) are inconsistent with full validation results (61299 records 630318770 bytes). Updating counters with new values. 2015-03-02T11:28:19.626-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (62235 records 639934298 bytes) is inconsistent with full validation results (61299 records 630318770 bytes). Updating size storer with new values. 2015-03-02T11:28:19.627-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:28:19.629-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:28:19.642-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:28:19.645-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:28:19.650-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 384ms 2015-03-02T11:28:19.651-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 395ms 2015-03-02T11:28:19.675-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:28:19.676-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:28:20.022-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (61299 records 630318770 bytes) are inconsistent with full validation results (62299 records 640591770 bytes). Updating counters with new values. 2015-03-02T11:28:20.023-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (61299 records 630318770 bytes) is inconsistent with full validation results (62299 records 640591770 bytes). Updating size storer with new values. 2015-03-02T11:28:20.023-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:28:20.026-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:28:20.034-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:28:20.037-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:28:20.042-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 366ms 2015-03-02T11:28:20.043-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 366ms 2015-03-02T11:28:20.054-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:28:20.320-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:28:20.328-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:28:20.331-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 276ms 2015-03-02T11:28:22.062-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:28:23.893-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:28:24.172-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T11:28:25.129-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 2025.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:102932 nscannedObjects:102932 nMatched:51466 nModified:51466 keyUpdates:1 writeConflicts:0 numYields:828 locks:{} 4794ms 2015-03-02T11:28:25.129-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2025.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4794ms 2015-03-02T11:28:25.133-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:28:25.752-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:28:25.761-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:28:25.777-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 644ms 2015-03-02T11:28:25.884-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59120 #6 (4 connections now open) 2015-03-02T11:28:25.889-0500 I NETWORK [conn1] end connection 10.4.127.218:59111 (3 connections now open) 2015-03-02T11:28:26.501-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T11:28:29.810-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:28:30.309-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 7627.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:77425 nscannedObjects:77425 nMatched:38932 nModified:38932 keyUpdates:1 writeConflicts:258 numYields:627 locks:{} 4402ms 2015-03-02T11:28:30.310-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7627.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4402ms 2015-03-02T11:28:30.314-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:28:30.700-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (17281 records 177562297 bytes) are inconsistent with full validation results (22661 records 232900977 bytes). Updating counters with new values. 2015-03-02T11:28:30.700-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (17825 records 183157881 bytes) is inconsistent with full validation results (22661 records 232900977 bytes). Updating size storer with new values. 2015-03-02T11:28:30.700-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:28:30.711-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:28:30.721-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 407ms 2015-03-02T11:28:30.734-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:29:00.665-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:29:00.674-0500 I CONTROL [initandlisten] MongoDB starting : pid=2496 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:29:00.674-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:29:00.674-0500 I CONTROL [initandlisten] 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:29:00.675-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:29:00.675-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:29:00.715-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:29:00.751-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:29:02.526-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59130 #1 (1 connection now open) 2015-03-02T11:29:02.535-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:29:02.698-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59131 #2 (2 connections now open) 2015-03-02T11:29:02.911-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:29:02.916-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:29:02.919-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 214ms 2015-03-02T11:29:02.920-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 383ms 2015-03-02T11:29:05.550-0500 I NETWORK [conn1] end connection 10.4.127.218:59130 (1 connection now open) 2015-03-02T11:29:05.594-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59132 #3 (2 connections now open) 2015-03-02T11:29:05.893-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59133 #4 (3 connections now open) 2015-03-02T11:29:05.914-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:06.227-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434772333 bytes) are inconsistent with full validation results (42299 records 434744136 bytes). Updating counters with new values. 2015-03-02T11:29:06.227-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42299 records 434759892 bytes) is inconsistent with full validation results (42299 records 434744136 bytes). Updating size storer with new values. 2015-03-02T11:29:06.227-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:06.238-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:06.249-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 335ms 2015-03-02T11:29:06.270-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:06.450-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434762973 bytes) are inconsistent with full validation results (42299 records 434775427 bytes). Updating counters with new values. 2015-03-02T11:29:06.450-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42299 records 434757695 bytes) is inconsistent with full validation results (42299 records 434775427 bytes). Updating size storer with new values. 2015-03-02T11:29:06.450-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:06.463-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:06.469-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 199ms 2015-03-02T11:29:06.494-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:06.679-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434796175 bytes) are inconsistent with full validation results (42299 records 434795213 bytes). Updating counters with new values. 2015-03-02T11:29:06.679-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42299 records 434796149 bytes) is inconsistent with full validation results (42299 records 434795213 bytes). Updating size storer with new values. 2015-03-02T11:29:06.679-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:06.683-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:06.692-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 198ms 2015-03-02T11:29:07.505-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T11:29:08.204-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T11:29:08.738-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2918.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53362 nscannedObjects:53362 nMatched:26681 nModified:26681 keyUpdates:1 writeConflicts:0 numYields:437 locks:{} 3138ms 2015-03-02T11:29:08.738-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2918.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3138ms 2015-03-02T11:29:08.745-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:29:09.035-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (44299 records 455403535 bytes) are inconsistent with full validation results (44299 records 455420240 bytes). Updating counters with new values. 2015-03-02T11:29:09.035-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (44299 records 455403535 bytes) is inconsistent with full validation results (44299 records 455420240 bytes). Updating size storer with new values. 2015-03-02T11:29:09.035-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:29:09.044-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:29:09.051-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 305ms 2015-03-02T11:29:09.060-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:29:09.238-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (45035 records 462981168 bytes) are inconsistent with full validation results (44299 records 455420240 bytes). Updating counters with new values. 2015-03-02T11:29:09.241-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (44619 records 458707600 bytes) is inconsistent with full validation results (44299 records 455420240 bytes). Updating size storer with new values. 2015-03-02T11:29:09.241-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:29:09.253-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:29:09.255-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 195ms 2015-03-02T11:29:09.257-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:29:09.273-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:29:09.483-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (44506 records 457546751 bytes) are inconsistent with full validation results (45299 records 465693240 bytes). Updating counters with new values. 2015-03-02T11:29:09.483-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (44299 records 455420240 bytes) is inconsistent with full validation results (45299 records 465693240 bytes). Updating size storer with new values. 2015-03-02T11:29:09.483-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:29:09.501-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:29:09.512-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 239ms 2015-03-02T11:29:09.527-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:29:09.671-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (46299 records 475966240 bytes) are inconsistent with full validation results (45605 records 468836778 bytes). Updating counters with new values. 2015-03-02T11:29:09.671-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (45619 records 468980600 bytes) is inconsistent with full validation results (45605 records 468836778 bytes). Updating size storer with new values. 2015-03-02T11:29:09.671-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:29:09.678-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:29:09.683-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 155ms 2015-03-02T11:29:10.604-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 5783.0 } } ndeleted:26681 keyUpdates:0 writeConflicts:0 numYields:208 locks:{} 918ms 2015-03-02T11:29:10.604-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5783.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 918ms 2015-03-02T11:29:10.609-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:29:10.762-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (18924 records 194406252 bytes) are inconsistent with full validation results (19618 records 201535714 bytes). Updating counters with new values. 2015-03-02T11:29:10.762-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (19285 records 198109258 bytes) is inconsistent with full validation results (19618 records 201535714 bytes). Updating size storer with new values. 2015-03-02T11:29:10.762-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:29:10.774-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:29:10.781-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 171ms 2015-03-02T11:29:10.789-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:29:10.910-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (20279 records 208326167 bytes) are inconsistent with full validation results (19618 records 201535714 bytes). Updating counters with new values. 2015-03-02T11:29:10.910-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20257 records 208100161 bytes) is inconsistent with full validation results (19618 records 201535714 bytes). Updating size storer with new values. 2015-03-02T11:29:10.910-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:29:10.919-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:29:10.921-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 131ms 2015-03-02T11:29:13.203-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:29:14.874-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:29:15.986-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:16.119-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:29:16.359-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (32957 records 338567261 bytes) are inconsistent with full validation results (32618 records 335084714 bytes). Updating counters with new values. 2015-03-02T11:29:16.359-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32596 records 334858708 bytes) is inconsistent with full validation results (32618 records 335084714 bytes). Updating size storer with new values. 2015-03-02T11:29:16.360-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:16.364-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:16.367-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 381ms 2015-03-02T11:29:16.553-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 6385.0 } } ndeleted:4230 keyUpdates:0 writeConflicts:0 numYields:33 locks:{} 180ms 2015-03-02T11:29:16.553-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6385.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T11:29:16.556-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:16.716-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (29166 records 299622318 bytes) are inconsistent with full validation results (29388 records 301902924 bytes). Updating counters with new values. 2015-03-02T11:29:16.716-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (28797 records 295831581 bytes) is inconsistent with full validation results (29388 records 301902924 bytes). Updating size storer with new values. 2015-03-02T11:29:16.716-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:16.733-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:16.734-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:29:16.745-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 189ms 2015-03-02T11:29:16.752-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:16.877-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (29610 records 304183530 bytes) are inconsistent with full validation results (30388 records 312175924 bytes). Updating counters with new values. 2015-03-02T11:29:16.877-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (29388 records 301902924 bytes) is inconsistent with full validation results (30388 records 312175924 bytes). Updating size storer with new values. 2015-03-02T11:29:16.878-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:16.882-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:16.886-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 134ms 2015-03-02T11:29:17.390-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4004.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11524 nscannedObjects:11524 nMatched:5762 nModified:5762 keyUpdates:1 writeConflicts:0 numYields:92 locks:{} 493ms 2015-03-02T11:29:17.390-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4004.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 493ms 2015-03-02T11:29:17.396-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:17.523-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (30388 records 312246241 bytes) is inconsistent with full validation results (30388 records 312250830 bytes). Updating size storer with new values. 2015-03-02T11:29:17.523-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:17.527-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:17.532-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 135ms 2015-03-02T11:29:18.135-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:29:18.858-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1832.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31064 nscannedObjects:31064 nMatched:15532 nModified:15532 keyUpdates:1 writeConflicts:0 numYields:247 locks:{} 1317ms 2015-03-02T11:29:18.864-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1832.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1324ms 2015-03-02T11:29:18.867-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:18.995-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:18.999-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:19.008-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 140ms 2015-03-02T11:29:19.155-0500 I NETWORK [conn2] end connection 10.4.127.218:59131 (2 connections now open) 2015-03-02T11:29:19.189-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59135 #5 (3 connections now open) 2015-03-02T11:29:19.211-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:19.366-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (26100 records 268258472 bytes) are inconsistent with full validation results (28109 records 288923046 bytes). Updating counters with new values. 2015-03-02T11:29:19.366-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26273 records 270037950 bytes) is inconsistent with full validation results (28109 records 288923046 bytes). Updating size storer with new values. 2015-03-02T11:29:19.367-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:19.373-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:19.381-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 170ms 2015-03-02T11:29:20.224-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 7854.0 } } ndeleted:16532 keyUpdates:0 writeConflicts:0 numYields:131 locks:{} 1214ms 2015-03-02T11:29:20.224-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7854.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1214ms 2015-03-02T11:29:20.230-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:20.234-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1253.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9713 nscannedObjects:9713 nMatched:3642 nModified:3642 keyUpdates:1 writeConflicts:4822 numYields:83 locks:{} 848ms 2015-03-02T11:29:20.236-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1253.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 850ms 2015-03-02T11:29:20.240-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:20.340-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (17865 records 183600608 bytes) are inconsistent with full validation results (15856 records 162936034 bytes). Updating counters with new values. 2015-03-02T11:29:20.340-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17924 records 184207482 bytes) is inconsistent with full validation results (15856 records 162936034 bytes). Updating size storer with new values. 2015-03-02T11:29:20.341-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:20.343-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:20.351-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:20.352-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:20.354-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 124ms 2015-03-02T11:29:20.357-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 116ms 2015-03-02T11:29:20.362-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:20.437-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:20.442-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:20.883-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8465.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7657 nscannedObjects:7657 nMatched:3642 nModified:3642 keyUpdates:1 writeConflicts:194 numYields:62 locks:{} 524ms 2015-03-02T11:29:20.883-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8465.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 524ms 2015-03-02T11:29:20.885-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:20.888-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T11:29:20.986-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16856 records 173209034 bytes) are inconsistent with full validation results (16844 records 173085758 bytes). Updating counters with new values. 2015-03-02T11:29:20.986-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16856 records 173209034 bytes) is inconsistent with full validation results (16844 records 173085758 bytes). Updating size storer with new values. 2015-03-02T11:29:20.987-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:20.995-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:21.007-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 121ms 2015-03-02T11:29:21.215-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 9501.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7284 nscannedObjects:7284 nMatched:3642 nModified:3642 keyUpdates:1 writeConflicts:1968 numYields:66 locks:{} 766ms 2015-03-02T11:29:21.216-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9501.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 766ms 2015-03-02T11:29:21.219-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:21.334-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (14490 records 148885514 bytes) are inconsistent with full validation results (15398 records 158225046 bytes). Updating counters with new values. 2015-03-02T11:29:21.334-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (15187 records 156054856 bytes) is inconsistent with full validation results (15398 records 158225046 bytes). Updating size storer with new values. 2015-03-02T11:29:21.334-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:21.346-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:21.351-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11677 locks:{} 131ms 2015-03-02T11:29:21.521-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 1352.0 } } ndeleted:3642 keyUpdates:0 writeConflicts:1 numYields:37 locks:{} 509ms 2015-03-02T11:29:21.521-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1352.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 509ms 2015-03-02T11:29:21.527-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:21.531-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6322.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:950 nscannedObjects:950 nMatched:1 nModified:1 upsert:1 keyUpdates:0 writeConflicts:1884 numYields:10 locks:{} 176ms 2015-03-02T11:29:21.531-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6322.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:106 locks:{} 177ms 2015-03-02T11:29:21.533-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:21.603-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13111 records 134690724 bytes) are inconsistent with full validation results (12214 records 125474422 bytes). Updating counters with new values. 2015-03-02T11:29:21.603-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14095 records 144822388 bytes) is inconsistent with full validation results (12214 records 125474422 bytes). Updating size storer with new values. 2015-03-02T11:29:21.603-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:21.604-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (12214 records 125474422 bytes) are inconsistent with full validation results (12215 records 125474468 bytes). Updating counters with new values. 2015-03-02T11:29:21.604-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (12214 records 125474422 bytes) is inconsistent with full validation results (12215 records 125474468 bytes). Updating size storer with new values. 2015-03-02T11:29:21.604-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:21.608-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:21.610-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:21.615-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:21.618-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:29:21.687-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:21.690-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:29:21.691-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:21.694-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:29:21.697-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:21.739-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:21.740-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:21.751-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:21.794-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (12215 records 125474468 bytes) is inconsistent with full validation results (12214 records 125474422 bytes). Updating size storer with new values. 2015-03-02T11:29:21.794-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:21.796-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:23.471-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:29:25.002-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:29:25.859-0500 I NETWORK [conn4] end connection 10.4.127.218:59133 (2 connections now open) 2015-03-02T11:29:25.916-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59137 #6 (3 connections now open) 2015-03-02T11:29:26.132-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:29:26.167-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 5882.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4236 nscannedObjects:4236 nMatched:2118 nModified:2118 keyUpdates:1 writeConflicts:0 numYields:34 locks:{} 238ms 2015-03-02T11:29:26.167-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5882.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 238ms 2015-03-02T11:29:26.175-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:29:26.337-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (22214 records 228230591 bytes) is inconsistent with full validation results (22214 records 228231956 bytes). Updating size storer with new values. 2015-03-02T11:29:26.337-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:29:26.341-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:29:26.344-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 168ms 2015-03-02T11:29:26.356-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:29:26.424-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:29:26.435-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:29:26.452-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:29:26.513-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:29:26.516-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:29:26.531-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:29:26.593-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:29:26.596-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:29:27.438-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:29:29.335-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:29:29.488-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (28109 records 288791291 bytes) is inconsistent with full validation results (28214 records 289869956 bytes). Updating size storer with new values. 2015-03-02T11:29:29.488-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:29:29.492-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:29:29.494-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T11:29:30.000-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:29:31.161-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T11:29:32.299-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T11:29:34.384-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T11:29:34.521-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:34.809-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (42109 records 432613291 bytes) is inconsistent with full validation results (42214 records 433691956 bytes). Updating size storer with new values. 2015-03-02T11:29:34.809-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:34.820-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:34.827-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 306ms 2015-03-02T11:29:34.838-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:29:34.987-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:29:35.006-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:29:35.021-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 182ms 2015-03-02T11:29:35.577-0500 I NETWORK [conn3] end connection 10.4.127.218:59132 (2 connections now open) 2015-03-02T11:29:35.617-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59142 #7 (3 connections now open) 2015-03-02T11:29:35.824-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T11:29:36.590-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 164ms 2015-03-02T11:29:37.363-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 176ms 2015-03-02T11:29:37.365-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:29:37.698-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:29:37.718-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:29:37.742-0500 I WRITE [conn7] update test.foo query: { x: { $gte: 5000.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28000 nscannedObjects:28000 nMatched:14000 nModified:14000 keyUpdates:1 writeConflicts:0 numYields:233 lock2015-03-02T11:30:13.498-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] MongoDB starting : pid=2501 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:30:13.511-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:30:13.511-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:30:13.549-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:30:13.597-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:30:15.263-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59152 #1 (1 connection now open) 2015-03-02T11:30:15.560-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59153 #2 (2 connections now open) 2015-03-02T11:30:15.572-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:30:16.174-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:30:16.180-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:30:16.184-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 610ms 2015-03-02T11:30:16.314-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:30:17.199-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9642.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24484 nscannedObjects:24484 nMatched:12242 nModified:12242 keyUpdates:1 writeConflicts:0 numYields:194 locks:{} 1008ms 2015-03-02T11:30:17.199-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9642.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1008ms 2015-03-02T11:30:17.202-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:30:17.304-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:30:17.308-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-032015-03-02T11:31:14.668-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:31:14.677-0500 I CONTROL [initandlisten] MongoDB starting : pid=2491 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:31:14.677-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:31:14.677-0500 I CONTROL [initandlisten] 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:31:14.678-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:31:14.678-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:31:14.731-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:31:14.774-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:31:16.712-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59168 #1 (1 connection now open) 2015-03-02T11:31:16.723-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:31:17.120-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:31:17.125-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:31:17.128-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 404ms 2015-03-02T11:31:19.203-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59169 #2 (2 connections now open) 2015-03-02T11:31:19.211-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:31:19.316-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (38300 records 393600152 bytes) is inconsistent with full validation results (39299 records 403862879 bytes). Updating size storer with new values. 2015-03-02T11:31:19.316-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:31:19.321-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:31:19.330-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 119ms 2015-03-02T11:31:20.919-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59170 #3 (3 connections now open) 2015-03-02T11:31:23.532-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12015-03-02T11:32:20.019-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] MongoDB starting : pid=2495 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:32:20.027-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:32:20.027-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:32:20.064-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:32:20.134-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:32:20.646-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59188 #1 (1 connection now open) 2015-03-02T11:32:20.673-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:21.414-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:21.419-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:21.422-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 748ms 2015-03-02T11:32:21.426-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:21.488-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:21.492-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:21.645-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59190 #2 (2 connections now open) 2015-03-02T11:32:22.958-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4411.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:26526 nscannedObjects:26526 nMatched:13223 nModified:13223 keyUpdates:1 writeConflicts:137 numYields:209 locks:{} 1300ms 2015-03-02T11:32:22.958-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4411.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1300ms 2015-03-02T11:32:22.961-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:32:23.041-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (7345 records 75466312 bytes) are inconsistent with full validation results (8930 records 91769562 bytes). Updating counters with new values. 2015-03-02T11:32:23.041-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7541 records 77482368 bytes) is inconsistent with full validation results (8930 records 91769562 bytes). Updating size storer with new values. 2015-03-02T11:32:23.041-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:32:23.052-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:32:23.090-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 951.0 } } ndeleted:0 keyUpdates:0 writeConflicts:64 numYields:215 locks:{} 1592ms 2015-03-02T11:32:23.090-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 951.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1592ms 2015-03-02T11:32:23.091-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:32:23.093-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.117-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (7291 records 74921048 bytes) are inconsistent with full validation results (5706 records 58617738 bytes). Updating counters with new values. 2015-03-02T11:32:23.117-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (8126 records 83499618 bytes) is inconsistent with full validation results (5706 records 58617738 bytes). Updating size storer with new values. 2015-03-02T11:32:23.118-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:32:23.119-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.121-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.123-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:32:23.127-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.130-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:32:23.151-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (5706 records 58617738 bytes) is inconsistent with full validation results (5707 records 58617784 bytes). Updating size storer with new values. 2015-03-02T11:32:23.152-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.153-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.154-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:32:23.155-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:32:23.159-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.162-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:32:23.180-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:32:23.180-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:32:23.182-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.183-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.186-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.199-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.200-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.203-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.213-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.214-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.217-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.231-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.232-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.235-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.245-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5707 records 58617784 bytes) is inconsistent with full validation results (5706 records 58617738 bytes). Updating size storer with new values. 2015-03-02T11:32:23.246-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.247-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.250-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.264-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.265-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.269-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.279-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.280-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.283-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.296-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.297-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.301-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.314-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.315-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.318-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.330-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.331-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.335-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.346-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.348-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.359-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.376-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5706 records 58617738 bytes) is inconsistent with full validation results (5707 records 58617784 bytes). Updating size storer with new values. 2015-03-02T11:32:23.376-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.377-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.386-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.407-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.408-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.417-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.437-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5707 records 58617784 bytes) is inconsistent with full validation results (5706 records 58617738 bytes). Updating size storer with new values. 2015-03-02T11:32:23.437-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.438-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.445-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.459-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.460-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.463-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.473-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.474-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.599-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 619.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3984 nscannedObjects:3984 nMatched:1992 nModified:1992 keyUpdates:1 writeConflicts:0 numYields:31 locks:{} 123ms 2015-03-02T11:32:23.599-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 619.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 123ms 2015-03-02T11:32:23.603-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.616-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5706 records 58632805 bytes) is inconsistent with full validation results (5706 records 58643634 bytes). Updating size storer with new values. 2015-03-02T11:32:23.616-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.617-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.621-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.631-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.632-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.635-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.647-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.648-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:23.793-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4302.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3984 nscannedObjects:3984 nMatched:1992 nModified:1992 keyUpdates:1 writeConflicts:0 numYields:31 locks:{} 141ms 2015-03-02T11:32:23.793-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4302.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 141ms 2015-03-02T11:32:23.795-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:23.809-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:23.810-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:24.015-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2052.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3984 nscannedObjects:3984 nMatched:1992 nModified:1992 keyUpdates:1 writeConflicts:0 numYields:31 locks:{} 197ms 2015-03-02T11:32:24.016-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2052.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 197ms 2015-03-02T11:32:24.020-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:24.034-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:24.035-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:24.147-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 5619.0 } } ndeleted:1992 keyUpdates:0 writeConflicts:0 numYields:15 locks:{} 104ms 2015-03-02T11:32:24.148-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5619.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:32:24.153-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:24.172-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (4523 records 46475296 bytes) is inconsistent with full validation results (3714 records 38153922 bytes). Updating size storer with new values. 2015-03-02T11:32:24.172-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:24.175-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:24.184-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:24.197-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:24.198-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:24.204-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:24.217-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (3714 records 38153922 bytes) is inconsistent with full validation results (3715 records 38153968 bytes). Updating size storer with new values. 2015-03-02T11:32:24.217-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:24.218-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:24.223-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:24.230-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:24.231-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:25.893-0500 I NETWORK [conn2] end connection 10.4.127.218:59190 (1 connection now open) 2015-03-02T11:32:25.939-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59191 #3 (2 connections now open) 2015-03-02T11:32:26.035-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:26.071-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (7715 records 79248438 bytes) is inconsistent with full validation results (7715 records 79255302 bytes). Updating size storer with new values. 2015-03-02T11:32:26.071-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:26.072-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:26.098-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:26.115-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (7244 records 74410596 bytes) is inconsistent with full validation results (6996 records 71869908 bytes). Updating size storer with new values. 2015-03-02T11:32:26.115-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:26.117-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:26.124-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:26.137-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6996 records 71869908 bytes) is inconsistent with full validation results (6997 records 71869954 bytes). Updating size storer with new values. 2015-03-02T11:32:26.137-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:26.138-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:26.142-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:26.156-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:26.158-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:26.164-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:26.178-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:26.179-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:29.249-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59192 #4 (3 connections now open) 2015-03-02T11:32:29.326-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:32:29.442-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12747 records 130939704 bytes) is inconsistent with full validation results (12997 records 133515312 bytes). Updating size storer with new values. 2015-03-02T11:32:29.442-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:32:29.444-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:32:29.445-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 118ms 2015-03-02T11:32:29.493-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:32:29.541-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (12361 records 126984553 bytes) are inconsistent with full validation results (12275 records 126101075 bytes). Updating counters with new values. 2015-03-02T11:32:29.541-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12814 records 131634989 bytes) is inconsistent with full validation results (12275 records 126101075 bytes). Updating size storer with new values. 2015-03-02T11:32:29.541-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:32:29.547-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:32:29.556-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:32:29.601-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13189 records 135490597 bytes) are inconsistent with full validation results (12632 records 129768536 bytes). Updating counters with new values. 2015-03-02T11:32:29.601-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12650 records 129953450 bytes) is inconsistent with full validation results (12632 records 129768536 bytes). Updating size storer with new values. 2015-03-02T11:32:29.602-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:32:29.604-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:32:29.611-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:32:29.707-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13061 records 134175653 bytes) are inconsistent with full validation results (13275 records 136374075 bytes). Updating counters with new values. 2015-03-02T11:32:29.708-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12632 records 129768536 bytes) is inconsistent with full validation results (13275 records 136374075 bytes). Updating size storer with new values. 2015-03-02T11:32:29.708-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:32:29.714-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:32:29.716-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T11:32:29.725-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:32:29.761-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T11:32:29.784-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13846 records 142239958 bytes) are inconsistent with full validation results (13932 records 143123436 bytes). Updating counters with new values. 2015-03-02T11:32:29.784-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13307 records 136702811 bytes) is inconsistent with full validation results (13932 records 143123436 bytes). Updating size storer with new values. 2015-03-02T11:32:29.784-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:32:29.787-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:32:31.985-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:32.115-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (18932 records 194488436 bytes) are inconsistent with full validation results (19275 records 198012075 bytes). Updating counters with new values. 2015-03-02T11:32:32.115-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18393 records 188951289 bytes) is inconsistent with full validation results (19275 records 198012075 bytes). Updating size storer with new values. 2015-03-02T11:32:32.115-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:32.118-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:32.119-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 134ms 2015-03-02T11:32:32.132-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:32.204-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:32.206-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:32.232-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:32:32.292-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:32:32.295-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:32:35.521-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:32:35.612-0500 I NETWORK [conn1] end connection 10.4.127.218:59188 (2 connections now open) 2015-03-02T11:32:35.645-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59193 #5 (3 connections now open) 2015-03-02T11:32:35.651-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:35.838-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26736 records 274658928 bytes) is inconsistent with full validation results (27275 records 280196075 bytes). Updating size storer with new values. 2015-03-02T11:32:35.838-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:35.842-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:35.846-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 194ms 2015-03-02T11:32:35.852-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:35.925-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:35.928-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:35.934-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:36.017-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:36.021-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:36.943-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 2284.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24286 nscannedObjects:24286 nMatched:12143 nModified:12143 keyUpdates:1 writeConflicts:0 numYields:193 locks:{} 912ms 2015-03-02T11:32:36.943-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2284.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 912ms 2015-03-02T11:32:36.946-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:37.033-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (27275 records 280345068 bytes) is inconsistent with full validation results (27275 records 280353934 bytes). Updating size storer with new values. 2015-03-02T11:32:37.033-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:37.049-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:37.064-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 117ms 2015-03-02T11:32:37.563-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:32:37.595-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 4847.0 } } ndeleted:12143 keyUpdates:0 writeConflicts:0 numYields:95 locks:{} 528ms 2015-03-02T11:32:37.595-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4847.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 528ms 2015-03-02T11:32:37.600-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:37.704-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17747 records 182324291 bytes) is inconsistent with full validation results (17132 records 175997036 bytes). Updating size storer with new values. 2015-03-02T11:32:37.705-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:37.712-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:37.717-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T11:32:37.729-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:37.777-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:37.779-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:38.710-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 476.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:23792 nscannedObjects:23792 nMatched:11896 nModified:11896 keyUpdates:1 writeConflicts:0 numYields:189 locks:{} 926ms 2015-03-02T11:32:38.710-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 476.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 926ms 2015-03-02T11:32:38.713-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:38.769-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17132 records 176142311 bytes) is inconsistent with full validation results (17132 records 176151684 bytes). Updating size storer with new values. 2015-03-02T11:32:38.769-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:38.771-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:38.780-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:38.850-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:38.853-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:40.770-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:32:42.322-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:32:44.259-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:44.666-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (30132 records 309700684 bytes) are inconsistent with full validation results (29132 records 299427684 bytes). Updating counters with new values. 2015-03-02T11:32:44.666-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (29411 records 302293851 bytes) is inconsistent with full validation results (29132 records 299427684 bytes). Updating size storer with new values. 2015-03-02T11:32:44.666-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:44.669-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:44.671-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 412ms 2015-03-02T11:32:45.343-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T11:32:45.346-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:32:45.563-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (30132 records 309791749 bytes) are inconsistent with full validation results (31132 records 320064749 bytes). Updating counters with new values. 2015-03-02T11:32:45.563-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (30132 records 309791749 bytes) is inconsistent with full validation results (31132 records 320064749 bytes). Updating size storer with new values. 2015-03-02T11:32:45.567-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:32:45.581-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:32:45.590-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 243ms 2015-03-02T11:32:46.203-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T11:32:46.668-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5995.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:37802 nscannedObjects:37802 nMatched:18901 nModified:18901 keyUpdates:1 writeConflicts:0 numYields:308 locks:{} 1994ms 2015-03-02T11:32:46.668-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5995.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1994ms 2015-03-02T11:32:46.669-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:46.793-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:46.797-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:46.805-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 135ms 2015-03-02T11:32:46.818-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:46.950-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:46.961-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:46.964-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 146ms 2015-03-02T11:32:46.988-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:32:47.088-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:32:47.102-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:32:47.108-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 120ms 2015-03-02T11:32:49.228-0500 I NETWORK [conn4] end connection 10.4.127.218:59192 (2 connections now open) 2015-03-02T11:32:49.269-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59195 #6 (3 connections now open) 2015-03-02T11:32:49.685-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:32:50.255-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:32:51.396-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T11:32:51.612-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:52.334-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (42510 records 436950943 bytes) is inconsistent with full validation results (43132 records 443340749 bytes). Updating size storer with new values. 2015-03-02T11:32:52.334-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:52.353-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:52.357-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 745ms 2015-03-02T11:32:52.367-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:52.552-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:52.564-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:52.569-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 202ms 2015-03-02T11:32:52.957-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T11:32:53.613-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:32:53.875-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 6180.0 } } ndeleted:23721 keyUpdates:0 writeConflicts:0 numYields:188 locks:{} 1304ms 2015-03-02T11:32:53.876-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6180.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1304ms 2015-03-02T11:32:53.880-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:54.043-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21754 records 223483301 bytes) is inconsistent with full validation results (21411 records 219955203 bytes). Updating size storer with new values. 2015-03-02T11:32:54.044-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:54.064-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:54.083-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 203ms 2015-03-02T11:32:54.268-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 5162.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3702 nscannedObjects:3702 nMatched:1851 nModified:1851 keyUpdates:1 writeConflicts:0 numYields:30 locks:{} 178ms 2015-03-02T11:32:54.268-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5162.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 178ms 2015-03-02T11:32:54.270-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:32:54.348-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21411 records 219976744 bytes) is inconsistent with full validation results (21411 records 219979266 bytes). Updating size storer with new values. 2015-03-02T11:32:54.348-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:32:54.351-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:32:55.296-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:32:55.919-0500 I NETWORK [conn3] end connection 10.4.127.218:59191 (2 connections now open) 2015-03-02T11:32:55.958-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59199 #7 (3 connections now open) 2015-03-02T11:32:55.969-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:32:56.261-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (25217 records 259078304 bytes) is inconsistent with full validation results (25411 records 261071266 bytes). Updating size storer with new values. 2015-03-02T11:32:56.261-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:32:56.275-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:32:56.283-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 313ms 2015-03-02T11:33:36.922-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] MongoDB starting : pid=2551 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:33:36.935-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:33:36.936-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:33:36.989-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:33:37.033-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:33:37.741-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59224 #1 (1 connection now open) 2015-03-02T11:33:37.756-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:33:38.535-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:33:38.543-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:33:38.546-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 789ms 2015-03-02T11:33:38.557-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:33:38.658-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:33:38.664-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:33:38.668-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 111ms 2015-03-02T11:33:38.675-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:33:38.754-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:33:38.758-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:33:38.766-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:33:38.843-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:33:38.847-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:33:38.858-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:33:38.932-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:33:38.937-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:33:38.948-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:33:39.031-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:33:39.035-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:33:44.192-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59226 #2 (2 connections now open) 2015-03-02T11:33:45.304-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:33:45.537-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59227 #3 (3 connections now open) 2015-03-02T11:33:45.649-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (48299 records 496319879 bytes) are inconsistent with full validation results (47299 records 486046879 bytes). Updating counters with new values. 2015-03-02T11:33:45.649-0500 W STORAGE [conn1] table:collection2015-03-02T11:34:43.005-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:34:43.023-0500 I CONTROL [initandlisten] MongoDB starting : pid=2613 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:34:43.023-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:34:43.023-0500 I CONTROL [initandlisten] 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:34:43.024-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:34:43.024-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:34:43.061-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:34:43.119-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:34:44.319-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59264 #1 (1 connection now open) 2015-03-02T11:34:45.220-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 3386.0 } } ndeleted:25663 keyUpdates:0 writeConflicts:0 numYields:200 locks:{} 894ms 2015-03-02T11:34:45.220-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3386.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 894ms 2015-03-02T11:34:45.223-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:34:45.338-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (12298 records 126335720 bytes) is inconsistent with full validation results (11636 records 119536628 bytes). Updating size storer with new values. 2015-03-02T11:34:45.339-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:34:45.342-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:34:45.346-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T11:34:45.349-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:34:45.377-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:34:45.379-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:34:45.704-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59265 #2 (2 connections now open) 2015-03-02T11:34:49.307-0500 I NETWORK [conn1] end connection 10.4.127.218:59264 (1 connection now open) 2015-03-02T11:34:49.328-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59269 #3 (2 connections now open) 2015-03-02T11:34:49.359-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:34:49.506-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (19974 records 205192902 bytes) is inconsistent with full validation results (20636 records 211995305 bytes). Updating size storer with new values. 2015-03-02T11:34:49.506-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:34:49.510-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:34:49.513-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 153ms 2015-03-02T11:34:49.520-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:34:49.584-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:34:49.589-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:34:49.602-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:34:49.670-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20636 records 211995305 bytes) is inconsistent with full validation results (20507 records 210668411 bytes). Updating size storer with new values. 2015-03-02T11:34:49.670-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:34:49.674-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:34:49.681-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:34:49.752-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:34:49.756-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:34:51.026-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59270 #4 (3 connections now open) 2015-03-02T11:34:51.058-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:34:51.216-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (22508 records 231214457 bytes) are inconsistent with full validation results (22039 records 226396420 bytes). Updating counters with new values. 2015-03-02T11:34:51.216-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21587 records 221763251 bytes) is inconsistent with full validation results (22039 records 226396420 bytes). Updating size storer with new values. 2015-03-02T11:34:51.217-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:34:51.221-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:34:51.224-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 165ms 2015-03-02T11:34:56.009-0500 I NETWORK [conn4] end connection 10.4.127.218:59270 (2 connections now open) 2015-03-02T11:34:56.019-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59271 #5 (3 connections now open) 2015-03-02T11:35:00.620-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:00.789-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:35:01.279-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (42039 records 431856420 bytes) are inconsistent with full validation results (41508 records 426401457 bytes). Updating counters with new values. 2015-03-02T11:35:01.279-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41118 records 422394987 bytes) is inconsistent with full validation results (41508 records 426401457 bytes). Updating size storer with new values. 2015-03-02T11:35:01.279-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:01.285-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:01.290-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 669ms 2015-03-02T11:35:01.303-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:01.413-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41508 records 426401457 bytes) are inconsistent with full validation results (42508 records 436674457 bytes). Updating counters with new values. 2015-03-02T11:35:01.413-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41508 records 426401457 bytes) is inconsistent with full validation results (42508 records 436674457 bytes). Updating size storer with new values. 2015-03-02T11:35:01.413-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:01.419-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:01.423-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 120ms 2015-03-02T11:35:01.588-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8671.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3318 nscannedObjects:3318 nMatched:1659 nModified:1659 keyUpdates:1 writeConflicts:0 numYields:26 locks:{} 163ms 2015-03-02T11:35:01.588-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8671.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 163ms 2015-03-02T11:35:01.590-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:01.720-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (42508 records 436688484 bytes) is inconsistent with full validation results (42508 records 436696011 bytes). Updating size storer with new values. 2015-03-02T11:35:01.720-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:01.726-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:01.730-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 140ms 2015-03-02T11:35:01.738-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:01.918-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:01.929-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:01.943-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 205ms 2015-03-02T11:35:01.947-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:02.158-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:35:02.163-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:35:02.176-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (43508 records 446969011 bytes) are inconsistent with full validation results (42508 records 436696011 bytes). Updating counters with new values. 2015-03-02T11:35:02.176-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (42928 records 441010671 bytes) is inconsistent with full validation results (42508 records 436696011 bytes). Updating size storer with new values. 2015-03-02T11:35:02.177-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:02.189-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:02.198-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 250ms 2015-03-02T11:35:02.219-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:02.392-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42508 records 436696011 bytes) are inconsistent with full validation results (43508 records 446969011 bytes). Updating counters with new values. 2015-03-02T11:35:02.393-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42508 records 436696011 bytes) is inconsistent with full validation results (43508 records 446969011 bytes). Updating size storer with new values. 2015-03-02T11:35:02.393-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:35:02.402-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:35:02.409-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 245ms 2015-03-02T11:35:02.447-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:02.458-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:02.462-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 242ms 2015-03-02T11:35:02.477-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:02.669-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:02.678-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:02.682-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 205ms 2015-03-02T11:35:02.707-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:02.896-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:02.918-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:02.927-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 219ms 2015-03-02T11:35:03.176-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9459.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4400 nscannedObjects:4400 nMatched:2200 nModified:2200 keyUpdates:1 writeConflicts:0 numYields:35 locks:{} 246ms 2015-03-02T11:35:03.177-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9459.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 246ms 2015-03-02T11:35:03.181-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:03.323-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T11:35:03.398-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (44508 records 457249044 bytes) are inconsistent with full validation results (43508 records 446976044 bytes). Updating counters with new values. 2015-03-02T11:35:03.398-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (43728 records 449236104 bytes) is inconsistent with full validation results (43508 records 446976044 bytes). Updating size storer with new values. 2015-03-02T11:35:03.399-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:03.417-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:03.429-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 248ms 2015-03-02T11:35:03.447-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:03.613-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (43508 records 446976044 bytes) are inconsistent with full validation results (44508 records 457249044 bytes). Updating counters with new values. 2015-03-02T11:35:03.614-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (43508 records 446976044 bytes) is inconsistent with full validation results (44508 records 457249044 bytes). Updating size storer with new values. 2015-03-02T11:35:03.614-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:03.620-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:03.624-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 177ms 2015-03-02T11:35:03.629-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:03.795-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:03.802-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:03.806-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 176ms 2015-03-02T11:35:03.840-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:03.976-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:03.983-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:03.994-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 153ms 2015-03-02T11:35:04.019-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:04.162-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:04.170-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:04.178-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T11:35:05.010-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 159ms 2015-03-02T11:35:05.694-0500 I NETWORK [conn2] end connection 10.4.127.218:59265 (2 connections now open) 2015-03-02T11:35:05.733-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59273 #6 (3 connections now open) 2015-03-02T11:35:05.743-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T11:35:07.132-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1525.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:43946 nscannedObjects:43946 nMatched:21925 nModified:21925 keyUpdates:1 writeConflicts:172 numYields:366 locks:{} 2946ms 2015-03-02T11:35:07.132-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1525.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2946ms 2015-03-02T11:35:07.135-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:07.457-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27995 records 287731743 bytes) are inconsistent with full validation results (32216 records 331148529 bytes). Updating counters with new values. 2015-03-02T11:35:07.457-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (28283 records 290694111 bytes) is inconsistent with full validation results (32216 records 331148529 bytes). Updating size storer with new values. 2015-03-02T11:35:07.460-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:07.483-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:07.505-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 370ms 2015-03-02T11:35:07.522-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:35:07.664-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (29013 records 298202471 bytes) are inconsistent with full validation results (26992 records 277414465 bytes). Updating counters with new values. 2015-03-02T11:35:07.664-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (29504 records 303252897 bytes) is inconsistent with full validation results (26992 records 277414465 bytes). Updating size storer with new values. 2015-03-02T11:35:07.664-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:35:07.679-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:35:07.687-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T11:35:08.078-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 3411.0 } } ndeleted:21925 keyUpdates:0 writeConflicts:74 numYields:215 locks:{} 2322ms 2015-03-02T11:35:08.078-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3411.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2322ms 2015-03-02T11:35:08.088-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:35:08.205-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (18739 records 192534347 bytes) are inconsistent with full validation results (16539 records 169905147 bytes). Updating counters with new values. 2015-03-02T11:35:08.205-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (19483 records 200176891 bytes) is inconsistent with full validation results (16539 records 169905147 bytes). Updating size storer with new values. 2015-03-02T11:35:08.206-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:35:08.213-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:35:08.217-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 133ms 2015-03-02T11:35:08.223-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:35:08.286-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:35:08.289-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:35:08.302-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:35:08.384-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:35:08.389-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:35:08.394-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:35:08.432-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:35:08.437-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:35:08.815-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:35:09.061-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T11:35:11.623-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T11:35:15.407-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:35:16.177-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:35:16.182-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:35:16.566-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (33795 records 347176035 bytes) is inconsistent with full validation results (34539 records 354819147 bytes). Updating size storer with new values. 2015-03-02T11:35:16.566-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:35:16.579-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:35:16.593-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 410ms 2015-03-02T11:35:16.904-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 182ms 2015-03-02T11:35:17.326-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6601.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7596 nscannedObjects:7596 nMatched:3798 nModified:3798 keyUpdates:1 writeConflicts:0 numYields:67 locks:{} 726ms 2015-03-02T11:35:17.326-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6601.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 726ms 2015-03-02T11:35:17.330-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:35:17.454-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35539 records 365134475 bytes) is inconsistent with full validation results (35539 records 365141521 bytes). Updating size storer with new values. 2015-03-02T11:35:17.454-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:35:17.460-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:35:17.468-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 137ms 2015-03-02T11:35:18.326-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T11:35:18.896-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:35:19.334-0500 I NETWORK [conn3] end connection 10.4.127.218:59269 (2 connections now open) 2015-03-02T11:35:19.368-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59285 #7 (3 connections now open) 2015-03-02T11:35:19.395-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:35:19.730-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (38997 records 400665555 bytes) is inconsistent with full validation results (39539 records 406233521 bytes). Updating size storer with new values. 2015-03-02T11:35:19.730-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:35:19.739-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:35:19.746-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 351ms 2015-03-02T11:35:19.775-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:35:19.957-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:35:19.981-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:35:19.991-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 216ms 2015-03-02T11:35:20.505-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:35:20.510-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:35:20.518-0500 I WRITE [conn7] update test.foo query: { x: { $gte: 8138.0 } } update: { $inc:2015-03-02T11:35:56.710-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:35:56.726-0500 I CONTROL [initandlisten] MongoDB starting : pid=2536 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:35:56.726-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:35:56.726-0500 I CONTROL [initandlisten] 2015-03-02T11:35:56.726-0500 I CONTROL [initandlisten] 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:35:56.727-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:35:56.727-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:35:56.767-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:35:56.828-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:35:59.147-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59305 #1 (1 connection now open) 2015-03-02T11:35:59.165-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:35:59.602-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:35:59.607-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:35:59.609-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 444ms 2015-03-02T11:36:00.498-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1385.0 } } ndeleted:29665 keyUpdates:0 writeConflicts:0 numYields:231 locks:{} 883ms 2015-03-02T11:36:00.498-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1385.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 884ms 2015-03-02T11:36:00.501-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:00.538-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (8298 records 85243746 bytes) is inconsistent with full validation results (7634 records 78424082 bytes). Updating size storer with new values. 2015-03-02T11:36:00.538-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:00.542-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:00.546-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59306 #2 (2 connections now open) 2015-03-02T11:36:00.550-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:00.564-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:00.565-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:00.570-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.576-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:00.599-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7634 records 78424082 bytes) is inconsistent with full validation results (7635 records 78424128 bytes). Updating size storer with new values. 2015-03-02T11:36:00.600-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.604-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.607-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:00.609-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:00.611-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.618-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:00.643-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.645-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.648-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:00.652-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:00.656-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:00.658-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.684-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (7635 records 78424128 bytes) is inconsistent with full validation results (7634 records 78424082 bytes). Updating size storer with new values. 2015-03-02T11:36:00.684-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:00.686-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.687-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.689-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:00.693-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.699-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:00.722-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7634 records 78424082 bytes) is inconsistent with full validation results (7635 records 78424128 bytes). Updating size storer with new values. 2015-03-02T11:36:00.722-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.724-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:00.726-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:00.727-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.732-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.748-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7635 records 78424128 bytes) is inconsistent with full validation results (7634 records 78424082 bytes). Updating size storer with new values. 2015-03-02T11:36:00.748-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.750-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.754-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.768-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.769-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.772-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.790-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.791-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.795-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.809-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7634 records 78424082 bytes) is inconsistent with full validation results (7635 records 78424128 bytes). Updating size storer with new values. 2015-03-02T11:36:00.810-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.811-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.815-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.829-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.831-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.835-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.854-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.855-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.860-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.878-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7635 records 78424128 bytes) is inconsistent with full validation results (7608 records 78156984 bytes). Updating size storer with new values. 2015-03-02T11:36:00.878-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.880-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.885-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.912-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.913-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.922-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:00.950-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:00.956-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:00.965-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:01.005-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:01.009-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:01.017-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:01.053-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:01.055-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:01.059-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:01.079-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:01.080-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:01.084-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:01.103-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:01.104-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:01.111-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:36:01.132-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:36:01.134-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:36:05.506-0500 I NETWORK [conn2] end connection 10.4.127.218:59306 (1 connection now open) 2015-03-02T11:36:05.545-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59310 #3 (2 connections now open) 2015-03-02T11:36:05.841-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59311 #4 (3 connections now open) 2015-03-02T11:36:05.847-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:06.001-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16654 records 171086542 bytes) are inconsistent with full validation results (16608 records 170613984 bytes). Updating counters with new values. 2015-03-02T11:36:06.001-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15911 records 163453703 bytes) is inconsistent with full validation results (16608 records 170613984 bytes). Updating size storer with new values. 2015-03-02T11:36:06.005-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:06.013-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:06.019-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 171ms 2015-03-02T11:36:06.029-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:06.141-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T11:36:06.170-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (17562 records 180414426 bytes) are inconsistent with full validation results (16736 records 171928928 bytes). Updating counters with new values. 2015-03-02T11:36:06.170-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16865 records 173254145 bytes) is inconsistent with full validation results (16736 records 171928928 bytes). Updating size storer with new values. 2015-03-02T11:36:06.170-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:06.172-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:06.177-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 148ms 2015-03-02T11:36:06.189-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:06.286-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16736 records 171928928 bytes) are inconsistent with full validation results (17608 records 180886984 bytes). Updating counters with new values. 2015-03-02T11:36:06.286-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16736 records 171928928 bytes) is inconsistent with full validation results (17608 records 180886984 bytes). Updating size storer with new values. 2015-03-02T11:36:06.290-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:06.295-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:06.297-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 108ms 2015-03-02T11:36:06.307-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:06.352-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:06.361-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:06.385-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:06.491-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:06.507-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:06.509-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 124ms 2015-03-02T11:36:06.523-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:06.652-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18035 records 185273555 bytes) are inconsistent with full validation results (17608 records 180886984 bytes). Updating counters with new values. 2015-03-02T11:36:06.652-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17911 records 183999703 bytes) is inconsistent with full validation results (17608 records 180886984 bytes). Updating size storer with new values. 2015-03-02T11:36:06.652-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:06.662-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:06.667-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 144ms 2015-03-02T11:36:06.671-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:06.718-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T11:36:06.807-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18181 records 186773413 bytes) are inconsistent with full validation results (18209 records 187061057 bytes). Updating counters with new values. 2015-03-02T11:36:06.811-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17608 records 180886984 bytes) is inconsistent with full validation results (18209 records 187061057 bytes). Updating size storer with new values. 2015-03-02T11:36:06.811-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:06.824-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:06.825-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 154ms 2015-03-02T11:36:06.916-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:07.023-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (17298 records 177702354 bytes) are inconsistent with full validation results (17697 records 181801281 bytes). Updating counters with new values. 2015-03-02T11:36:07.023-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17906 records 183948338 bytes) is inconsistent with full validation results (17697 records 181801281 bytes). Updating size storer with new values. 2015-03-02T11:36:07.023-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:07.029-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:07.030-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 114ms 2015-03-02T11:36:08.210-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:36:08.392-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:36:08.541-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:36:09.431-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T11:36:09.739-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:36:10.433-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:36:10.692-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:10.831-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26089 records 268012297 bytes) is inconsistent with full validation results (26697 records 274258281 bytes). Updating size storer with new values. 2015-03-02T11:36:10.831-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:10.834-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:10.836-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 144ms 2015-03-02T11:36:10.987-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 5073.0 } } ndeleted:4016 keyUpdates:0 writeConflicts:0 numYields:31 locks:{} 148ms 2015-03-02T11:36:10.987-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5073.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T11:36:10.988-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:11.114-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23305 records 239412265 bytes) is inconsistent with full validation results (22681 records 233001913 bytes). Updating size storer with new values. 2015-03-02T11:36:11.115-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:11.124-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:11.133-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 144ms 2015-03-02T11:36:11.138-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:11.262-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:11.269-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:11.274-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T11:36:11.283-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:11.364-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23681 records 243274913 bytes) are inconsistent with full validation results (22813 records 234357949 bytes). Updating counters with new values. 2015-03-02T11:36:11.364-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23057 records 236864561 bytes) is inconsistent with full validation results (22813 records 234357949 bytes). Updating size storer with new values. 2015-03-02T11:36:11.364-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:11.368-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:11.383-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:11.471-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22813 records 234357949 bytes) are inconsistent with full validation results (23681 records 243274913 bytes). Updating counters with new values. 2015-03-02T11:36:11.471-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22813 records 234357949 bytes) is inconsistent with full validation results (23681 records 243274913 bytes). Updating size storer with new values. 2015-03-02T11:36:11.471-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:11.474-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:11.479-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:11.544-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23681 records 243274913 bytes) is inconsistent with full validation results (23682 records 243274959 bytes). Updating size storer with new values. 2015-03-02T11:36:11.544-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:11.561-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:11.573-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:11.678-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:11.686-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:11.692-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 118ms 2015-03-02T11:36:11.758-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:36:11.884-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23682 records 243274959 bytes) is inconsistent with full validation results (23682 records 243279717 bytes). Updating size storer with new values. 2015-03-02T11:36:11.884-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:36:11.895-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:36:11.899-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 140ms 2015-03-02T11:36:12.182-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:36:13.129-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T11:36:13.133-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T11:36:13.138-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 174ms 2015-03-02T11:36:15.821-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T11:36:15.861-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:36:16.917-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 184ms 2015-03-02T11:36:16.922-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:36:17.237-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (34689 records 356354628 bytes) is inconsistent with full validation results (35682 records 366555717 bytes). Updating size storer with new values. 2015-03-02T11:36:17.237-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:36:17.246-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:36:17.252-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 329ms 2015-03-02T11:36:17.546-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T11:36:17.549-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:36:18.413-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T11:36:19.112-0500 I NETWORK [conn1] end connection 10.4.127.218:59305 (2 connections now open) 2015-03-02T11:36:19.151-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59316 #5 (3 connections now open) 2015-03-02T11:36:19.161-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:36:19.514-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (39689 records 407719628 bytes) is inconsistent with full validation results (40682 records 417920717 bytes). Updating size storer with new values. 2015-03-02T11:36:19.514-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:36:19.524-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:36:19.542-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 380ms 2015-03-02T11:36:20.107-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T11:36:20.122-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T11:36:21.324-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:36:21.517-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (43689 records 448811628 bytes) is inconsistent with full validation results (44682 records 459012717 bytes). Updating size storer with new values. 2015-03-02T11:36:21.518-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:36:21.526-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:36:21.536-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 212ms 2015-03-02T11:36:22.465-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T11:36:23.892-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:36:23.958-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:36:24.267-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:36:25.799-0500 I NETWORK [conn4] end connection 10.4.127.218:59311 (2 connections now open) 2015-03-02T11:36:25.847-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59317 #6 (3 connections now open) 2015-03-02T11:36:27.975-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:36:27.989-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:36:29.589-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:36:29.607-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:36:29.612-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:36:30.932-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (63689 records 654271628 bytes) is inconsistent with full validation results (64682 records 664472717 bytes). Updating size storer with new values. 2015-03-02T11:36:30.932-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:36:30.942-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:36:30.952-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1340ms 2015-03-02T11:36:30.970-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:36:31.219-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T11:36:31.332-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (65682 records 674745717 bytes) are inconsistent with full validation results (64682 records 664472717 bytes). Updating counters with new values. 2015-03-02T11:36:31.332-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (64689 records 664544628 bytes) is inconsistent with full validation results (64682 records 664472717 bytes). Updating size storer with new values. 2015-03-02T11:36:31.332-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:36:31.345-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:36:31.355-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 385ms 2015-03-02T11:36:31.387-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:36:31.765-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T11:36:31.766-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (64689 records 664544628 bytes) is inconsistent with full validation results (65682 records 674745717 bytes). Updating size storer with new values. 2015-03-02T11:36:31.766-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:36:31.777-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:36:31.789-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 402ms 2015-03-02T11:37:00.798-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:37:00.808-0500 I CONTROL [initandlisten] MongoDB starting : pid=2516 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:37:00.808-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:37:00.808-0500 I CONTROL [initandlisten] 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:37:00.811-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:37:00.811-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:37:00.858-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:37:00.909-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:37:02.650-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59329 #1 (1 connection now open) 2015-03-02T11:37:02.877-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59330 #2 (2 connections now open) 2015-03-02T11:37:04.656-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2954.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39328 nscannedObjects:39328 nMatched:19871 nModified:19871 keyUpdates:1 writeConflicts:127 numYields:314 locks:{} 1998ms 2015-03-02T11:37:04.657-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2954.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ],2015-03-02T11:38:04.424-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] MongoDB starting : pid=2529 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:38:04.436-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:38:04.436-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:38:04.478-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:38:04.520-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:38:05.777-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59349 #1 (1 connection now open) 2015-03-02T11:38:05.792-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:06.103-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59350 #2 (2 connections now open) 2015-03-02T11:38:06.186-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:06.190-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:06.194-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 401ms 2015-03-02T11:38:06.205-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:38:06.207-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:06.334-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:38:06.338-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:38:06.341-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:06.346-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 140ms 2015-03-02T11:38:06.348-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:06.351-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 143ms 2015-03-02T11:38:06.360-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:06.363-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:38:06.486-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:38:06.490-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:06.494-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:06.496-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:38:06.498-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 134ms 2015-03-02T11:38:06.500-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 139ms 2015-03-02T11:38:06.510-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:38:06.513-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:06.638-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:38:06.640-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:06.644-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:38:06.646-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:06.649-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 139ms 2015-03-02T11:38:06.650-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 137ms 2015-03-02T11:38:06.657-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:06.731-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:06.735-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:07.206-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6182.0 } } ndeleted:18784 keyUpdates:0 writeConflicts:0 numYields:146 locks:{} 464ms 2015-03-02T11:38:07.206-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6182.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 465ms 2015-03-02T11:38:07.210-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:07.276-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19298 records 198248293 bytes) is inconsistent with full validation results (18515 records 190204595 bytes). Updating size storer with new values. 2015-03-02T11:38:07.277-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:07.281-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:14.426-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59352 #3 (3 connections now open) 2015-03-02T11:38:19.415-0500 I NETWORK [conn3] end connection 10.4.127.218:59352 (2 connections now open) 2015-03-02T11:38:19.417-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59353 #4 (3 connections now open) 2015-03-02T11:38:19.982-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:38:20.384-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:20.896-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34515 records 354758066 bytes) are inconsistent with full validation results (34515 records 354720080 bytes). Updating counters with new values. 2015-03-02T11:38:20.896-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34515 records 354757416 bytes) is inconsistent with full validation results (34515 records 354720080 bytes). Updating size storer with new values. 2015-03-02T11:38:20.897-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:20.907-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:20.915-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 530ms 2015-03-02T11:38:20.929-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:21.112-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34515 records 354733366 bytes) are inconsistent with full validation results (34515 records 354759184 bytes). Updating counters with new values. 2015-03-02T11:38:21.112-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34515 records 354732430 bytes) is inconsistent with full validation results (34515 records 354759184 bytes). Updating size storer with new values. 2015-03-02T11:38:21.112-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:21.121-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:21.133-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 204ms 2015-03-02T11:38:21.208-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3156.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31048 nscannedObjects:31048 nMatched:15289 nModified:15289 keyUpdates:1 writeConflicts:0 numYields:254 locks:{} 1780ms 2015-03-02T11:38:21.208-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3156.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1780ms 2015-03-02T11:38:21.213-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:21.382-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (34515 records 354759184 bytes) are inconsistent with full validation results (34515 records 354771352 bytes). Updating counters with new values. 2015-03-02T11:38:21.382-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (34515 records 354759184 bytes) is inconsistent with full validation results (34515 records 354771352 bytes). Updating size storer with new values. 2015-03-02T11:38:21.382-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:21.389-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:21.404-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 190ms 2015-03-02T11:38:21.421-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:21.604-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:21.613-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:21.619-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 197ms 2015-03-02T11:38:22.361-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T11:38:22.382-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9936.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17128 nscannedObjects:17128 nMatched:8542 nModified:8542 keyUpdates:1 writeConflicts:95 numYields:144 locks:{} 1244ms 2015-03-02T11:38:22.383-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9936.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1244ms 2015-03-02T11:38:22.388-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:22.560-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (25639 records 263459816 bytes) are inconsistent with full validation results (27968 records 287415910 bytes). Updating counters with new values. 2015-03-02T11:38:22.560-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26135 records 268561672 bytes) is inconsistent with full validation results (27968 records 287415910 bytes). Updating size storer with new values. 2015-03-02T11:38:22.560-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:22.587-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:22.594-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 206ms 2015-03-02T11:38:22.613-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:22.754-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (25463 records 261649480 bytes) are inconsistent with full validation results (24960 records 256475622 bytes). Updating counters with new values. 2015-03-02T11:38:22.754-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (25464 records 261659766 bytes) is inconsistent with full validation results (24960 records 256475622 bytes). Updating size storer with new values. 2015-03-02T11:38:22.754-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:22.763-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:22.765-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 151ms 2015-03-02T11:38:22.775-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:22.899-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23065 records 236983652 bytes) are inconsistent with full validation results (22725 records 233486412 bytes). Updating counters with new values. 2015-03-02T11:38:22.899-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23961 records 246199908 bytes) is inconsistent with full validation results (22725 records 233486412 bytes). Updating size storer with new values. 2015-03-02T11:38:22.899-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:22.905-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:22.909-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 133ms 2015-03-02T11:38:22.955-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 5775.0 } } ndeleted:8626 keyUpdates:0 writeConflicts:61 numYields:97 locks:{} 1331ms 2015-03-02T11:38:22.955-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5775.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1331ms 2015-03-02T11:38:22.958-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.124-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (21712 records 223083126 bytes) are inconsistent with full validation results (20226 records 207785273 bytes). Updating counters with new values. 2015-03-02T11:38:23.124-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21712 records 223080877 bytes) is inconsistent with full validation results (20226 records 207785273 bytes). Updating size storer with new values. 2015-03-02T11:38:23.124-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.125-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4474.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2528 nscannedObjects:2528 nMatched:1264 nModified:1264 keyUpdates:1 writeConflicts:0 numYields:22 locks:{} 210ms 2015-03-02T11:38:23.125-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4474.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 210ms 2015-03-02T11:38:23.130-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:38:23.135-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.141-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 183ms 2015-03-02T11:38:23.153-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.225-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (20226 records 207785273 bytes) are inconsistent with full validation results (20226 records 207798130 bytes). Updating counters with new values. 2015-03-02T11:38:23.229-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20226 records 207785273 bytes) is inconsistent with full validation results (20226 records 207798130 bytes). Updating size storer with new values. 2015-03-02T11:38:23.230-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:38:23.237-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:38:23.242-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.242-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 112ms 2015-03-02T11:38:23.247-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.255-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.324-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.330-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.338-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.399-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.403-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.584-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3466.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3476 nscannedObjects:3476 nMatched:1738 nModified:1738 keyUpdates:1 writeConflicts:0 numYields:28 locks:{} 170ms 2015-03-02T11:38:23.585-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3466.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 170ms 2015-03-02T11:38:23.587-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.662-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.664-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.669-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.715-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.718-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.729-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.811-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.820-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.830-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 101ms 2015-03-02T11:38:23.836-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.917-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:23.920-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:23.925-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:23.993-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.003-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.100-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.169-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19137 records 196602838 bytes) is inconsistent with full validation results (18488 records 189927224 bytes). Updating size storer with new values. 2015-03-02T11:38:24.170-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.173-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.178-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.218-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.221-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.232-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.293-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18488 records 189927224 bytes) is inconsistent with full validation results (18489 records 189927270 bytes). Updating size storer with new values. 2015-03-02T11:38:24.293-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.296-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.300-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.366-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.369-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.374-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.414-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.417-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.428-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.495-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18489 records 189927270 bytes) is inconsistent with full validation results (18488 records 189927224 bytes). Updating size storer with new values. 2015-03-02T11:38:24.495-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.500-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.515-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.571-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18488 records 189927224 bytes) is inconsistent with full validation results (18489 records 189927270 bytes). Updating size storer with new values. 2015-03-02T11:38:24.571-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.575-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.582-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.667-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18991 records 195084316 bytes) are inconsistent with full validation results (18489 records 189927270 bytes). Updating counters with new values. 2015-03-02T11:38:24.667-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18837 records 193502274 bytes) is inconsistent with full validation results (18489 records 189927270 bytes). Updating size storer with new values. 2015-03-02T11:38:24.669-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.674-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.682-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.780-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18987 records 195043224 bytes) are inconsistent with full validation results (19203 records 197262192 bytes). Updating counters with new values. 2015-03-02T11:38:24.780-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18489 records 189927270 bytes) is inconsistent with full validation results (19203 records 197262192 bytes). Updating size storer with new values. 2015-03-02T11:38:24.780-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.784-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.787-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 104ms 2015-03-02T11:38:24.793-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.841-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19203 records 197262192 bytes) are inconsistent with full validation results (19489 records 200200270 bytes). Updating counters with new values. 2015-03-02T11:38:24.841-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19203 records 197262192 bytes) is inconsistent with full validation results (19489 records 200200270 bytes). Updating size storer with new values. 2015-03-02T11:38:24.842-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.846-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.856-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.917-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.919-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:24.924-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:24.981-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:24.985-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:26.090-0500 I NETWORK [conn2] end connection 10.4.127.218:59350 (2 connections now open) 2015-03-02T11:38:26.106-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59354 #5 (3 connections now open) 2015-03-02T11:38:26.115-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:26.222-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (20837 records 214048274 bytes) is inconsistent with full validation results (21488 records 220746224 bytes). Updating size storer with new values. 2015-03-02T11:38:26.222-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:26.233-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:26.240-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 125ms 2015-03-02T11:38:26.247-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:26.349-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:26.363-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:26.371-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 123ms 2015-03-02T11:38:26.380-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:26.483-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:26.486-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:26.489-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 108ms 2015-03-02T11:38:26.491-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:26.582-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:26.585-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:26.642-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:26.686-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (20141 records 206908493 bytes) is inconsistent with full validation results (19484 records 200159132 bytes). Updating size storer with new values. 2015-03-02T11:38:26.687-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:26.691-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:26.699-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:26.746-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19484 records 200159132 bytes) is inconsistent with full validation results (19485 records 200159178 bytes). Updating size storer with new values. 2015-03-02T11:38:26.747-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:26.751-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:28.920-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:38:30.606-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T11:38:31.328-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:38:31.331-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T11:38:31.718-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:38:34.018-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T11:38:34.118-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:38:35.773-0500 I NETWORK [conn1] end connection 10.4.127.218:59349 (2 connections now open) 2015-03-02T11:38:35.800-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59356 #6 (3 connections now open) 2015-03-02T11:38:36.079-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:36.621-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42827 records 439951544 bytes) is inconsistent with full validation results (43485 records 446711178 bytes). Updating size storer with new values. 2015-03-02T11:38:36.621-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:36.627-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:36.631-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 552ms 2015-03-02T11:38:36.648-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:36.800-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:36.821-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:36.830-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 181ms 2015-03-02T11:38:36.839-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:36.999-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:37.005-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:37.009-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 169ms 2015-03-02T11:38:37.014-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:37.185-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:37.191-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:37.196-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 181ms 2015-03-02T11:38:37.202-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:37.331-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:37.343-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:37.364-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 161ms 2015-03-02T11:38:38.578-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:38:39.006-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T11:38:39.011-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:39.341-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (46485 records 477769378 bytes) are inconsistent with full validation results (46485 records 477750515 bytes). Updating counters with new values. 2015-03-02T11:38:39.341-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (46485 records 477768624 bytes) is inconsistent with full validation results (46485 records 477750515 bytes). Updating size storer with new values. 2015-03-02T11:38:39.341-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:39.352-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3200.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:36802 nscannedObjects:36802 nMatched:18401 nModified:18401 keyUpdates:1 writeConflicts:0 numYields:299 locks:{} 1984ms 2015-03-02T11:38:39.352-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3200.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1984ms 2015-03-02T11:38:39.357-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:39.360-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:38:39.386-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 374ms 2015-03-02T11:38:39.401-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:38:39.608-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (46485 records 477750515 bytes) are inconsistent with full validation results (46485 records 477769378 bytes). Updating counters with new values. 2015-03-02T11:38:39.608-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (46485 records 477750515 bytes) is inconsistent with full validation results (46485 records 477769378 bytes). Updating size storer with new values. 2015-03-02T11:38:39.608-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:38:39.624-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:38:39.633-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 273ms 2015-03-02T11:38:39.641-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (46485 records 477769885 bytes) are inconsistent with full validation results (46485 records 477769378 bytes). Updating counters with new values. 2015-03-02T11:38:39.642-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:38:39.656-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:38:39.664-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 262ms 2015-03-02T11:38:41.199-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T11:38:43.995-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 2131.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50554 nscannedObjects:50554 nMatched:24704 nModified:24704 keyUpdates:1 writeConflict2015-03-02T11:39:15.498-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:39:15.513-0500 I CONTROL [initandlisten] MongoDB starting : pid=2540 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:39:15.514-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:39:15.514-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:39:15.555-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:39:15.603-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:39:16.197-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59363 #1 (1 connection now open) 2015-03-02T11:39:16.215-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:16.348-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59364 #2 (2 connections now open) 2015-03-02T11:39:16.942-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:16.948-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:16.951-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 592ms 2015-03-02T11:39:16.951-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 735ms 2015-03-02T11:39:19.364-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1114.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:61306 nscannedObjects:61306 nMatched:30653 nModified:30653 keyUpdates:1 writeConflicts:0 numYields:481 locks:{} 2408ms 2015-03-02T11:39:19.364-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1114.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2408ms 2015-03-02T11:39:19.370-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:19.389-0500 I NETWORK [conn2] end connection 10.4.127.218:59364 (1 connection now open) 2015-03-02T11:39:19.430-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59366 #3 (2 connections now open) 2015-03-02T11:39:19.471-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:19.476-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:19.486-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T11:39:20.732-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 9997.0 } } ndeleted:30653 keyUpdates:0 writeConflicts:0 numYields:239 locks:{} 1242ms 2015-03-02T11:39:20.732-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9997.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1242ms 2015-03-02T11:39:20.734-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:20.773-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6951 records 71401348 bytes) is inconsistent with full validation results (6646 records 68274358 bytes). Updating size storer with new values. 2015-03-02T11:39:20.774-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:20.778-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:20.785-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:20.797-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:20.799-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:20.805-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:20.818-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6646 records 68274358 bytes) is inconsistent with full validation results (6647 records 68274404 bytes). Updating size storer with new values. 2015-03-02T11:39:20.818-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:20.819-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:20.822-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:20.834-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:20.836-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:20.840-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:20.855-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:20.857-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:20.860-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:20.874-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:20.876-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:20.880-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:20.896-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:20.897-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:21.106-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59369 #4 (3 connections now open) 2015-03-02T11:39:22.053-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:39:22.065-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:39:24.282-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T11:39:26.078-0500 I NETWORK [conn4] end connection 10.4.127.218:59369 (2 connections now open) 2015-03-02T11:39:26.103-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59370 #5 (3 connections now open) 2015-03-02T11:39:26.130-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:26.204-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:39:26.435-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (19647 records 201823404 bytes) are inconsistent with full validation results (18929 records 194447390 bytes). Updating counters with new values. 2015-03-02T11:39:26.435-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19341 records 198679866 bytes) is inconsistent with full validation results (18929 records 194447390 bytes). Updating size storer with new values. 2015-03-02T11:39:26.435-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:26.441-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:26.447-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 316ms 2015-03-02T11:39:26.873-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:39:27.070-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:39:27.850-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T11:39:28.079-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:39:28.081-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:39:30.092-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:39:30.097-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:30.455-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (28947 records 297362304 bytes) are inconsistent with full validation results (28647 records 294280404 bytes). Updating counters with new values. 2015-03-02T11:39:30.455-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (28623 records 294033852 bytes) is inconsistent with full validation results (28647 records 294280404 bytes). Updating size storer with new values. 2015-03-02T11:39:30.455-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:30.469-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:30.475-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 378ms 2015-03-02T11:39:30.507-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T11:39:30.526-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T11:39:30.533-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:39:30.666-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9525.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:1902 nscannedObjects:1902 nMatched:951 nModified:951 keyUpdates:1 writeConflicts:0 numYields:16 locks:{} 184ms 2015-03-02T11:39:30.672-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9525.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 190ms 2015-03-02T11:39:30.675-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:30.748-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (29629 records 304380840 bytes) are inconsistent with full validation results (30647 records 314830642 bytes). Updating counters with new values. 2015-03-02T11:39:30.748-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (29629 records 304377512 bytes) is inconsistent with full validation results (30647 records 314830642 bytes). Updating size storer with new values. 2015-03-02T11:39:30.748-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:39:30.760-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:39:30.763-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 230ms 2015-03-02T11:39:30.772-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:39:30.874-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (30647 records 314830642 bytes) are inconsistent with full validation results (30647 records 314838754 bytes). Updating counters with new values. 2015-03-02T11:39:30.874-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (30647 records 314830642 bytes) is inconsistent with full validation results (30647 records 314838754 bytes). Updating size storer with new values. 2015-03-02T11:39:30.874-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:30.888-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:30.899-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 224ms 2015-03-02T11:39:30.951-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (29921 records 307380556 bytes) are inconsistent with full validation results (30647 records 314838754 bytes). Updating counters with new values. 2015-03-02T11:39:30.954-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:39:30.960-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:39:30.973-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 201ms 2015-03-02T11:39:31.898-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2456.0 } } ndeleted:15633 keyUpdates:0 writeConflicts:0 numYields:124 locks:{} 993ms 2015-03-02T11:39:31.898-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2456.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 994ms 2015-03-02T11:39:31.899-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:32.040-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16535 records 169864055 bytes) are inconsistent with full validation results (15014 records 154238822 bytes). Updating counters with new values. 2015-03-02T11:39:32.040-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (15850 records 162827050 bytes) is inconsistent with full validation results (15014 records 154238822 bytes). Updating size storer with new values. 2015-03-02T11:39:32.040-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:32.053-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:32.065-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 165ms 2015-03-02T11:39:32.069-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:32.144-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (15219 records 156344787 bytes) are inconsistent with full validation results (16014 records 164511822 bytes). Updating counters with new values. 2015-03-02T11:39:32.145-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (15014 records 154238822 bytes) is inconsistent with full validation results (16014 records 164511822 bytes). Updating size storer with new values. 2015-03-02T11:39:32.145-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:32.147-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:32.306-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:39:33.228-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 176ms 2015-03-02T11:39:33.626-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T11:39:34.151-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 398.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29144 nscannedObjects:29144 nMatched:14572 nModified:14572 keyUpdates:1 writeConflicts:0 numYields:242 locks:{} 1995ms 2015-03-02T11:39:34.151-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 398.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1995ms 2015-03-02T11:39:34.156-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:34.274-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (20014 records 205793258 bytes) are inconsistent with full validation results (19014 records 195520258 bytes). Updating counters with new values. 2015-03-02T11:39:34.274-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19552 records 201047132 bytes) is inconsistent with full validation results (19014 records 195520258 bytes). Updating size storer with new values. 2015-03-02T11:39:34.274-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:34.278-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:34.295-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T11:39:35.220-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 191.0 } } ndeleted:17913 keyUpdates:0 writeConflicts:0 numYields:140 locks:{} 919ms 2015-03-02T11:39:35.220-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 191.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 919ms 2015-03-02T11:39:35.221-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:35.316-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1520 records 15614960 bytes) are inconsistent with full validation results (2101 records 21583573 bytes). Updating counters with new values. 2015-03-02T11:39:35.316-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1476 records 15167823 bytes) is inconsistent with full validation results (2101 records 21583573 bytes). Updating size storer with new values. 2015-03-02T11:39:35.316-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:35.336-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:35.357-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T11:39:35.362-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:39:35.375-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (2654 records 27264542 bytes) are inconsistent with full validation results (2977 records 30582721 bytes). Updating counters with new values. 2015-03-02T11:39:35.375-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (2307 records 23699811 bytes) is inconsistent with full validation results (2977 records 30582721 bytes). Updating size storer with new values. 2015-03-02T11:39:35.375-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:39:35.376-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:39:35.379-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T11:39:35.645-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T11:39:35.768-0500 I NETWORK [conn1] end connection 10.4.127.218:59363 (2 connections now open) 2015-03-02T11:39:35.805-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59372 #6 (3 connections now open) 2015-03-02T11:39:36.088-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 2900.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4000 nscannedObjects:4000 nMatched:2000 nModified:2000 keyUpdates:1 writeConflicts:0 numYields:33 locks:{} 272ms 2015-03-02T11:39:36.088-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2900.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 273ms 2015-03-02T11:39:36.093-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:39:36.111-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (4005 records 41169365 bytes) are inconsistent with full validation results (4101 records 42155573 bytes). Updating counters with new values. 2015-03-02T11:39:36.111-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (4005 records 41164490 bytes) is inconsistent with full validation results (4101 records 42155573 bytes). Updating size storer with new values. 2015-03-02T11:39:36.111-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:39:36.113-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:39:39.557-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T11:39:39.576-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:39:40.288-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:39:40.290-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:39:40.412-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13726 records 141033198 bytes) is inconsistent with full validation results (14101 records 144885573 bytes). Updating size storer with new values. 2015-03-02T11:39:40.412-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:39:40.414-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:39:40.415-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 125ms 2015-03-02T11:39:40.425-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:39:40.458-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:39:40.461-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:39:40.468-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:39:40.496-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:39:40.498-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:39:40.505-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:39:40.547-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:39:40.549-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:39:40.765-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:40.811-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (14726 records 151306198 bytes) is inconsistent with full validation results (15101 records 155158573 bytes). Updating size storer with new values. 2015-03-02T11:39:40.811-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:40.814-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:40.820-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:40.883-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:40.885-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:41.763-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:39:42.165-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3031.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24000 nscannedObjects:24000 nMatched:12000 nModified:12000 keyUpdates:1 writeConflicts:0 numYields:196 locks:{} 1275ms 2015-03-02T11:39:42.165-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3031.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1275ms 2015-03-02T11:39:42.168-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:42.265-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:42.267-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:42.276-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 108ms 2015-03-02T11:39:43.033-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T11:39:43.062-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 4225.0 } } ndeleted:12000 keyUpdates:0 writeConflicts:0 numYields:95 locks:{} 782ms 2015-03-02T11:39:43.062-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4225.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 782ms 2015-03-02T11:39:43.067-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:43.215-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T11:39:43.225-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (6101 records 62675573 bytes) are inconsistent with full validation results (5101 records 52402573 bytes). Updating counters with new values. 2015-03-02T11:39:43.225-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (5726 records 58823198 bytes) is inconsistent with full validation results (5101 records 52402573 bytes). Updating size storer with new values. 2015-03-02T11:39:43.226-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:43.234-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:43.241-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 174ms 2015-03-02T11:39:43.247-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:43.304-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (5101 records 52402573 bytes) are inconsistent with full validation results (6101 records 62675573 bytes). Updating counters with new values. 2015-03-02T11:39:43.304-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (5101 records 52402573 bytes) is inconsistent with full validation results (6101 records 62675573 bytes). Updating size storer with new values. 2015-03-02T11:39:43.305-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:43.306-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:43.315-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:43.336-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (6101 records 62675573 bytes) is inconsistent with full validation results (6102 records 62675619 bytes). Updating size storer with new values. 2015-03-02T11:39:43.337-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:43.338-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:43.344-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:43.363-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (6102 records 62675619 bytes) is inconsistent with full validation results (6101 records 62675573 bytes). Updating size storer with new values. 2015-03-02T11:39:43.363-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:43.364-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:43.375-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:43.419-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:43.429-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:43.441-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:39:43.460-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (6101 records 62675573 bytes) is inconsistent with full validation results (6102 records 62675619 bytes). Updating size storer with new values. 2015-03-02T11:39:43.460-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:39:43.461-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:39:44.299-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T11:39:47.540-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:39:49.406-0500 I NETWORK [conn3] end connection 10.4.127.218:59366 (2 connections now open) 2015-03-02T11:39:49.420-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T11:39:49.461-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59377 #7 (3 connections now open) 2015-03-02T11:39:49.472-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:49.882-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (18724 records 192341425 bytes) is inconsistent with full validation results (19102 records 196224619 bytes). Updating size storer with new values. 2015-03-02T11:39:49.882-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:49.886-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:49.888-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 416ms 2015-03-02T11:39:49.894-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:49.959-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:49.963-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:49.969-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:50.059-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:50.063-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:50.070-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:50.128-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:50.132-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:50.320-0500 I WRITE [conn7] update test.foo query: { x: { $gte: 6874.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2254 nscannedObjects:2254 nMatched:1127 nModified:1127 keyUpdates:1 writeConflicts:0 numYields:19 locks:{} 176ms 2015-03-02T11:39:50.320-0500 I COMMAND [conn7] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6874.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 176ms 2015-03-02T11:39:50.325-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:50.419-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T11:39:50.434-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (20102 records 206512257 bytes) are inconsistent with full validation results (19298 records 198252765 bytes). Updating counters with new values. 2015-03-02T11:39:50.434-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (19597 records 201324392 bytes) is inconsistent with full validation results (19298 records 198252765 bytes). Updating size storer with new values. 2015-03-02T11:39:50.434-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:50.438-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:50.460-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 135ms 2015-03-02T11:39:50.536-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:50.580-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (17635 records 181164355 bytes) are inconsistent with full validation results (18439 records 189423847 bytes). Updating counters with new values. 2015-03-02T11:39:50.580-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (17803 records 182882163 bytes) is inconsistent with full validation results (18439 records 189423847 bytes). Updating size storer with new values. 2015-03-02T11:39:50.580-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:50.586-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:50.596-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:50.667-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:50.671-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:50.682-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:50.726-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:50.728-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:50.733-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:39:50.770-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:39:50.773-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:39:51.866-0500 I COMMAND [conn6] command test.$cmd command: insert { 2015-03-02T11:40:30.005-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] MongoDB starting : pid=2506 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:40:30.018-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:40:30.019-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:40:30.019-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:40:30.056-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:40:30.117-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:40:31.361-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59393 #1 (1 connection now open) 2015-03-02T11:40:31.528-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59394 #2 (2 connections now open) 2015-03-02T11:40:32.522-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 1983.0 } } ndeleted:152 keyUpdates:0 writeConflicts:75 numYields:82 locks:{} 979ms 2015-03-02T11:40:32.522-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1983.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 979ms 2015-03-02T11:40:32.525-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:40:32.527-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1588.0 } } ndeleted:0 keyUpdates:0 writeConflicts:67 numYields:124 locks:{} 1159ms 2015-03-02T11:40:32.527-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1588.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1160ms 2015-03-02T11:40:32.530-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:40:32.634-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (8298 records 85238468 bytes) is inconsistent with full validation results (8040 records 82594920 bytes). Updating size storer with new values. 2015-03-02T11:40:32.634-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:40:32.636-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:40:32.641-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:40:32.641-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:40:32.642-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 111ms 2015-03-02T11:40:32.644-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 118ms 2015-03-02T11:40:32.649-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:40:32.651-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:40:32.681-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (8040 records 82594920 bytes) is inconsistent with full validation results (8041 records 82594966 bytes). Updating size storer with new values. 2015-03-02T11:40:32.682-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:40:32.683-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:40:32.685-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:40:32.687-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:40:32.692-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:40:32.710-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:40:32.711-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:40:32.715-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:40:32.744-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:40:32.746-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:40:32.751-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:40:32.772-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:40:32.774-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:40:32.780-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:40:32.802-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:40:32.804-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:40:32.809-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:40:32.834-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:40:32.838-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:40:35.776-0500 I NETWORK [conn2] end connection 10.4.127.218:59394 (1 connection now open) 2015-03-02T11:40:35.811-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59395 #3 (2 connections now open) 2015-03-02T11:40:35.816-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:35.894-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13781 records 141561986 bytes) is inconsistent with full validation results (14041 records 144232966 bytes). Updating size storer with new values. 2015-03-02T11:40:35.895-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:35.903-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:35.909-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:35.939-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:35.941-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:35.945-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:35.980-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:35.985-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:35.990-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:36.023-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:36.025-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:36.035-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:36.069-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (14041 records 144232966 bytes) is inconsistent with full validation results (14040 records 144232920 bytes). Updating size storer with new values. 2015-03-02T11:40:36.069-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:36.072-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:36.128-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59396 #4 (3 connections now open) 2015-03-02T11:40:36.135-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:36.164-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:36.167-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:38.751-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:40:38.804-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T11:40:39.522-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T11:40:40.314-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T11:40:41.888-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T11:40:42.376-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:40:42.890-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T11:40:44.641-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:40:45.564-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:40:45.841-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:46.604-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (39040 records 401057920 bytes) are inconsistent with full validation results (38040 records 390784920 bytes). Updating counters with new values. 2015-03-02T11:40:46.604-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (38779 records 398376667 bytes) is inconsistent with full validation results (38040 records 390784920 bytes). Updating size storer with new values. 2015-03-02T11:40:46.605-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:46.615-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:46.622-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 780ms 2015-03-02T11:40:47.415-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T11:40:47.422-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:47.718-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 190ms 2015-03-02T11:40:47.768-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (40040 records 411436454 bytes) are inconsistent with full validation results (40040 records 411410103 bytes). Updating counters with new values. 2015-03-02T11:40:47.768-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40040 records 411431527 bytes) is inconsistent with full validation results (40040 records 411410103 bytes). Updating size storer with new values. 2015-03-02T11:40:47.768-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:47.782-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:47.799-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 376ms 2015-03-02T11:40:47.818-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:48.055-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (40040 records 411430032 bytes) are inconsistent with full validation results (41040 records 421712652 bytes). Updating counters with new values. 2015-03-02T11:40:48.055-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40040 records 411418176 bytes) is inconsistent with full validation results (41040 records 421712652 bytes). Updating size storer with new values. 2015-03-02T11:40:48.055-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:48.066-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:48.083-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 265ms 2015-03-02T11:40:48.104-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:48.332-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41040 records 421731424 bytes) are inconsistent with full validation results (41040 records 421732204 bytes). Updating counters with new values. 2015-03-02T11:40:48.332-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41040 records 421726796 bytes) is inconsistent with full validation results (41040 records 421732204 bytes). Updating size storer with new values. 2015-03-02T11:40:48.332-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:48.344-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:48.356-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 252ms 2015-03-02T11:40:48.376-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:48.599-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41040 records 421750781 bytes) are inconsistent with full validation results (41040 records 421751730 bytes). Updating counters with new values. 2015-03-02T11:40:48.599-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41040 records 421740576 bytes) is inconsistent with full validation results (41040 records 421751730 bytes). Updating size storer with new values. 2015-03-02T11:40:48.599-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:48.612-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:48.619-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 243ms 2015-03-02T11:40:49.460-0500 I NETWORK [conn1] end connection 10.4.127.218:59393 (2 connections now open) 2015-03-02T11:40:49.461-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59398 #5 (4 connections now open) 2015-03-02T11:40:50.584-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 2126.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31624 nscannedObjects:31624 nMatched:23274 nModified:23274 keyUpdates:1 writeConflicts:0 numYields:286 locks:{} 3957ms 2015-03-02T11:40:50.584-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2126.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3958ms 2015-03-02T11:40:50.587-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:50.853-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (21604 records 221988670 bytes) are inconsistent with full validation results (24103 records 247708386 bytes). Updating counters with new values. 2015-03-02T11:40:50.853-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (22106 records 227152242 bytes) is inconsistent with full validation results (24103 records 247708386 bytes). Updating size storer with new values. 2015-03-02T11:40:50.854-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:50.891-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:50.908-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 321ms 2015-03-02T11:40:51.056-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 9838.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11210 nscannedObjects:11210 nMatched:3757 nModified:3757 keyUpdates:1 writeConflicts:7553 numYields:111 locks:{} 1577ms 2015-03-02T11:40:51.056-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9838.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1577ms 2015-03-02T11:40:51.061-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:40:51.204-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (21424 records 220181195 bytes) are inconsistent with full validation results (20003 records 205550866 bytes). Updating counters with new values. 2015-03-02T11:40:51.204-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21753 records 223561064 bytes) is inconsistent with full validation results (20003 records 205550866 bytes). Updating size storer with new values. 2015-03-02T11:40:51.205-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:40:51.216-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:40:51.228-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 166ms 2015-03-02T11:40:51.237-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:40:51.359-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (18795 records 193140952 bytes) are inconsistent with full validation results (18661 records 191764409 bytes). Updating counters with new values. 2015-03-02T11:40:51.359-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18825 records 193449142 bytes) is inconsistent with full validation results (18661 records 191764409 bytes). Updating size storer with new values. 2015-03-02T11:40:51.359-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:40:51.365-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:40:51.373-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T11:40:51.384-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:40:51.499-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (17581 records 180669543 bytes) are inconsistent with full validation results (17510 records 179940056 bytes). Updating counters with new values. 2015-03-02T11:40:51.499-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17690 records 181789300 bytes) is inconsistent with full validation results (17510 records 179940056 bytes). Updating size storer with new values. 2015-03-02T11:40:51.502-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:40:51.508-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:40:51.510-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 9389.0 } } ndeleted:4918 keyUpdates:0 writeConflicts:71 numYields:186 locks:{} 2886ms 2015-03-02T11:40:51.510-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9389.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2886ms 2015-03-02T11:40:51.512-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:51.516-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 131ms 2015-03-02T11:40:51.590-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (17417 records 178992428 bytes) are inconsistent with full validation results (16544 records 170016325 bytes). Updating counters with new values. 2015-03-02T11:40:51.592-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (17417 records 178992415 bytes) is inconsistent with full validation results (16544 records 170016325 bytes). Updating size storer with new values. 2015-03-02T11:40:51.593-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:51.599-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:51.611-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:51.719-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (16544 records 170026660 bytes) are inconsistent with full validation results (16544 records 170026270 bytes). Updating counters with new values. 2015-03-02T11:40:51.719-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (16544 records 170016325 bytes) is inconsistent with full validation results (16544 records 170026270 bytes). Updating size storer with new values. 2015-03-02T11:40:51.719-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:51.728-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:51.736-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 124ms 2015-03-02T11:40:51.747-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:40:51.833-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (16544 records 170036800 bytes) are inconsistent with full validation results (16544 records 170037216 bytes). Updating counters with new values. 2015-03-02T11:40:51.833-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (16544 records 170028545 bytes) is inconsistent with full validation results (16544 records 170037216 bytes). Updating size storer with new values. 2015-03-02T11:40:51.833-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:40:51.841-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:40:51.898-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 955.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13988 nscannedObjects:13988 nMatched:6994 nModified:6994 keyUpdates:1 writeConflicts:0 numYields:115 locks:{} 984ms 2015-03-02T11:40:51.898-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 955.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 985ms 2015-03-02T11:40:51.902-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:51.944-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16544 records 170039335 bytes) are inconsistent with full validation results (16544 records 170047434 bytes). Updating counters with new values. 2015-03-02T11:40:51.945-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16544 records 170037216 bytes) is inconsistent with full validation results (16544 records 170047434 bytes). Updating size storer with new values. 2015-03-02T11:40:51.945-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:51.947-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:52.641-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3493.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13988 nscannedObjects:13988 nMatched:6994 nModified:6994 keyUpdates:1 writeConflicts:0 numYields:113 locks:{} 686ms 2015-03-02T11:40:52.641-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3493.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 686ms 2015-03-02T11:40:52.643-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:52.731-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:52.734-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:52.745-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:52.830-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:52.842-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:52.855-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:52.924-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:52.927-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:53.598-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7737.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13988 nscannedObjects:13988 nMatched:6994 nModified:6994 keyUpdates:1 writeConflicts:0 numYields:111 locks:{} 666ms 2015-03-02T11:40:53.598-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7737.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 666ms 2015-03-02T11:40:53.600-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:53.707-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18507 records 190213333 bytes) are inconsistent with full validation results (17544 records 180320434 bytes). Updating counters with new values. 2015-03-02T11:40:53.707-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17758 records 182518856 bytes) is inconsistent with full validation results (17544 records 180320434 bytes). Updating size storer with new values. 2015-03-02T11:40:53.707-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:53.710-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:40:53.716-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:53.723-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T11:40:53.735-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:53.813-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (17581 records 180700535 bytes) are inconsistent with full validation results (18544 records 190593434 bytes). Updating counters with new values. 2015-03-02T11:40:53.813-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17544 records 180320434 bytes) is inconsistent with full validation results (18544 records 190593434 bytes). Updating size storer with new values. 2015-03-02T11:40:53.813-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:53.816-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:54.539-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 9698.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13988 nscannedObjects:13988 nMatched:6994 nModified:6994 keyUpdates:1 writeConflicts:0 numYields:112 locks:{} 715ms 2015-03-02T11:40:54.539-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9698.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 715ms 2015-03-02T11:40:54.547-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:54.625-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:54.629-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:54.987-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 7516.0 } } ndeleted:6994 keyUpdates:0 writeConflicts:0 numYields:55 locks:{} 344ms 2015-03-02T11:40:54.987-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7516.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 344ms 2015-03-02T11:40:54.989-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:55.090-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13324 records 136887514 bytes) is inconsistent with full validation results (12550 records 128926150 bytes). Updating size storer with new values. 2015-03-02T11:40:55.090-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:55.097-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:55.103-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 113ms 2015-03-02T11:40:55.107-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:55.165-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:55.172-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:55.180-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:55.210-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12550 records 128926150 bytes) is inconsistent with full validation results (12551 records 128926196 bytes). Updating size storer with new values. 2015-03-02T11:40:55.210-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:55.213-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:55.444-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 873.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4150 nscannedObjects:4150 nMatched:2075 nModified:2075 keyUpdates:1 writeConflicts:0 numYields:33 locks:{} 222ms 2015-03-02T11:40:55.444-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 873.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 222ms 2015-03-02T11:40:55.452-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:55.515-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12551 records 128942121 bytes) is inconsistent with full validation results (12551 records 128953158 bytes). Updating size storer with new values. 2015-03-02T11:40:55.515-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:55.517-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:55.753-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 9190.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4150 nscannedObjects:4150 nMatched:2075 nModified:2075 keyUpdates:1 writeConflicts:0 numYields:33 locks:{} 233ms 2015-03-02T11:40:55.754-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9190.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 233ms 2015-03-02T11:40:55.756-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:55.784-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:55.786-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:55.796-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:40:55.860-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13253 records 136164804 bytes) are inconsistent with full validation results (12583 records 129281894 bytes). Updating counters with new values. 2015-03-02T11:40:55.860-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12626 records 129723633 bytes) is inconsistent with full validation results (12583 records 129281894 bytes). Updating size storer with new values. 2015-03-02T11:40:55.860-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:40:55.866-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:40:55.903-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:40:56.135-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59400 #6 (4 connections now open) 2015-03-02T11:40:56.213-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 2658.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4272 nscannedObjects:4272 nMatched:2075 nModified:2075 keyUpdates:1 writeConflicts:3 numYields:36 locks:{} 333ms 2015-03-02T11:40:56.213-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2658.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 333ms 2015-03-02T11:40:56.214-0500 I NETWORK [conn4] end connection 10.4.127.218:59396 (3 connections now open) 2015-03-02T11:40:56.323-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 182ms 2015-03-02T11:40:56.451-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6002.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4150 nscannedObjects:4150 nMatched:2075 nModified:2075 keyUpdates:1 writeConflicts:71 numYields:35 locks:{} 296ms 2015-03-02T11:40:56.451-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6002.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 296ms 2015-03-02T11:40:56.454-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:40:56.512-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (13881 records 142616248 bytes) are inconsistent with full validation results (14551 records 149499158 bytes). Updating counters with new values. 2015-03-02T11:40:56.512-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (13881 records 142616248 bytes) is inconsistent with full validation results (14551 records 149499158 bytes). Updating size storer with new values. 2015-03-02T11:40:56.512-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:40:56.520-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:40:56.777-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6573.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4150 nscannedObjects:4150 nMatched:2075 nModified:2075 keyUpdates:1 writeConflicts:0 numYields:33 locks:{} 240ms 2015-03-02T11:40:56.777-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6573.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 240ms 2015-03-02T11:40:56.782-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:40:56.827-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:40:56.834-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:40:56.847-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:40:56.922-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:40:56.925-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:40:56.941-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:40:57.010-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:40:57.013-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:40:57.119-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:40:57.148-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (12701 records 130470058 bytes) is inconsistent with full validation results (12476 records 128165948 bytes). Updating size storer with new values. 2015-03-02T11:40:57.148-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:40:57.151-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:40:57.159-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:40:57.197-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (12476 records 128165948 bytes) is inconsistent with full validation results (12477 records 128165994 bytes). Updating size storer with new values. 2015-03-02T11:40:57.197-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:40:57.203-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:41:02.131-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T11:41:02.696-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:41:02.699-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:03.149-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26251 records 269666296 bytes) is inconsistent with full validation results (26477 records 271987994 bytes). Updating size storer with new values. 2015-03-02T11:41:03.149-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:03.156-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:03.168-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 468ms 2015-03-02T11:41:03.175-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:03.284-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:03.296-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:03.305-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 130ms 2015-03-02T11:41:03.668-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 189ms 2015-03-02T11:41:03.737-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 168ms 2015-03-02T11:41:04.230-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 5325.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:14702 nscannedObjects:14702 nMatched:7351 nModified:7351 keyUpdates:1 writeConflicts:0 numYields:120 locks:{} 921ms 2015-03-02T11:41:04.231-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5325.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 921ms 2015-03-02T11:41:04.232-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:04.397-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (28477 records 292622056 bytes) is inconsistent with full validation results (28477 records 292629544 bytes). Updating size storer with new values. 2015-03-02T11:41:04.398-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:04.403-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:04.408-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 175ms 2015-03-02T11:41:04.413-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:04.549-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:04.560-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:04.562-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 149ms 2015-03-02T11:41:05.183-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:41:05.703-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T11:41:05.788-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3817.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20734 nscannedObjects:20734 nMatched:10367 nModified:10367 keyUpdates:1 writeConflicts:0 numYields:169 locks:{} 1221ms 2015-03-02T11:41:05.788-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3817.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1221ms 2015-03-02T11:41:05.791-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:05.836-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59401 #7 (4 connections now open) 2015-03-02T11:41:05.843-0500 I NETWORK [conn3] end connection 10.4.127.218:59395 (3 connections now open) 2015-03-02T11:41:05.900-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (30195 records 310317766 bytes) is inconsistent with full validation results (30477 records 313214752 bytes). Updating size storer with new values. 2015-03-02T11:41:05.900-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:05.904-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:05.910-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 119ms 2015-03-02T11:41:07.431-0500 I WRITE [conn7] update test.foo query: { x: { $gte: 6477.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22734 nscannedObjects:22734 nMatched:11367 nModified:11367 keyUpdates:1 writeConflicts:0 numYields:187 locks:{} 1515ms 2015-03-02T11:41:07.432-0500 I COMMAND [conn7] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6477.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1516ms 2015-03-02T11:41:40.432-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:41:40.444-0500 I CONTROL [initandlisten] MongoDB starting : pid=2513 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:41:40.444-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:41:40.444-0500 I CONTROL [initandlisten] 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:41:40.445-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:41:40.445-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:41:40.492-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:41:40.557-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:41:41.154-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59417 #1 (1 connection now open) 2015-03-02T11:41:41.175-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:41.987-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:41.992-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:41.995-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 819ms 2015-03-02T11:41:42.516-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6024.0 } } ndeleted:19100 keyUpdates:0 writeConflicts:0 numYields:149 locks:{} 517ms 2015-03-02T11:41:42.516-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6024.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 517ms 2015-03-02T11:41:42.519-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:42.580-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18298 records 187966401 bytes) is inconsistent with full validation results (18199 records 186958327 bytes). Updating size storer with new values. 2015-03-02T11:41:42.580-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:42.585-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:42.594-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:42.635-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:42.637-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:44.476-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59418 #2 (2 connections now open) 2015-03-02T11:41:44.496-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:41:44.574-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (21100 records 216760300 bytes) is inconsistent with full validation results (21199 records 217777327 bytes). Updating size storer with new values. 2015-03-02T11:41:44.574-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:41:44.577-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:41:44.583-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:41:44.647-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:41:44.651-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:41:45.843-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59419 #3 (3 connections now open) 2015-03-02T11:41:46.259-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T11:41:46.262-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T11:41:47.184-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T11:41:47.318-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T11:41:47.333-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:41:48.069-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:41:48.905-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T11:41:49.459-0500 I NETWORK [conn2] end connection 10.4.127.218:59418 (2 connections now open) 2015-03-02T11:41:49.490-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59420 #4 (3 connections now open) 2015-03-02T11:41:49.505-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:41:49.910-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:41:49.968-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (33199 records 341053327 bytes) are inconsistent with full validation results (32199 records 330780327 bytes). Updating counters with new values. 2015-03-02T11:41:49.968-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (33100 records 340036300 bytes) is inconsistent with full validation results (32199 records 330780327 bytes). Updating size storer with new values. 2015-03-02T11:41:49.971-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:41:49.975-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:41:49.983-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 477ms 2015-03-02T11:41:50.079-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:41:50.187-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (30352 records 311806096 bytes) are inconsistent with full validation results (31352 records 322079096 bytes). Updating counters with new values. 2015-03-02T11:41:50.187-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (31298 records 321524354 bytes) is inconsistent with full validation results (31352 records 322079096 bytes). Updating size storer with new values. 2015-03-02T11:41:50.188-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:41:50.198-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:41:50.203-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 124ms 2015-03-02T11:41:50.212-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:41:50.400-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:41:50.409-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:41:50.412-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 200ms 2015-03-02T11:41:51.561-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:51.781-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T11:41:51.845-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (35352 records 363171096 bytes) are inconsistent with full validation results (34352 records 352898096 bytes). Updating counters with new values. 2015-03-02T11:41:51.845-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34406 records 353452838 bytes) is inconsistent with full validation results (34352 records 352898096 bytes). Updating size storer with new values. 2015-03-02T11:41:51.845-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:51.856-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:51.862-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 300ms 2015-03-02T11:41:51.868-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:51.944-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34352 records 352898096 bytes) are inconsistent with full validation results (35352 records 363171096 bytes). Updating counters with new values. 2015-03-02T11:41:51.944-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34352 records 352898096 bytes) is inconsistent with full validation results (35352 records 363171096 bytes). Updating size storer with new values. 2015-03-02T11:41:51.944-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:51.948-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:53.240-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 325.0 } } ndeleted:32427 keyUpdates:0 writeConflicts:0 numYields:253 locks:{} 1287ms 2015-03-02T11:41:53.240-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 325.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1288ms 2015-03-02T11:41:53.243-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:53.331-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (3198 records 32853054 bytes) are inconsistent with full validation results (2925 records 30048525 bytes). Updating counters with new values. 2015-03-02T11:41:53.331-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (3298 records 33880354 bytes) is inconsistent with full validation results (2925 records 30048525 bytes). Updating size storer with new values. 2015-03-02T11:41:53.331-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:53.347-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:53.362-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 119ms 2015-03-02T11:41:53.367-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:53.381-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (3642 records 37414266 bytes) are inconsistent with full validation results (3751 records 38534023 bytes). Updating counters with new values. 2015-03-02T11:41:53.381-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (3279 records 33685167 bytes) is inconsistent with full validation results (3751 records 38534023 bytes). Updating size storer with new values. 2015-03-02T11:41:53.383-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:53.383-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:53.387-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:53.397-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (3761 records 38636753 bytes) are inconsistent with full validation results (3925 records 40321525 bytes). Updating counters with new values. 2015-03-02T11:41:53.397-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (3751 records 38534023 bytes) is inconsistent with full validation results (3925 records 40321525 bytes). Updating size storer with new values. 2015-03-02T11:41:53.397-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:53.398-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:53.405-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:53.422-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (3925 records 40321525 bytes) is inconsistent with full validation results (3856 records 39612688 bytes). Updating size storer with new values. 2015-03-02T11:41:53.423-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:53.423-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:53.432-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:53.448-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:53.448-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:53.456-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:41:53.464-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:41:53.465-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:41:54.095-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T11:41:56.167-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59421 #5 (4 connections now open) 2015-03-02T11:41:56.184-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:56.281-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (8414 records 86437022 bytes) is inconsistent with full validation results (8856 records 90977688 bytes). Updating size storer with new values. 2015-03-02T11:41:56.281-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:56.282-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:56.287-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:56.306-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:56.307-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:56.311-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:56.331-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:56.333-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:56.341-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:56.364-0500 I NETWORK [conn1] end connection 10.4.127.218:59417 (3 connections now open) 2015-03-02T11:41:56.376-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:56.377-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:56.380-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:56.400-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:56.401-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:56.404-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:41:56.424-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:41:56.425-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:41:58.401-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:41:58.537-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13414 records 137802022 bytes) is inconsistent with full validation results (13856 records 142342688 bytes). Updating size storer with new values. 2015-03-02T11:41:58.538-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:41:58.540-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:41:58.542-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 140ms 2015-03-02T11:41:58.547-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:41:58.629-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:41:58.631-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:41:58.847-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:41:59.453-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1235.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17060 nscannedObjects:17060 nMatched:8530 nModified:8530 keyUpdates:1 writeConflicts:0 numYields:137 locks:{} 811ms 2015-03-02T11:41:59.453-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1235.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 811ms 2015-03-02T11:41:59.456-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:41:59.549-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (14856 records 152713942 bytes) is inconsistent with full validation results (14856 records 152726578 bytes). Updating size storer with new values. 2015-03-02T11:41:59.549-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:41:59.552-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:41:59.558-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:41:59.622-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:41:59.629-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:41:59.650-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:41:59.685-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:41:59.687-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:42:00.682-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:42:00.683-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:42:03.214-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:42:05.837-0500 I NETWORK [conn3] end connection 10.4.127.218:59419 (2 connections now open) 2015-03-02T11:42:05.873-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59422 #6 (3 connections now open) 2015-03-02T11:42:08.634-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:09.217-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (33884 records 348201222 bytes) is inconsistent with full validation results (34856 records 358186578 bytes). Updating size storer with new values. 2015-03-02T11:42:09.217-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:09.222-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:09.226-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 592ms 2015-03-02T11:42:09.246-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:09.363-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:09.368-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:09.372-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 125ms 2015-03-02T11:42:09.379-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:09.487-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:09.491-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:09.495-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 115ms 2015-03-02T11:42:10.441-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T11:42:10.446-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:42:10.706-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:42:10.715-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:42:10.729-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 283ms 2015-03-02T11:42:10.866-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 7872.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:23572 nscannedObjects:23572 nMatched:11786 nModified:11786 keyUpdates:1 writeConflicts:0 numYields:191 locks:{} 1363ms 2015-03-02T11:42:10.867-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7872.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1364ms 2015-03-02T11:42:10.870-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:11.024-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T11:42:11.075-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (36856 records 378774906 bytes) are inconsistent with full validation results (35856 records 368501906 bytes). Updating counters with new values. 2015-03-02T11:42:11.075-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (36098 records 370987972 bytes) is inconsistent with full validation results (35856 records 368501906 bytes). Updating size storer with new values. 2015-03-02T11:42:11.075-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:11.082-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:11.091-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 221ms 2015-03-02T11:42:11.096-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:11.215-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (35856 records 368501906 bytes) are inconsistent with full validation results (36856 records 378774906 bytes). Updating counters with new values. 2015-03-02T11:42:11.215-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35856 records 368501906 bytes) is inconsistent with full validation results (36856 records 378774906 bytes). Updating size storer with new values. 2015-03-02T11:42:11.215-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:11.226-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:11.237-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 141ms 2015-03-02T11:42:11.246-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:11.366-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:11.384-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:11.395-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 148ms 2015-03-02T11:42:11.402-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:11.512-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:11.517-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:11.521-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 118ms 2015-03-02T11:42:12.174-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 8005.0 } } ndeleted:12786 keyUpdates:0 writeConflicts:0 numYields:101 locks:{} 646ms 2015-03-02T11:42:12.174-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8005.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 646ms 2015-03-02T11:42:12.176-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:12.301-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24614 records 252866694 bytes) is inconsistent with full validation results (24070 records 247271110 bytes). Updating size storer with new values. 2015-03-02T11:42:12.301-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:12.319-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:12.329-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 153ms 2015-03-02T11:42:12.350-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:12.465-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:12.472-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:12.478-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 127ms 2015-03-02T11:42:12.483-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:42:12.589-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:42:12.592-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:42:12.595-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 112ms 2015-03-02T11:42:17.509-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:42:19.457-0500 I NETWORK [conn4] end connection 10.4.127.218:59420 (2 connections now open) 2015-03-02T11:42:19.505-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59431 #7 (3 connections now open) 2015-03-02T11:42:19.813-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpd2015-03-02T11:42:53.400-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:42:53.429-0500 I CONTROL [initandlisten] MongoDB starting : pid=2583 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:42:53.429-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:42:53.429-0500 I CONTROL [initandlisten] 2015-03-02T11:42:53.429-0500 I CONTROL [initandlisten] 2015-03-02T11:42:53.429-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:42:53.429-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:42:53.429-0500 I CONTROL [initandlisten] 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:42:53.430-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:42:53.435-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:42:53.482-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:42:53.569-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:42:54.624-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59476 #1 (1 connection now open) 2015-03-02T11:42:54.658-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:42:55.264-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:42:55.269-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:42:55.272-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 613ms 2015-03-02T11:42:55.287-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:42:55.397-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:42:55.400-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:42:55.403-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T11:42:55.413-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:42:55.482-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:42:55.487-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:42:55.495-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:42:55.561-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:42:55.565-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:42:56.105-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59484 #2 (2 connections now open) 2015-03-02T11:42:56.304-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 6951.0 } } ndeleted:527 keyUpdates:0 writeConflicts:20 numYields:20 locks:{} 185ms 2015-03-02T11:42:56.304-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6951.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 185ms 2015-03-02T11:42:56.308-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1326.0 } } ndeleted:0 keyUpdates:0 writeConflicts:17 numYields:202 locks:{} 735ms 2015-03-02T11:42:56.308-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1326.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 735ms 2015-03-02T11:42:56.308-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:42:56.308-0500 I NETWORK [conn1] end connection 10.4.127.218:59476 (1 connection now open) 2015-03-02T11:42:56.343-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (8298 records 85245566 bytes) is inconsistent with full validation results (7494 records 76985862 bytes). Updating size storer with new values. 2015-03-02T11:42:56.343-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:42:56.347-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:42:56.351-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:42:56.364-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:42:56.365-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:42:56.369-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:42:56.382-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:42:56.383-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:42:56.386-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:42:56.399-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:42:56.400-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:42:59.419-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59489 #3 (2 connections now open) 2015-03-02T11:42:59.434-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:42:59.553-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11690 records 120091370 bytes) is inconsistent with full validation results (12494 records 128350862 bytes). Updating size storer with new values. 2015-03-02T11:42:59.554-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:42:59.556-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:42:59.557-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 123ms 2015-03-02T11:42:59.624-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:42:59.679-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11298 records 116064354 bytes) is inconsistent with full validation results (11167 records 114718591 bytes). Updating size storer with new values. 2015-03-02T11:42:59.679-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:42:59.693-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:42:59.705-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:42:59.748-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:42:59.750-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:42:59.808-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:42:59.845-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (10298 records 105791354 bytes) is inconsistent with full validation results (10271 records 105513983 bytes). Updating size storer with new values. 2015-03-02T11:42:59.845-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:42:59.851-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:42:59.859-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:42:59.907-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:42:59.912-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:43:00.828-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59490 #4 (3 connections now open) 2015-03-02T11:43:00.844-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:43:00.875-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12244 records 125782612 bytes) is inconsistent with full validation results (12257 records 125916161 bytes). Updating size storer with new values. 2015-03-02T11:43:00.875-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:43:00.877-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:43:01.711-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:43:01.836-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:43:02.810-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T11:43:03.555-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T11:43:04.406-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:43:05.045-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:05.342-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23257 records 238919161 bytes) are inconsistent with full validation results (22257 records 228646161 bytes). Updating counters with new values. 2015-03-02T11:43:05.342-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23216 records 238497968 bytes) is inconsistent with full validation results (22257 records 228646161 bytes). Updating size storer with new values. 2015-03-02T11:43:05.343-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:05.354-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:05.362-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 316ms 2015-03-02T11:43:05.768-0500 I NETWORK [conn4] end connection 10.4.127.218:59490 (2 connections now open) 2015-03-02T11:43:05.824-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59494 #5 (3 connections now open) 2015-03-02T11:43:05.841-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:05.987-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 158ms 2015-03-02T11:43:06.005-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (23257 records 238978402 bytes) are inconsistent with full validation results (23294 records 239345919 bytes). Updating counters with new values. 2015-03-02T11:43:06.005-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (23035 records 236692908 bytes) is inconsistent with full validation results (23294 records 239345919 bytes). Updating size storer with new values. 2015-03-02T11:43:06.005-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:06.015-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:06.025-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 184ms 2015-03-02T11:43:06.041-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:06.160-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (23294 records 239356670 bytes) are inconsistent with full validation results (24257 records 249254197 bytes). Updating counters with new values. 2015-03-02T11:43:06.160-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (23294 records 239351145 bytes) is inconsistent with full validation results (24257 records 249254197 bytes). Updating size storer with new values. 2015-03-02T11:43:06.160-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:06.163-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3801.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:10768 nscannedObjects:10768 nMatched:5384 nModified:5384 keyUpdates:1 writeConflicts:0 numYields:90 locks:{} 797ms 2015-03-02T11:43:06.163-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3801.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 797ms 2015-03-02T11:43:06.169-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:06.175-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:06.180-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T11:43:06.316-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (24257 records 249254197 bytes) are inconsistent with full validation results (24257 records 249262153 bytes). Updating counters with new values. 2015-03-02T11:43:06.316-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (24257 records 249254197 bytes) is inconsistent with full validation results (24257 records 249262153 bytes). Updating size storer with new values. 2015-03-02T11:43:06.316-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:06.322-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:06.328-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 158ms 2015-03-02T11:43:06.597-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6400.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6115 nscannedObjects:6115 nMatched:3105 nModified:3105 keyUpdates:1 writeConflicts:56 numYields:51 locks:{} 405ms 2015-03-02T11:43:06.597-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6400.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 405ms 2015-03-02T11:43:06.600-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:06.746-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (19753 records 202934009 bytes) are inconsistent with full validation results (21448 records 220368779 bytes). Updating counters with new values. 2015-03-02T11:43:06.746-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19803 records 203448309 bytes) is inconsistent with full validation results (21448 records 220368779 bytes). Updating size storer with new values. 2015-03-02T11:43:06.746-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:06.759-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:06.763-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 163ms 2015-03-02T11:43:06.777-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:06.828-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 6726.0 } } ndeleted:3116 keyUpdates:0 writeConflicts:23 numYields:35 locks:{} 496ms 2015-03-02T11:43:06.828-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6726.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 496ms 2015-03-02T11:43:06.830-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:06.884-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (20568 records 211317099 bytes) are inconsistent with full validation results (19546 records 200804807 bytes). Updating counters with new values. 2015-03-02T11:43:06.884-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21448 records 220368779 bytes) is inconsistent with full validation results (19546 records 200804807 bytes). Updating size storer with new values. 2015-03-02T11:43:06.884-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:06.889-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:06.896-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 119ms 2015-03-02T11:43:06.906-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:06.938-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19546 records 200804807 bytes) are inconsistent with full validation results (18873 records 193882329 bytes). Updating counters with new values. 2015-03-02T11:43:06.938-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19546 records 200804807 bytes) is inconsistent with full validation results (18873 records 193882329 bytes). Updating size storer with new values. 2015-03-02T11:43:06.938-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:06.947-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:06.952-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T11:43:06.964-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:07.025-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:07.032-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:07.040-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 133ms 2015-03-02T11:43:07.047-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:07.082-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:07.091-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:07.098-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 133ms 2015-03-02T11:43:07.159-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (18873 records 193887347 bytes) are inconsistent with full validation results (18873 records 193882329 bytes). Updating counters with new values. 2015-03-02T11:43:07.159-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18873 records 193883239 bytes) is inconsistent with full validation results (18873 records 193882329 bytes). Updating size storer with new values. 2015-03-02T11:43:07.159-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:07.166-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:07.171-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 123ms 2015-03-02T11:43:07.742-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 242ms 2015-03-02T11:43:08.972-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1107.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20132 nscannedObjects:20132 nMatched:9934 nModified:9934 keyUpdates:1 writeConflicts:0 numYields:175 locks:{} 1871ms 2015-03-02T11:43:08.973-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1107.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1871ms 2015-03-02T11:43:08.976-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:09.028-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6452.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:19868 nscannedObjects:19868 nMatched:9934 nModified:9934 keyUpdates:1 writeConflicts:0 numYields:173 locks:{} 1852ms 2015-03-02T11:43:09.028-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6452.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1852ms 2015-03-02T11:43:09.038-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:09.159-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19873 records 204279453 bytes) are inconsistent with full validation results (19873 records 204284471 bytes). Updating counters with new values. 2015-03-02T11:43:09.159-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19873 records 204276177 bytes) is inconsistent with full validation results (19873 records 204284471 bytes). Updating size storer with new values. 2015-03-02T11:43:09.159-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:09.162-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:09.165-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:09.168-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:09.173-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T11:43:09.180-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 203ms 2015-03-02T11:43:09.188-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:09.261-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:09.266-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:09.916-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 7833.0 } } ndeleted:9934 keyUpdates:0 writeConflicts:0 numYields:78 locks:{} 644ms 2015-03-02T11:43:09.916-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7833.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 644ms 2015-03-02T11:43:09.918-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:10.045-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (11671 records 119905699 bytes) is inconsistent with full validation results (10939 records 112376347 bytes). Updating size storer with new values. 2015-03-02T11:43:10.045-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:10.069-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:10.085-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T11:43:10.453-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:43:11.738-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:43:12.530-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T11:43:13.411-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:43:13.672-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (18207 records 187040511 bytes) is inconsistent with full validation results (18939 records 194560347 bytes). Updating size storer with new values. 2015-03-02T11:43:13.673-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:43:13.676-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:43:13.677-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 266ms 2015-03-02T11:43:13.681-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:43:13.730-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:43:13.736-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:43:13.758-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:43:13.839-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:43:13.856-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:43:13.863-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T11:43:14.015-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:43:14.108-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 7555.0 } } ndeleted:2445 keyUpdates:0 writeConflicts:0 numYields:20 locks:{} 239ms 2015-03-02T11:43:14.108-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7555.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 239ms 2015-03-02T11:43:14.109-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:43:14.246-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (18220 records 187174060 bytes) are inconsistent with full validation results (17494 records 179715862 bytes). Updating counters with new values. 2015-03-02T11:43:14.246-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (17671 records 181534183 bytes) is inconsistent with full validation results (17494 records 179715862 bytes). Updating size storer with new values. 2015-03-02T11:43:14.246-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:43:14.257-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:43:14.274-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T11:43:14.282-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:43:15.340-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:43:17.379-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T11:43:18.497-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 164ms 2015-03-02T11:43:18.548-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T11:43:18.807-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:43:19.433-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59497 #6 (4 connections now open) 2015-03-02T11:43:19.444-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:43:19.455-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T11:43:19.543-0500 I NETWORK [conn3] end connection 10.4.127.218:59489 (3 connections now open) 2015-03-02T11:43:19.977-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (30354 records 311826642 bytes) are inconsistent with full validation results (30435 records 312658755 bytes). Updating counters with new values. 2015-03-02T11:43:19.979-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (29591 records 303988343 bytes) is inconsistent with full validation results (30435 records 312658755 bytes). Updating size storer with new values. 2015-03-02T11:43:19.979-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:43:19.991-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:43:20.006-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 562ms 2015-03-02T11:43:20.053-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T11:43:20.801-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6192.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11958 nscannedObjects:11958 nMatched:5979 nModified:5979 keyUpdates:1 writeConflicts:0 numYields:100 locks:{} 786ms 2015-03-02T11:43:20.807-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6192.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 792ms 2015-03-02T11:43:20.810-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:43:20.965-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:43:20.990-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (31829 records 327057044 bytes) are inconsistent with full validation results (31494 records 323615589 bytes). Updating counters with new values. 2015-03-02T11:43:20.990-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (31673 records 325454456 bytes) is inconsistent with full validation results (31494 records 323615589 bytes). Updating size storer with new values. 2015-03-02T11:43:20.991-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:43:21.009-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:43:21.024-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 213ms 2015-03-02T11:43:21.330-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:43:21.334-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:21.502-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (27074 records 278145879 bytes) are inconsistent with full validation results (30240 records 310698355 bytes). Updating counters with new values. 2015-03-02T11:43:21.502-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (27650 records 284070615 bytes) is inconsistent with full validation results (30240 records 310698355 bytes). Updating size storer with new values. 2015-03-02T11:43:21.504-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:21.517-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:21.525-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 190ms 2015-03-02T11:43:21.540-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:21.611-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 8430.0 } } ndeleted:6549 keyUpdates:0 writeConflicts:0 numYields:52 locks:{} 581ms 2015-03-02T11:43:21.611-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8430.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 581ms 2015-03-02T11:43:21.613-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:43:21.716-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (29111 records 299085461 bytes) are inconsistent with full validation results (27644 records 283995899 bytes). Updating counters with new values. 2015-03-02T11:43:21.717-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (29816 records 306337091 bytes) is inconsistent with full validation results (27644 records 283995899 bytes). Updating size storer with new values. 2015-03-02T11:43:21.717-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:21.727-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:21.733-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 192ms 2015-03-02T11:43:21.749-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:21.758-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (27644 records 283995899 bytes) are inconsistent with full validation results (26945 records 276805985 bytes). Updating counters with new values. 2015-03-02T11:43:21.758-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (27644 records 283995899 bytes) is inconsistent with full validation results (26945 records 276805985 bytes). Updating size storer with new values. 2015-03-02T11:43:21.758-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:43:21.774-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:43:21.781-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T11:43:21.797-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:43:21.916-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:21.927-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:21.934-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 184ms 2015-03-02T11:43:21.947-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:43:21.966-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:43:21.975-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:43:21.980-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 183ms 2015-03-02T11:43:22.083-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:43:22.090-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:43:22.104-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 157ms 2015-03-02T11:43:22.604-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 164ms 2015-03-02T11:43:22.607-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:23.002-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (27240 records 279836520 bytes) is inconsistent with full validation results (27945 records 287078985 bytes). Updating size storer with new values. 2015-03-02T11:43:23.002-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:23.011-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:23.014-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 406ms 2015-03-02T11:43:23.024-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:43:23.142-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:43:23.146-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:43:23.149-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 124ms 2015-03-02T11:43:23.525-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T11:43:23.528-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:43:24.700-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T11:43:25.491-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T11:43:25.748-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T11:43:26.068-0500 I NETWORK [conn2] end connection 10.4.127.218:59484 (2 connections now open) 2015-03-02T11:43:26.132-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59502 #7 (3 connections now open) 2015-03-02T11:43:26.149-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:43:26.605-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (35240 records 362020520 bytes) is inconsistent with full validation results (35945 records 369262985 bytes). Updating size storer with new values. 2015-03-02T11:43:26.605-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:43:26.616-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:43:26.623-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 474ms 2015-03-02T11:43:26.631-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:43:26.880-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (36337 records 373290001 bytes) are inconsistent with full validation results (35945 records 369262985 bytes). Updating counters with new values. 2015-03-02T11:43:26.880-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (36240 records 372293520 bytes) is inconsistent with full validation results (35945 records 369262985 bytes). Updating size storer with new values. 2015-03-02T11:43:26.880-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:43:26.894-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:43:26.903-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 272ms 2015-03-02T11:43:26.921-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:43:26.928-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:43:27.099-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (36553 records 375508969 bytes) are inconsistent with full validation results (36923 records 379309979 bytes). Updating counters with new values. 2015-03-02T11:43:27.099-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (35945 records 369262985 bytes) is inconsistent with full validation results (36923 records 379309979 bytes). Updating size storer with new values. 2015-03-02T11:43:27.099-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:43:27.113-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T11:43:27.120-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 199ms 2015-03-02T11:43:27.458-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 181ms 2015-03-02T11:43:28.022-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 189ms 2015-03-02T11:43:29.001-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 202ms 2015-03-02T11:43:29.284-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 202ms 2015-03-02T11:43:30.771-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 176ms 2015-03-02T11:43:30.799-0500 I WRITE [conn7] update test.foo query: { x: { $gte: 1736.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:41180 nscannedObjects:41180 nMatched:20590 nModified:20590 keyUpdates:1 writeConflicts:0 numYields:362 locks:{} 3671ms 2015-03-02T11:43:30.799-0500 I COMMAND [conn7] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1736.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3671ms 2015-03-02T11:43:30.804-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T11:43:30.932-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 163ms 2015-03-02T11:43:31.170-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (42923 records 441215649 bytes) are inconsistent with full validation results (42173 records 433510899 bytes). Updating counters with new values. 2015-03-02T11:43:31.170-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (42628 records 438185114 bytes) is inconsistent with full validation results (42173 records 433510899 bytes). Updating size storer with new values. 2015-03-02T11:43:31.171-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T11:43:31.177-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12015-03-02T11:44:08.210-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] MongoDB starting : pid=2576 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:44:08.225-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:44:08.225-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:44:08.262-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:44:08.313-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:44:09.521-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59533 #1 (1 connection now open) 2015-03-02T11:44:11.414-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2661.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:54226 nscannedObjects:54226 nMatched:27113 nModified:27113 keyUpdates:1 writeConflicts:0 numYields:423 locks:{} 1885ms 2015-03-02T11:44:11.414-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2661.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1885ms 2015-03-02T11:44:11.417-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:44:11.612-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:44:11.618-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:44:11.629-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 211ms 2015-03-02T11:44:14.348-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59534 #2 (2 connections now open) 2015-03-02T11:44:15.732-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59535 #3 (3 connections now open) 2015-03-02T11:44:15.751-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:44:15.829-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 4935.0 } } ndeleted:27178 keyUpdates:0 writeConflicts:0 numYields:213 locks:{} 1471ms 2015-03-02T11:44:15.830-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4935.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1471ms 2015-03-02T11:44:15.835-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:44:16.025-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (16263 records 167069799 bytes) are inconsistent with full validation results (17152 records 176205659 bytes). Updating counters with new values. 2015-03-02T11:44:16.025-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (16411 records 168583733 bytes) is inconsistent with full validation results (17152 records 176205659 bytes). Updating size storer with new values. 2015-03-02T11:44:16.026-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:44:16.026-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (17152 records 176205659 bytes) are inconsistent with full validation results (16121 records 165611033 bytes). Updating counters with new values. 2015-03-02T11:44:16.026-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (17152 records 176205659 bytes) is inconsistent with full validation results (16121 records 165611033 bytes). Updating size storer with new values. 2015-03-02T11:44:16.026-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:44:16.042-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:44:16.044-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:44:16.048-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 213ms 2015-03-02T11:44:16.050-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 298ms 2015-03-02T11:44:16.058-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:44:16.060-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:44:16.157-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 192ms 2015-03-02T11:44:16.177-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (16979 records 174425267 bytes) are inconsistent with full validation results (16456 records 169052488 bytes). Updating counters with new values. 2015-03-02T11:44:16.177-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (16689 records 171446097 bytes) is inconsistent with full validation results (16456 records 169052488 bytes). Updating size storer with new values. 2015-03-02T11:44:16.178-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:44:16.184-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:44:16.186-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (16456 records 169052488 bytes) are inconsistent with full validation results (16458 records 169073034 bytes). Updating counters with new values. 2015-03-02T11:44:16.186-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16456 records 169052488 bytes) is inconsistent with full validation results (16458 records 169073034 bytes). Updating size storer with new values. 2015-03-02T11:44:16.187-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:44:16.195-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 137ms 2015-03-02T11:44:16.195-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:44:16.201-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 141ms 2015-03-02T11:44:16.212-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:44:16.258-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (16458 records 169073034 bytes) are inconsistent with full validation results (17121 records 175884033 bytes). Updating counters with new values. 2015-03-02T11:44:16.258-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16458 records 169073034 bytes) is inconsistent with full validation results (17121 records 175884033 bytes). Updating size storer with new values. 2015-03-02T11:44:16.258-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:44:16.260-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:44:16.265-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:44:16.333-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:44:16.341-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:44:18.090-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:44:18.169-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19831 records 203723863 bytes) is inconsistent with full validation results (20121 records 206703033 bytes). Updating size storer with new values. 2015-03-02T11:44:18.170-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:44:18.184-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:44:18.199-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:44:18.268-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:44:18.271-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:44:18.757-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 163ms 2015-03-02T11:44:19.307-0500 I NETWORK [conn2] end connection 10.4.127.218:59534 (2 connections now open) 2015-03-02T11:44:19.321-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59540 #4 (3 connections now open) 2015-03-02T11:44:19.453-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 9110.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:1780 nscannedObjects:1780 nMatched:890 nModified:890 keyUpdates:1 writeConflicts:0 numYields:14 locks:{} 120ms 2015-03-02T11:44:19.453-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9110.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 120ms 2015-03-02T11:44:19.457-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:44:19.613-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (23121 records 237531263 bytes) is inconsistent with full validation results (23121 records 237533603 bytes). Updating size storer with new values. 2015-03-02T11:44:19.614-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:44:19.618-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:44:19.628-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 170ms 2015-03-02T11:44:22.625-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:44:23.253-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T11:44:23.705-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:44:24.819-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T11:44:25.113-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T11:44:25.590-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T11:44:25.974-0500 I NETWORK [conn1] end connection 10.4.127.218:59533 (2 connections now open) 2015-03-02T11:44:26.015-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59541 #5 (3 connections now open) 2015-03-02T11:44:26.126-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 7947.0 } } ndeleted:2053 keyUpdates:0 writeConflicts:0 numYields:16 locks:{} 103ms 2015-03-02T11:44:26.127-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7947.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:44:26.133-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:44:26.582-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (34301 records 352377202 bytes) is inconsistent with full validation results (34068 records 349980564 bytes). Updating size storer with new values. 2015-03-02T11:44:26.583-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:44:26.623-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:44:26.635-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 501ms 2015-03-02T11:44:26.644-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:44:26.780-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:44:26.786-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:44:26.792-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 148ms 2015-03-02T11:44:26.807-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:44:26.930-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:44:27.122-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (35068 records 360253564 bytes) are inconsistent with full validation results (34068 records 349980564 bytes). Updating counters with new values. 2015-03-02T11:44:27.122-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (34835 records 357859955 bytes) is inconsistent with full validation results (34068 records 349980564 bytes). Updating size storer with new values. 2015-03-02T11:44:27.122-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:44:27.127-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:44:27.130-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 323ms 2015-03-02T11:44:28.384-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T11:44:28.724-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3140.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22644 nscannedObjects:22644 nMatched:11322 nModified:11322 keyUpdates:1 writeConflicts:0 numYields:193 locks:{} 1591ms 2015-03-02T11:44:28.724-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3140.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1591ms 2015-03-02T11:44:28.727-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:44:28.789-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T11:44:28.960-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (36068 records 370673750 bytes) are inconsistent with full validation results (36389 records 373971383 bytes). Updating counters with new values. 2015-03-02T11:44:28.960-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35513 records 364972235 bytes) is inconsistent with full validation results (36389 records 373971383 bytes). Updating size storer with new values. 2015-03-02T11:44:28.960-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:44:28.971-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:44:28.990-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 262ms 2015-03-02T11:44:29.007-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:44:29.148-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (36389 records 373971383 bytes) are inconsistent with full validation results (37068 records 380946750 bytes). Updating counters with new values. 2015-03-02T11:44:29.148-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (36389 records 373971383 bytes) is inconsistent with full validation results (37068 records 380946750 bytes). Updating size storer with new values. 2015-03-02T11:44:29.148-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:44:29.161-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:44:29.176-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 168ms 2015-03-02T11:44:31.858-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T11:44:32.421-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:44:33.699-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:44:34.697-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:44:35.104-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (46513 records 477975235 bytes) is inconsistent with full validation results (47068 records 483676750 bytes). Updating size storer with new values. 2015-03-02T11:44:35.104-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:44:35.111-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:44:35.124-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 426ms 2015-03-02T11:44:35.135-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:44:35.326-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:44:35.348-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:44:35.360-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 224ms 2015-03-02T11:44:35.370-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:44:35.538-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:44:35.546-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:44:35.552-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 182ms 2015-03-02T11:44:35.686-0500 I NETWORK [conn3] end connection 10.4.127.218:59535 (2 connections now open) 2015-03-02T11:44:35.748-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59542 #6 (3 connections now open) 2015-03-02T11:44:35.797-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:44:36.110-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (47068 records 483704414 bytes) are inconsistent with full validation results (47068 records 483704271 bytes). Updating counters with new values. 2015-03-02T11:44:36.110-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (47068 records 483704414 bytes) is inconsistent with full validation results (47068 records 483704271 bytes). Updating size storer with new values. 2015-03-02T11:44:36.110-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:44:36.135-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:44:36.146-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 348ms 2015-03-02T11:44:36.833-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:44:36.955-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7936.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13020 nscannedObjects:13020 nMatched:4698 nModified:4698 keyUpdates:1 writeConflicts:7222 numYields:117 locks:{} 1399ms 2015-03-02T11:44:36.955-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7936.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1399ms 2015-03-02T11:44:36.958-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:44:37.229-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (35752 records 367294895 bytes) are inconsistent with full validation results (38852 records 399181638 bytes). Updating counters with new values. 2015-03-02T11:44:37.229-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (36321 records 373147629 bytes) is inconsistent with full validation results (38852 records 399181638 bytes). Updating size storer with new values. 2015-03-02T11:44:37.231-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:44:37.253-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:44:37.263-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 305ms 2015-03-02T11:44:37.326-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:44:37.357-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 8253.0 } } ndeleted:5652 keyUpdates:0 writeConflicts:13 numYields:105 locks:{} 1204ms 2015-03-02T11:44:37.357-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8253.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1204ms 2015-03-02T11:44:37.362-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:44:37.550-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (37718 records 387517314 bytes) are inconsistent with full validation results (34922 records 358757658 bytes). Updating counters with new values. 2015-03-02T11:44:37.550-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (38421 records 394748372 bytes) is inconsistent with full validation results (34922 records 358757658 bytes). Updating size storer with new values. 2015-03-02T11:44:37.550-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:44:37.552-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (34922 records 358757658 bytes) are inconsistent with full validation results (34618 records 355630714 bytes). Updating counters with new values. 2015-03-02T11:44:37.552-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (34922 records 358757658 bytes) is inconsistent with full validation results (34618 records 355630714 bytes). Updating size storer with new values. 2015-03-02T11:44:37.552-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:44:37.560-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:44:37.563-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:44:37.569-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 207ms 2015-03-02T11:44:37.570-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 244ms 2015-03-02T11:44:37.575-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:44:38.030-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (34618 records 355668518 bytes) are inconsistent with full validation results (34618 records 355630714 bytes). Updating counters with new values. 2015-03-02T11:44:38.031-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (34618 records 355660575 bytes) is inconsistent with full validation results (34618 records 355630714 bytes). Updating size storer with new values. 2015-03-02T11:44:38.032-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:44:38.042-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:44:38.054-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 478ms 2015-03-02T11:44:38.471-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 3915.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13914 nscannedObjects:13914 nMatched:6957 nModified:6957 keyUpdates:1 writeConflicts:0 numYields:116 locks:{} 896ms 2015-03-02T11:44:38.471-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3915.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 897ms 2015-03-02T11:44:38.473-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:44:38.584-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (34618 records 355683143 bytes) are inconsistent with full validation results (34618 records 355721155 bytes). Updating counters with new values. 2015-03-02T11:44:38.584-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (34618 records 355674563 bytes) is inconsistent with full validation results (34618 records 355721155 bytes). Updating size storer with new values. 2015-03-02T11:44:38.584-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:44:38.589-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:44:38.594-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 121ms 2015-03-02T11:44:39.401-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T11:44:40.214-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 1986.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31704 nscannedObjects:31704 nMatched:15852 nModified:15852 keyUpdates:1 writeConflicts:0 numYields:257 locks:{} 1610ms 2015-03-02T11:44:40.214-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1986.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1610ms 2015-03-02T11:44:40.217-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:44:40.540-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:44:40.578-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (36618 records 376382790 bytes) are inconsistent with full validation results (35618 records 366109790 bytes). Updating counters with new values. 2015-03-02T11:44:40.582-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (36106 records 371123014 bytes) is inconsistent with full validation results (35618 records 366109790 bytes). Updating size storer with new values. 2015-03-02T11:44:40.582-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:44:40.598-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:44:40.632-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 414ms 2015-03-02T11:44:40.657-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:44:40.776-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (35618 records 366109790 bytes) are inconsistent with full validation results (36618 records 376382790 bytes). Updating counters with new values. 2015-03-02T11:44:40.776-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (35618 records 366109790 bytes) is inconsistent with full validation results (36618 records 376382790 bytes). Updating size storer with new values. 2015-03-02T11:44:40.776-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:44:40.783-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:44:40.789-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 131ms 2015-03-02T11:44:42.070-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T11:44:42.535-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T11:44:42.699-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6529.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31704 nscannedObjects:31704 nMatched:15852 nModified:15852 keyUpdates:1 writeConflicts:0 numYields:261 locks:{} 1904ms 2015-03-02T11:44:42.699-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6529.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1905ms 2015-03-02T11:44:42.701-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:44:42.897-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:44:42.907-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:44:42.919-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 218ms 2015-03-02T11:45:17.566-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] MongoDB starting : pid=2537 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:45:17.581-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:45:17.581-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:45:17.620-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:45:17.658-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:45:19.474-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59555 #1 (1 connection now open) 2015-03-02T11:45:19.555-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59556 #2 (2 connections now open) 2015-03-02T11:45:19.581-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:20.421-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383420203 bytes) are inconsistent with full validation results (37299 records 383333441 bytes). Updating counters with new values. 2015-03-02T11:45:20.422-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383407892 bytes) is inconsistent with full validation results (37299 records 383333441 bytes). Updating size storer with new values. 2015-03-02T11:45:20.422-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:20.431-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:20.440-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 859ms 2015-03-02T11:45:21.253-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59558 #3 (3 connections now open) 2015-03-02T11:45:23.138-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 209.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:51944 nscannedObjects:51944 nMatched:26226 nModified:26226 keyUpdates:1 writeConflicts:167 numYields:425 locks:{} 3657ms 2015-03-02T11:45:23.138-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 209.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3657ms 2015-03-02T11:45:23.142-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.269-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (6515 records 66900130 bytes) are inconsistent with full validation results (8107 records 83362060 bytes). Updating counters with new values. 2015-03-02T11:45:23.269-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6548 records 67239568 bytes) is inconsistent with full validation results (8107 records 83362060 bytes). Updating size storer with new values. 2015-03-02T11:45:23.269-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.287-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.304-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 162ms 2015-03-02T11:45:23.316-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.352-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (6967 records 71636020 bytes) are inconsistent with full validation results (5875 records 60403708 bytes). Updating counters with new values. 2015-03-02T11:45:23.352-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (7140 records 73415498 bytes) is inconsistent with full validation results (5875 records 60403708 bytes). Updating size storer with new values. 2015-03-02T11:45:23.352-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.361-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.371-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.412-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (5222 records 53686950 bytes) are inconsistent with full validation results (5168 records 53131506 bytes). Updating counters with new values. 2015-03-02T11:45:23.412-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5875 records 60403708 bytes) is inconsistent with full validation results (5168 records 53131506 bytes). Updating size storer with new values. 2015-03-02T11:45:23.412-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.423-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.432-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.463-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (4608 records 47371346 bytes) are inconsistent with full validation results (4499 records 46250172 bytes). Updating counters with new values. 2015-03-02T11:45:23.463-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (4994 records 51341742 bytes) is inconsistent with full validation results (4499 records 46250172 bytes). Updating size storer with new values. 2015-03-02T11:45:23.463-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.467-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.478-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.503-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (3964 records 40747162 bytes) are inconsistent with full validation results (3942 records 40520870 bytes). Updating counters with new values. 2015-03-02T11:45:23.504-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (4499 records 46250172 bytes) is inconsistent with full validation results (3942 records 40520870 bytes). Updating size storer with new values. 2015-03-02T11:45:23.504-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.504-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.599-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.609-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 1709.0 } } ndeleted:0 keyUpdates:0 writeConflicts:104 numYields:242 locks:{} 3164ms 2015-03-02T11:45:23.609-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1709.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3164ms 2015-03-02T11:45:23.610-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1569 records 16122432 bytes) are inconsistent with full validation results (1254 records 12882342 bytes). Updating counters with new values. 2015-03-02T11:45:23.610-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1863 records 19136276 bytes) is inconsistent with full validation results (1254 records 12882342 bytes). Updating size storer with new values. 2015-03-02T11:45:23.610-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.613-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.616-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.618-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.619-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.627-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.633-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.636-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (1254 records 12882342 bytes) is inconsistent with full validation results (1255 records 12882388 bytes). Updating size storer with new values. 2015-03-02T11:45:23.636-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.636-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.638-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.638-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.647-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.649-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.656-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.657-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.657-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.660-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.666-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.668-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.673-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.673-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.677-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1301 records 13354946 bytes) are inconsistent with full validation results (1255 records 12882388 bytes). Updating counters with new values. 2015-03-02T11:45:23.677-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.678-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.685-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.687-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.697-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (1395 records 14330835 bytes) are inconsistent with full validation results (1359 records 13961007 bytes). Updating counters with new values. 2015-03-02T11:45:23.697-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (1255 records 12882388 bytes) is inconsistent with full validation results (1359 records 13961007 bytes). Updating size storer with new values. 2015-03-02T11:45:23.697-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.698-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.699-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.700-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.706-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.709-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.713-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1451 records 14895896 bytes) are inconsistent with full validation results (1528 records 15686917 bytes). Updating counters with new values. 2015-03-02T11:45:23.713-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1359 records 13961007 bytes) is inconsistent with full validation results (1528 records 15686917 bytes). Updating size storer with new values. 2015-03-02T11:45:23.713-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.713-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.717-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (1598 records 16406027 bytes) are inconsistent with full validation results (1532 records 15728009 bytes). Updating counters with new values. 2015-03-02T11:45:23.717-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (1528 records 15686917 bytes) is inconsistent with full validation results (1532 records 15728009 bytes). Updating size storer with new values. 2015-03-02T11:45:23.718-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.718-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.738-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:45:23.743-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.749-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1718 records 17638787 bytes) are inconsistent with full validation results (1703 records 17484692 bytes). Updating counters with new values. 2015-03-02T11:45:23.749-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1532 records 15728009 bytes) is inconsistent with full validation results (1703 records 17484692 bytes). Updating size storer with new values. 2015-03-02T11:45:23.749-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:45:23.750-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:45:23.751-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (1703 records 17484692 bytes) are inconsistent with full validation results (1731 records 17772336 bytes). Updating counters with new values. 2015-03-02T11:45:23.751-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (1703 records 17484692 bytes) is inconsistent with full validation results (1731 records 17772336 bytes). Updating size storer with new values. 2015-03-02T11:45:23.752-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.752-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.765-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.783-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (1921 records 19724206 bytes) are inconsistent with full validation results (1848 records 18974277 bytes). Updating counters with new values. 2015-03-02T11:45:23.783-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (1896 records 19467381 bytes) is inconsistent with full validation results (1848 records 18974277 bytes). Updating size storer with new values. 2015-03-02T11:45:23.784-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.784-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.801-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.812-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (2087 records 21429524 bytes) are inconsistent with full validation results (2153 records 22107542 bytes). Updating counters with new values. 2015-03-02T11:45:23.812-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (1848 records 18974277 bytes) is inconsistent with full validation results (2153 records 22107542 bytes). Updating size storer with new values. 2015-03-02T11:45:23.812-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.813-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.817-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 159ms 2015-03-02T11:45:23.819-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.828-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (2190 records 22487643 bytes) are inconsistent with full validation results (2255 records 23155388 bytes). Updating counters with new values. 2015-03-02T11:45:23.828-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (2153 records 22107542 bytes) is inconsistent with full validation results (2255 records 23155388 bytes). Updating size storer with new values. 2015-03-02T11:45:23.829-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.829-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.836-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.845-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.846-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:23.856-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:23.862-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:23.863-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:25.129-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T11:45:25.265-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T11:45:25.932-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:45:26.187-0500 I NETWORK [conn3] end connection 10.4.127.218:59558 (2 connections now open) 2015-03-02T11:45:26.234-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59559 #4 (3 connections now open) 2015-03-02T11:45:27.522-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T11:45:28.133-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T11:45:28.971-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T11:45:29.660-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:45:31.735-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T11:45:31.740-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:45:31.898-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:45:33.173-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T11:45:33.206-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T11:45:33.580-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:34.155-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25953 records 266604942 bytes) is inconsistent with full validation results (26255 records 269707388 bytes). Updating size storer with new values. 2015-03-02T11:45:34.155-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:34.161-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:34.167-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 586ms 2015-03-02T11:45:35.184-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T11:45:35.664-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:45:35.806-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:45:35.913-0500 I NETWORK [conn1] end connection 10.4.127.218:59555 (2 connections now open) 2015-03-02T11:45:35.952-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59561 #5 (3 connections now open) 2015-03-02T11:45:35.959-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:45:36.225-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:45:36.259-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (32255 records 331345388 bytes) are inconsistent with full validation results (31255 records 321072388 bytes). Updating counters with new values. 2015-03-02T11:45:36.260-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (31953 records 328242942 bytes) is inconsistent with full validation results (31255 records 321072388 bytes). Updating size storer with new values. 2015-03-02T11:45:36.260-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:45:36.272-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:45:36.279-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 319ms 2015-03-02T11:45:37.349-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T11:45:37.530-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T11:45:38.404-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:45:38.868-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:45:39.672-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T11:45:40.477-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 213ms 2015-03-02T11:45:40.483-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:45:40.871-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (37255 records 383103638 bytes) are inconsistent with full validation results (38255 records 393340693 bytes). Updating counters with new values. 2015-03-02T11:45:40.871-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (37255 records 383096462 bytes) is inconsistent with full validation results (38255 records 393340693 bytes). Updating size storer with new values. 2015-03-02T11:45:40.871-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:45:40.879-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:45:40.891-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 407ms 2015-03-02T11:45:41.236-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T11:45:41.697-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 427.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:67731 nscannedObjects:67731 nMatched:33866 nModified:33866 keyUpdates:1 writeConflicts:0 numYields:585 locks:{} 5412ms 2015-03-02T11:45:41.697-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 427.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5413ms 2015-03-02T11:45:41.702-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:45:41.961-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (39255 records 403660688 bytes) are inconsistent with full validation results (39255 records 403696633 bytes). Updating counters with new values. 2015-03-02T11:45:41.961-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (39255 records 403658517 bytes) is inconsistent with full validation results (39255 records 403696633 bytes). Updating size storer with new values. 2015-03-02T11:45:41.962-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:45:41.976-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:45:41.987-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 285ms 2015-03-02T11:45:42.446-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 181ms 2015-03-02T11:45:42.627-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T11:45:44.119-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 1554.0 } } ndeleted:35866 keyUpdates:0 writeConflicts:0 numYields:286 locks:{} 2128ms 2015-03-02T11:45:44.119-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1554.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2128ms 2015-03-02T11:45:44.122-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:45:44.676-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (7084 records 72773932 bytes) are inconsistent with full validation results (5674 records 58289002 bytes). Updating counters with new values. 2015-03-02T11:45:44.677-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (6355 records 65284915 bytes) is inconsistent with full validation results (5674 records 58289002 bytes). Updating size storer with new values. 2015-03-02T11:45:44.677-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:45:44.700-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:45:44.701-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 213ms 2015-03-02T11:45:44.711-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 588ms 2015-03-02T11:45:46.094-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:45:46.100-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:46.228-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (8977 records 92220721 bytes) are inconsistent with full validation results (10389 records 106726197 bytes). Updating counters with new values. 2015-03-02T11:45:46.228-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (8943 records 91871439 bytes) is inconsistent with full validation results (10389 records 106726197 bytes). Updating size storer with new values. 2015-03-02T11:45:46.228-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:46.229-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:46.230-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 130ms 2015-03-02T11:45:46.234-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:46.260-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:46.261-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:46.436-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 7028.0 } } ndeleted:2972 keyUpdates:0 writeConflicts:0 numYields:23 locks:{} 163ms 2015-03-02T11:45:46.436-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7028.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 163ms 2015-03-02T11:45:46.437-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:46.456-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7423 records 76256479 bytes) is inconsistent with full validation results (7417 records 76194841 bytes). Updating size storer with new values. 2015-03-02T11:45:46.457-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:46.460-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:46.525-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:45:46.549-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (7417 records 76207763 bytes) is inconsistent with full validation results (7417 records 76208205 bytes). Updating size storer with new values. 2015-03-02T11:45:46.549-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:45:46.552-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:45:46.858-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T11:45:46.867-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:45:49.112-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T11:45:49.312-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T11:45:49.539-0500 I NETWORK [conn2] end connection 10.4.127.218:59556 (2 connections now open) 2015-03-02T11:45:49.570-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59562 #6 (3 connections now open) 2015-03-02T11:45:49.581-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:45:49.715-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15383 records 158042923 bytes) is inconsistent with full validation results (15417 records 158392205 bytes). Updating size storer with new values. 2015-03-02T11:45:49.716-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:45:49.718-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:45:49.719-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 138ms 2015-03-02T11:45:50.349-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T11:45:50.456-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:45:50.560-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 2646.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9472 nscannedObjects:9472 nMatched:4736 nModified:4736 keyUpdates:1 writeConflicts:0 numYields:80 locks:{} 832ms 2015-03-02T11:45:50.560-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2646.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 832ms 2015-03-02T11:45:50.566-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:45:50.700-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (17254 records 177311910 bytes) is inconsistent with full validation results (17417 records 178986409 bytes). Updating size storer with new values. 2015-03-02T11:45:50.700-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:45:50.712-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:45:50.722-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 156ms 2015-03-02T11:45:50.732-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:45:50.795-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:45:50.798-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:45:51.564-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:45:51.699-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 5998.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11472 nscannedObjects:11472 nMatched:5736 nModified:5736 keyUpdates:1 writeConflicts:0 numYields:100 locks:{} 892ms 2015-03-02T11:45:51.699-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5998.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 893ms 2015-03-02T11:45:51.705-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:45:51.833-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:45:51.898-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (19417 records 199545409 bytes) are inconsistent with full validation results (18417 records 189272409 bytes). Updating counters with new values. 2015-03-02T11:45:51.898-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (18911 records 194347271 bytes) is inconsistent with full validation results (18417 records 189272409 bytes). Updating size storer with new values. 2015-03-02T11:45:51.898-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:45:51.909-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:45:51.913-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 207ms 2015-03-02T11:45:52.742-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6250.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13472 nscannedObjects:13472 nMatched:6736 nModified:6736 keyUpdates:1 writeConflicts:0 numYields:111 locks:{} 821ms 2015-03-02T11:45:52.742-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6250.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 821ms 2015-03-02T11:45:52.749-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:45:52.865-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (19417 records 199558409 bytes) are inconsistent with full validation results (20252 records 208136364 bytes). Updating counters with new values. 2015-03-02T11:45:52.865-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (19175 records 197072343 bytes) is inconsistent with full validation results (20252 records 208136364 bytes). Updating size storer with new values. 2015-03-02T11:45:52.865-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:45:52.872-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:45:52.879-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 130ms 2015-03-02T11:45:54.400-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:45:54.602-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (23252 records 238955364 bytes) are inconsistent with full validation results (23417 records 240650409 bytes). Updating counters with new values. 2015-03-02T11:45:54.602-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (23010 records 236469298 bytes) is inconsistent with full validation results (23417 records 240650409 bytes). Updating size storer with new values. 2015-03-02T11:45:54.602-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:45:54.620-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:45:54.622-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 221ms 2015-03-02T11:45:54.631-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:46:23.882-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] MongoDB starting : pid=2611 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:46:23.902-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:46:23.902-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:46:23.939-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:46:24.005-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:46:26.219-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59569 #1 (1 connection now open) 2015-03-02T11:46:26.231-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:26.609-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:26.614-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:26.617-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 384ms 2015-03-02T11:46:27.711-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7420.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32616 nscannedObjects:32616 nMatched:16308 nModified:16308 keyUpdates:1 writeConflicts:0 numYields:254 locks:{} 1089ms 2015-03-02T11:46:27.711-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7420.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1090ms 2015-03-02T11:46:27.714-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:27.783-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:27.787-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:27.798-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:27.888-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:27.892-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:27.900-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:27.969-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:27.974-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:29.575-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59571 #2 (2 connections now open) 2015-03-02T11:46:29.599-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:46:29.788-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39992 records 411039580 bytes) is inconsistent with full validation results (40299 records 414193391 bytes). Updating size storer with new values. 2015-03-02T11:46:29.791-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:46:29.798-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:46:29.805-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 206ms 2015-03-02T11:46:29.821-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:46:30.007-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:46:30.023-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:46:30.033-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 212ms 2015-03-02T11:46:30.057-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:46:30.292-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:46:30.303-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:46:30.308-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 250ms 2015-03-02T11:46:30.504-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T11:46:30.971-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59572 #3 (3 connections now open) 2015-03-02T11:46:31.594-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 201ms 2015-03-02T11:46:32.064-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 8773.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24237 nscannedObjects:24237 nMatched:12125 nModified:12125 keyUpdates:1 writeConflicts:57 numYields:202 locks:{} 1750ms 2015-03-02T11:46:32.064-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8773.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1750ms 2015-03-02T11:46:32.069-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:46:32.370-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (30463 records 312994295 bytes) are inconsistent with full validation results (33256 records 341723093 bytes). Updating counters with new values. 2015-03-02T11:46:32.370-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (30731 records 315750943 bytes) is inconsistent with full validation results (33256 records 341723093 bytes). Updating size storer with new values. 2015-03-02T11:46:32.374-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:46:32.394-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:46:32.419-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 349ms 2015-03-02T11:46:32.789-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T11:46:32.852-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 8769.0 } } ndeleted:12189 keyUpdates:0 writeConflicts:39 numYields:124 locks:{} 1860ms 2015-03-02T11:46:32.852-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8769.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1861ms 2015-03-02T11:46:32.857-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:46:33.082-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (29784 records 306007341 bytes) are inconsistent with full validation results (26991 records 277278543 bytes). Updating counters with new values. 2015-03-02T11:46:33.082-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (30382 records 312149052 bytes) is inconsistent with full validation results (26991 records 277278543 bytes). Updating size storer with new values. 2015-03-02T11:46:33.082-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:46:33.094-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:46:33.108-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 251ms 2015-03-02T11:46:34.019-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T11:46:35.303-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T11:46:35.571-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:46:35.575-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:35.734-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T11:46:35.900-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33991 records 349189543 bytes) are inconsistent with full validation results (32991 records 338916543 bytes). Updating counters with new values. 2015-03-02T11:46:35.900-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (33251 records 341587523 bytes) is inconsistent with full validation results (32991 records 338916543 bytes). Updating size storer with new values. 2015-03-02T11:46:35.901-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:35.907-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:35.910-0500 I NETWORK [conn3] end connection 10.4.127.218:59572 (2 connections now open) 2015-03-02T11:46:35.916-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 341ms 2015-03-02T11:46:35.950-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59573 #4 (3 connections now open) 2015-03-02T11:46:36.511-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:46:37.770-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3376.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31998 nscannedObjects:31998 nMatched:15999 nModified:15999 keyUpdates:1 writeConflicts:0 numYields:261 locks:{} 1848ms 2015-03-02T11:46:37.770-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3376.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1848ms 2015-03-02T11:46:37.773-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:37.980-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T11:46:38.007-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34252 records 352078783 bytes) is inconsistent with full validation results (34991 records 359670530 bytes). Updating size storer with new values. 2015-03-02T11:46:38.008-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:38.025-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:38.043-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 269ms 2015-03-02T11:46:38.058-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:38.190-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34991 records 359670530 bytes) are inconsistent with full validation results (35991 records 369943530 bytes). Updating counters with new values. 2015-03-02T11:46:38.190-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34991 records 359670530 bytes) is inconsistent with full validation results (35991 records 369943530 bytes). Updating size storer with new values. 2015-03-02T11:46:38.190-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:38.209-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:38.215-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 157ms 2015-03-02T11:46:38.232-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:38.453-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:38.463-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:38.467-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 234ms 2015-03-02T11:46:38.473-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:38.702-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 201ms 2015-03-02T11:46:38.831-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (36991 records 380216530 bytes) are inconsistent with full validation results (35991 records 369943530 bytes). Updating counters with new values. 2015-03-02T11:46:38.831-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (36252 records 372624783 bytes) is inconsistent with full validation results (35991 records 369943530 bytes). Updating size storer with new values. 2015-03-02T11:46:38.832-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:38.849-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:38.856-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 382ms 2015-03-02T11:46:39.184-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:46:40.285-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:46:41.028-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:46:41.032-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T11:46:41.973-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T11:46:43.322-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:46:43.625-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T11:46:43.852-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T11:46:45.832-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 217ms 2015-03-02T11:46:45.923-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 204ms 2015-03-02T11:46:46.451-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:46:46.457-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:46:47.218-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 158ms 2015-03-02T11:46:47.718-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (54252 records 557538783 bytes) is inconsistent with full validation results (54991 records 565130530 bytes). Updating size storer with new values. 2015-03-02T11:46:47.723-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:46:47.741-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:46:47.755-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 1298ms 2015-03-02T11:46:48.247-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T11:46:48.481-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:46:48.489-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:48.971-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (44829 records 460736304 bytes) are inconsistent with full validation results (50382 records 517782273 bytes). Updating counters with new values. 2015-03-02T11:46:48.971-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (45730 records 469992277 bytes) is inconsistent with full validation results (50382 records 517782273 bytes). Updating size storer with new values. 2015-03-02T11:46:48.971-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:49.005-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:49.022-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 533ms 2015-03-02T11:46:49.576-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59577 #5 (4 connections now open) 2015-03-02T11:46:49.617-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:46:49.991-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (29237 records 300559688 bytes) are inconsistent with full validation results (31249 records 321228964 bytes). Updating counters with new values. 2015-03-02T11:46:49.991-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (29283 records 301032246 bytes) is inconsistent with full validation results (31249 records 321228964 bytes). Updating size storer with new values. 2015-03-02T11:46:49.991-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:46:50.026-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:46:50.051-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 434ms 2015-03-02T11:46:50.082-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:46:50.406-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (26990 records 277476257 bytes) are inconsistent with full validation results (23235 records 238901142 bytes). Updating counters with new values. 2015-03-02T11:46:50.406-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (27295 records 280609522 bytes) is inconsistent with full validation results (23235 records 238901142 bytes). Updating size storer with new values. 2015-03-02T11:46:50.406-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:46:50.432-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:46:50.439-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 357ms 2015-03-02T11:46:51.448-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T11:46:51.982-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6133.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:8374 nscannedObjects:8374 nMatched:1184 nModified:1184 keyUpdates:1 writeConflicts:11941 numYields:87 locks:{} 1533ms 2015-03-02T11:46:51.986-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6133.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1537ms 2015-03-02T11:46:51.989-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:46:52.087-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 1189.0 } } ndeleted:89 keyUpdates:0 writeConflicts:119 numYields:290 locks:{} 4326ms 2015-03-02T11:46:52.087-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1189.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 4326ms 2015-03-02T11:46:52.087-0500 I NETWORK [conn2] end connection 10.4.127.218:59571 (3 connections now open) 2015-03-02T11:46:52.102-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 76.0 } } ndeleted:0 keyUpdates:0 writeConflicts:143 numYields:159 locks:{} 3071ms 2015-03-02T11:46:52.102-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 76.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3075ms 2015-03-02T11:46:52.108-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:46:52.142-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (3646 records 37455358 bytes) are inconsistent with full validation results (1852 records 19038804 bytes). Updating counters with new values. 2015-03-02T11:46:52.142-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (3724 records 38257666 bytes) is inconsistent with full validation results (1852 records 19038804 bytes). Updating size storer with new values. 2015-03-02T11:46:52.142-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:46:52.146-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1852 records 19038804 bytes) are inconsistent with full validation results (836 records 8588228 bytes). Updating counters with new values. 2015-03-02T11:46:52.146-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1852 records 19038804 bytes) is inconsistent with full validation results (836 records 8588228 bytes). Updating size storer with new values. 2015-03-02T11:46:52.146-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:46:52.158-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:46:52.159-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 169ms 2015-03-02T11:46:52.160-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:46:53.054-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T11:46:53.751-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:46:55.380-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T11:46:55.455-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:46:56.191-0500 I NETWORK [conn1] end connection 10.4.127.218:59569 (2 connections now open) 2015-03-02T11:46:56.238-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59578 #6 (3 connections now open) 2015-03-02T11:46:56.253-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:46:56.276-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:46:56.397-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (9758 records 100243934 bytes) is inconsistent with full validation results (9836 records 101045228 bytes). Updating size storer with new values. 2015-03-02T11:46:56.398-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:46:56.399-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (9836 records 101045228 bytes) are inconsistent with full validation results (9672 records 99360456 bytes). Updating counters with new values. 2015-03-02T11:46:56.399-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (9836 records 101045228 bytes) is inconsistent with full validation results (9672 records 99360456 bytes). Updating size storer with new values. 2015-03-02T11:46:56.401-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:46:56.403-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:46:56.405-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:46:56.405-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 129ms 2015-03-02T11:46:56.407-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 153ms 2015-03-02T11:46:56.413-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:46:56.422-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:46:56.472-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (9672 records 99360456 bytes) are inconsistent with full validation results (9836 records 101045228 bytes). Updating counters with new values. 2015-03-02T11:46:56.472-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (9672 records 99360456 bytes) is inconsistent with full validation results (9836 records 101045228 bytes). Updating size storer with new values. 2015-03-02T11:46:56.474-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:46:56.477-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:46:56.479-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:46:56.480-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:46:56.486-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:46:56.542-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (10138 records 104147674 bytes) are inconsistent with full validation results (9836 records 101045228 bytes). Updating counters with new values. 2015-03-02T11:46:56.542-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:46:56.544-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:46:56.554-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:46:56.620-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:46:56.651-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (10534 records 108215782 bytes) are inconsistent with full validation results (10276 records 105565348 bytes). Updating counters with new values. 2015-03-02T11:46:56.651-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10456 records 107414488 bytes) is inconsistent with full validation results (10276 records 105565348 bytes). Updating size storer with new values. 2015-03-02T11:46:56.651-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:46:56.653-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:46:58.437-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T11:46:58.448-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T11:46:59.761-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T11:47:00.323-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 242ms 2015-03-02T11:47:00.528-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T11:47:01.313-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T11:47:01.382-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:47:01.611-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:47:40.970-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] MongoDB starting : pid=2548 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:47:40.985-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:47:40.985-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:47:41.022-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:47:41.067-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:47:41.235-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59590 #1 (1 connection now open) 2015-03-02T11:47:41.259-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:42.117-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:42.139-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:42.149-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 887ms 2015-03-02T11:47:42.170-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:42.336-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:42.340-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:42.342-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 172ms 2015-03-02T11:47:43.331-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7453.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32484 nscannedObjects:32484 nMatched:16242 nModified:16242 keyUpdates:1 writeConflicts:0 numYields:253 locks:{} 984ms 2015-03-02T11:47:43.331-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7453.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 984ms 2015-03-02T11:47:43.334-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:43.405-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:43.409-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:43.830-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 8777.0 } } ndeleted:16242 keyUpdates:0 writeConflicts:0 numYields:126 locks:{} 413ms 2015-03-02T11:47:43.830-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8777.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 413ms 2015-03-02T11:47:43.831-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:43.888-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21540 records 221276459 bytes) is inconsistent with full validation results (21057 records 216318561 bytes). Updating size storer with new values. 2015-03-02T11:47:43.888-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:43.892-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:43.898-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:43.937-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:43.940-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:43.947-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:43.984-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:43.987-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:43.991-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:44.029-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:44.032-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:44.280-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 3906.0 } } ndeleted:8381 keyUpdates:0 writeConflicts:0 numYields:65 locks:{} 244ms 2015-03-02T11:47:44.280-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3906.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 244ms 2015-03-02T11:47:44.282-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:44.311-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (13540 records 139096420 bytes) is inconsistent with full validation results (12676 records 130220548 bytes). Updating size storer with new values. 2015-03-02T11:47:44.311-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:44.314-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:44.320-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:44.342-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:44.344-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:44.599-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59591 #2 (2 connections now open) 2015-03-02T11:47:44.698-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:47:44.724-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (10540 records 108277420 bytes) is inconsistent with full validation results (10084 records 103592932 bytes). Updating size storer with new values. 2015-03-02T11:47:44.725-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:47:44.727-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:47:45.964-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59592 #3 (3 connections now open) 2015-03-02T11:47:45.974-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:47:45.995-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (10628 records 109181444 bytes) is inconsistent with full validation results (11084 records 113865932 bytes). Updating size storer with new values. 2015-03-02T11:47:45.995-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:47:45.997-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:47:46.043-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:47:46.099-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11084 records 113865932 bytes) is inconsistent with full validation results (11084 records 113870014 bytes). Updating size storer with new values. 2015-03-02T11:47:46.099-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:47:46.100-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:47:46.107-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:47:46.145-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:47:46.147-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:47:46.154-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:47:46.190-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:47:46.196-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:47:46.236-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:47:46.300-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (10854 records 111504234 bytes) is inconsistent with full validation results (10770 records 110640210 bytes). Updating size storer with new values. 2015-03-02T11:47:46.300-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:47:46.302-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:47:46.306-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:47:46.329-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:47:46.331-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:47:46.339-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:47:46.399-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:47:46.404-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:47:49.557-0500 I NETWORK [conn2] end connection 10.4.127.218:59591 (2 connections now open) 2015-03-02T11:47:49.587-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59593 #4 (3 connections now open) 2015-03-02T11:47:54.835-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:55.132-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (27686 records 284418278 bytes) is inconsistent with full validation results (27770 records 285281210 bytes). Updating size storer with new values. 2015-03-02T11:47:55.132-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:55.139-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:55.144-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 308ms 2015-03-02T11:47:55.153-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:55.272-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:55.276-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:55.281-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 127ms 2015-03-02T11:47:55.302-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:47:55.391-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:47:55.396-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:47:55.929-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:47:56.209-0500 I NETWORK [conn1] end connection 10.4.127.218:59590 (2 connections now open) 2015-03-02T11:47:56.272-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59594 #5 (3 connections now open) 2015-03-02T11:47:56.286-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:47:56.422-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (29686 records 304964278 bytes) is inconsistent with full validation results (29770 records 305827210 bytes). Updating size storer with new values. 2015-03-02T11:47:56.422-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:47:56.426-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:47:56.429-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 142ms 2015-03-02T11:47:57.936-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:48:03.188-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:48:04.784-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:48:04.822-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:48:05.289-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (45770 records 470195210 bytes) are inconsistent with full validation results (45416 records 466558568 bytes). Updating counters with new values. 2015-03-02T11:48:05.289-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (45686 records 469332278 bytes) is inconsistent with full validation results (45416 records 466558568 bytes). Updating size storer with new values. 2015-03-02T11:48:05.289-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:48:05.294-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:48:05.298-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 514ms 2015-03-02T11:48:05.538-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:48:05.584-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 7204.0 } } ndeleted:5592 keyUpdates:0 writeConflicts:0 numYields:44 locks:{} 283ms 2015-03-02T11:48:05.584-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7204.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 283ms 2015-03-02T11:48:05.591-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:48:05.848-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (40824 records 419384952 bytes) are inconsistent with full validation results (41178 records 423021594 bytes). Updating counters with new values. 2015-03-02T11:48:05.848-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41500 records 426329500 bytes) is inconsistent with full validation results (41178 records 423021594 bytes). Updating size storer with new values. 2015-03-02T11:48:05.848-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:48:05.875-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:48:05.880-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 289ms 2015-03-02T11:48:05.980-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59596 #6 (4 connections now open) 2015-03-02T11:48:06.014-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:48:06.363-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T11:48:06.505-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (42178 records 433343643 bytes) are inconsistent with full validation results (41178 records 423039105 bytes). Updating counters with new values. 2015-03-02T11:48:06.505-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (42178 records 433337806 bytes) is inconsistent with full validation results (41178 records 423039105 bytes). Updating size storer with new values. 2015-03-02T11:48:06.505-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:48:06.532-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:48:06.548-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 534ms 2015-03-02T11:48:06.562-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:48:07.083-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (41178 records 423079353 bytes) are inconsistent with full validation results (42178 records 433347829 bytes). Updating counters with new values. 2015-03-02T11:48:07.083-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (41178 records 423072268 bytes) is inconsistent with full validation results (42178 records 433347829 bytes). Updating size storer with new values. 2015-03-02T11:48:07.083-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:48:07.101-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:48:07.121-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 558ms 2015-03-02T11:48:07.159-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:48:07.432-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (42178 records 433373231 bytes) are inconsistent with full validation results (42178 records 433386699 bytes). Updating counters with new values. 2015-03-02T11:48:07.432-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (42178 records 433366744 bytes) is inconsistent with full validation results (42178 records 433386699 bytes). Updating size storer with new values. 2015-03-02T11:48:07.432-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:48:07.443-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:48:07.450-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 290ms 2015-03-02T11:48:07.532-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5261.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:18728 nscannedObjects:18728 nMatched:9364 nModified:9364 keyUpdates:1 writeConflicts:0 numYields:163 locks:{} 1644ms 2015-03-02T11:48:07.532-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5261.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1645ms 2015-03-02T11:48:07.532-0500 I NETWORK [conn3] end connection 10.4.127.218:59592 (3 connections now open) 2015-03-02T11:48:08.049-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:48:09.103-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:48:09.335-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (45178 records 464212732 bytes) are inconsistent with full validation results (45178 records 464235326 bytes). Updating counters with new values. 2015-03-02T11:48:09.335-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (45138 records 463801812 bytes) is inconsistent with full validation results (45178 records 464235326 bytes). Updating size storer with new values. 2015-03-02T11:48:09.335-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:48:09.342-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:48:09.351-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 248ms 2015-03-02T11:48:09.897-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 6604.0 } } ndeleted:12364 keyUpdates:0 writeConflicts:0 numYields:97 locks:{} 536ms 2015-03-02T11:48:09.897-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6604.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 536ms 2015-03-02T11:48:09.899-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:48:10.019-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (33218 records 341253766 bytes) is inconsistent with full validation results (32814 records 337098222 bytes). Updating size storer with new values. 2015-03-02T11:48:10.019-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:48:10.026-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:48:10.032-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 132ms 2015-03-02T11:48:10.234-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:48:10.468-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4736.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6200 nscannedObjects:6200 nMatched:3100 nModified:3100 keyUpdates:1 writeConflicts:0 numYields:52 locks:{} 427ms 2015-03-02T11:48:10.468-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4736.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 427ms 2015-03-02T11:48:10.470-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:48:10.563-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (33814 records 347411522 bytes) are inconsistent with full validation results (33814 records 347393218 bytes). Updating counters with new values. 2015-03-02T11:48:10.563-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (33814 records 347404970 bytes) is inconsistent with full validation results (33814 records 347393218 bytes). Updating size storer with new values. 2015-03-02T11:48:10.563-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:48:10.577-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:48:10.589-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 355ms 2015-03-02T11:48:10.599-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:48:10.661-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (33814 records 347393218 bytes) are inconsistent with full validation results (33814 records 347411522 bytes). Updating counters with new values. 2015-03-02T11:48:10.661-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (33814 records 347393218 bytes) is inconsistent with full validation results (33814 records 347411522 bytes). Updating size storer with new values. 2015-03-02T11:48:10.662-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:48:10.669-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:48:10.681-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 210ms 2015-03-02T11:48:10.692-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:48:10.787-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:48:10.796-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:48:10.809-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 209ms 2015-03-02T11:48:10.833-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:48:10.838-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:48:10.841-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 148ms 2015-03-02T11:48:10.946-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:48:11.044-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (31318 records 321737666 bytes) is inconsistent with full validation results (30714 records 315524922 bytes). Updating size storer with new values. 2015-03-02T11:48:11.044-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:48:11.049-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:48:11.053-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 107ms 2015-03-02T11:48:12.124-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 2107.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22416 nscannedObjects:22416 nMatched:11208 nModified:11208 keyUpdates:1 writeConflicts:0 numYields:181 locks:{} 1068ms 2015-03-02T11:48:12.124-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2107.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1068ms 2015-03-02T11:48:12.129-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:48:12.221-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (31714 records 325933070 bytes) is inconsistent with full validation results (31714 records 325943626 bytes). Updating size storer with new values. 2015-03-02T11:48:12.221-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:48:12.226-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:48:12.233-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 103ms 2015-03-02T11:48:14.315-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:48:17.214-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:48:17.266-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T11:48:50.863-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:48:50.875-0500 I CONTROL [initandlisten] MongoDB starting : pid=2545 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:48:50.875-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:48:50.875-0500 I CONTROL [initandlisten] 2015-03-02T11:48:50.875-0500 I CONTROL [initandlisten] 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:48:50.876-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:48:50.876-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:48:50.914-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:48:50.959-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:48:51.197-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59616 #1 (1 connection now open) 2015-03-02T11:48:51.215-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:48:52.034-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:48:52.055-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:48:52.065-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 845ms 2015-03-02T11:48:52.080-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:48:52.205-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:48:52.216-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:48:52.219-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 139ms 2015-03-02T11:48:52.658-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6559.0 } } ndeleted:18030 keyUpdates:0 writeConflicts:0 numYields:140 locks:{} 433ms 2015-03-02T11:48:52.658-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6559.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 433ms 2015-03-02T11:48:52.661-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:48:52.706-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19298 records 198238491 bytes) is inconsistent with full validation results (19269 records 197950437 bytes). Updating size storer with new values. 2015-03-02T11:48:52.707-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:48:52.710-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:48:52.717-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:48:52.758-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:48:52.760-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:48:52.766-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:48:52.801-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:48:52.803-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:48:52.810-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:48:52.844-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:48:52.846-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:48:53.426-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1204.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24526 nscannedObjects:24526 nMatched:12263 nModified:12263 keyUpdates:1 writeConflicts:0 numYields:191 locks:{} 576ms 2015-03-02T11:48:53.427-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1204.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 576ms 2015-03-02T11:48:53.428-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:48:53.465-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19269 records 198106060 bytes) is inconsistent with full validation results (12015-03-02T11:49:58.220-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] MongoDB starting : pid=2638 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:49:58.237-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:49:58.237-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:49:58.275-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:49:58.324-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:49:59.688-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59651 #1 (1 connection now open) 2015-03-02T11:49:59.698-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:50:00.082-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:50:00.087-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:50:00.089-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 391ms 2015-03-02T11:50:00.500-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6557.0 } } ndeleted:18034 keyUpdates:0 writeConflicts:0 numYields:140 locks:{} 406ms 2015-03-02T11:50:00.500-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6557.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 407ms 2015-03-02T11:50:00.503-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:50:00.549-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19298 records 198238543 bytes) is inconsistent with full validation results (19265 records 197909345 bytes). Updating size storer with new values. 2015-03-02T11:50:00.549-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:50:00.553-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:50:00.736-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 3618.0 } } ndeleted:7165 keyUpdates:0 writeConflicts:0 numYields:55 locks:{} 177ms 2015-03-02T11:50:00.736-0500 I COMMAND [conn1] command test.$cmd command: dele2015-03-02T11:51:06.321-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] MongoDB starting : pid=2546 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:51:06.332-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:51:06.332-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:51:06.376-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:51:06.427-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:51:07.447-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59685 #1 (1 connection now open) 2015-03-02T11:51:08.313-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 7246.0 } } ndeleted:16656 keyUpdates:0 writeConflicts:0 numYields:130 locks:{} 836ms 2015-03-02T11:51:08.313-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7246.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 836ms 2015-03-02T11:51:08.317-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:51:08.518-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21298 records 218792629 bytes) is inconsistent with full validation results (20643 records 212065539 bytes). Updating size storer with new values. 2015-03-02T11:51:08.518-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:51:08.523-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:51:08.527-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 209ms 2015-03-02T11:51:14.693-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59686 #2 (2 connections now open) 2015-03-02T11:51:14.708-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:51:14.880-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28988 records 297793724 bytes) is inconsistent with full validation results (29643 records 304522539 bytes). Updating size storer with new values. 2015-03-02T12015-03-02T11:52:10.008-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] MongoDB starting : pid=2536 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:52:10.017-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:52:10.017-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:52:10.055-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:52:10.105-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:52:11.338-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59734 #1 (1 connection now open) 2015-03-02T11:52:14.655-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59735 #2 (2 connections now open) 2015-03-02T11:52:14.778-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T11:52:16.052-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59736 #3 (3 connections now open) 2015-03-02T11:52:16.391-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T11:52:18.320-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 155ms 2015-03-02T11:52:19.086-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T11:52:19.593-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 567.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:82660 nscannedObjects:82660 nMatched:41330 nModified:41330 keyUpdates:1 writeConflicts:0 numYields:672 locks:{} 4924ms 2015-03-02T11:52:19.593-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 567.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4924ms 2015-03-02T11:52:19.599-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:52:19.660-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59738 #4 (4 connections now open) 2015-03-02T11:52:20.157-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:52:20.180-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:52:20.194-0500 I COMMAND [conn4] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 525ms 2015-03-02T11:52:20.194-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 594ms 2015-03-02T11:52:20.200-0500 I NETWORK [conn2] end connection 10.4.127.218:59735 (3 connections now open) 2015-03-02T11:52:20.346-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T11:52:20.350-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:52:20.632-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (42197 records 433963505 bytes) are inconsistent with full validation results (46307 records 476238861 bytes). Updating counters with new values. 2015-03-02T11:52:20.632-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (42628 records 438396771 bytes) is inconsistent with full validation results (46307 records 476238861 bytes). Updating size storer with new values. 2015-03-02T11:52:20.632-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:52:20.653-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:52:20.674-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 323ms 2015-03-02T11:52:22.079-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6332.0 } } ndeleted:53 keyUpdates:0 writeConflicts:85 numYields:126 locks:{} 1401ms 2015-03-02T11:52:22.079-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6332.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1401ms 2015-03-02T11:52:22.082-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:52:22.087-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 7409.0 } } ndeleted:0 keyUpdates:0 writeConflicts:98 numYields:162 locks:{} 1885ms 2015-03-02T11:52:22.087-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7409.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1885ms 2015-03-02T11:52:22.091-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:52:22.213-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (10079 records 103594893 bytes) are inconsistent with full validation results (5969 records 61319537 bytes). Updating counters with new values. 2015-03-02T11:52:22.213-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10738 records 110363127 bytes) is inconsistent with full validation results (5969 records 61319537 bytes). Updating size storer with new values. 2015-03-02T11:52:22.213-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:52:22.214-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:52:22.230-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:52:22.231-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 140ms 2015-03-02T11:52:22.235-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:52:22.239-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 157ms 2015-03-02T11:52:22.240-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:52:22.254-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:52:22.285-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:52:22.288-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:52:22.289-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:52:22.290-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:52:22.295-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:52:22.298-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:52:22.320-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:52:22.322-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:52:22.322-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:52:22.324-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:52:22.328-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:52:22.342-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:52:22.343-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:52:23.422-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:52:23.426-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T11:52:23.432-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T11:52:24.492-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T11:52:25.990-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:52:26.294-0500 I NETWORK [conn1] end connection 10.4.127.218:59734 (2 connections now open) 2015-03-02T11:52:26.342-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59739 #5 (3 connections now open) 2015-03-02T11:52:26.361-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:26.534-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (15280 records 156971440 bytes) are inconsistent with full validation results (14969 records 153776537 bytes). Updating counters with new values. 2015-03-02T11:52:26.534-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (14310 records 147006630 bytes) is inconsistent with full validation results (14969 records 153776537 bytes). Updating size storer with new values. 2015-03-02T11:52:26.534-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:26.542-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:26.543-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 181ms 2015-03-02T11:52:26.550-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:26.590-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T11:52:26.626-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (15658 records 160854634 bytes) are inconsistent with full validation results (15581 records 160063613 bytes). Updating counters with new values. 2015-03-02T11:52:26.626-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (14999 records 154084727 bytes) is inconsistent with full validation results (15581 records 160063613 bytes). Updating size storer with new values. 2015-03-02T11:52:26.626-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:26.630-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:26.643-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:26.744-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (15581 records 160063613 bytes) are inconsistent with full validation results (15969 records 164049537 bytes). Updating counters with new values. 2015-03-02T11:52:26.744-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (15581 records 160063613 bytes) is inconsistent with full validation results (15969 records 164049537 bytes). Updating size storer with new values. 2015-03-02T11:52:26.744-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:26.753-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:26.756-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 112ms 2015-03-02T11:52:26.762-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:26.900-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:26.909-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:26.911-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 149ms 2015-03-02T11:52:26.918-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.042-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.046-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.052-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 134ms 2015-03-02T11:52:27.071-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.171-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.175-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.177-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 105ms 2015-03-02T11:52:27.182-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.279-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.286-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.292-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 109ms 2015-03-02T11:52:27.303-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.415-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (15969 records 164049537 bytes) is inconsistent with full validation results (15970 records 164049583 bytes). Updating size storer with new values. 2015-03-02T11:52:27.415-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.418-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.419-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 115ms 2015-03-02T11:52:27.424-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.458-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.465-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.487-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.594-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.603-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.605-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 118ms 2015-03-02T11:52:27.620-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.738-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.742-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.744-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 123ms 2015-03-02T11:52:27.749-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.842-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.845-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.854-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:27.952-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:27.955-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:27.958-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 104ms 2015-03-02T11:52:27.963-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:28.023-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:28.029-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:28.135-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T11:52:28.518-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T11:52:29.491-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 599.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24408 nscannedObjects:24408 nMatched:12204 nModified:12204 keyUpdates:1 writeConflicts:0 numYields:202 locks:{} 1451ms 2015-03-02T11:52:29.491-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 599.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1451ms 2015-03-02T11:52:29.495-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:29.568-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17970 records 184743003 bytes) is inconsistent with full validation results (17970 records 184754222 bytes). Updating size storer with new values. 2015-03-02T11:52:29.568-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:29.571-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:30.131-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 164ms 2015-03-02T11:52:31.059-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T11:52:31.383-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T11:52:31.955-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T11:52:32.857-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T11:52:33.958-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:52:34.299-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (28106 records 288881350 bytes) is inconsistent with full validation results (28970 records 297757222 bytes). Updating size storer with new values. 2015-03-02T11:52:34.300-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:52:34.311-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:52:34.319-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 360ms 2015-03-02T11:52:34.336-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:52:34.471-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:52:34.479-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:52:34.497-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 160ms 2015-03-02T11:52:34.725-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:52:34.728-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:52:34.904-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:52:34.911-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:52:34.924-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 195ms 2015-03-02T11:52:35.192-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T11:52:36.048-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59740 #6 (4 connections now open) 2015-03-02T11:52:36.077-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:36.117-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8728.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:14205 nscannedObjects:14205 nMatched:5227 nModified:5227 keyUpdates:1 writeConflicts:7474 numYields:130 locks:{} 1616ms 2015-03-02T11:52:36.117-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8728.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1616ms 2015-03-02T11:52:36.117-0500 I NETWORK [conn3] end connection 10.4.127.218:59736 (3 connections now open) 2015-03-02T11:52:36.307-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (18294 records 187963100 bytes) are inconsistent with full validation results (20315 records 208751106 bytes). Updating counters with new values. 2015-03-02T11:52:36.307-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (19061 records 195852462 bytes) is inconsistent with full validation results (20315 records 208751106 bytes). Updating size storer with new values. 2015-03-02T11:52:36.307-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:36.329-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:36.340-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 263ms 2015-03-02T11:52:36.354-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:36.482-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (18817 records 193342678 bytes) are inconsistent with full validation results (17901 records 183920702 bytes). Updating counters with new values. 2015-03-02T11:52:36.482-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (19082 records 196068468 bytes) is inconsistent with full validation results (17901 records 183920702 bytes). Updating size storer with new values. 2015-03-02T11:52:36.482-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:36.492-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:36.497-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 143ms 2015-03-02T11:52:36.508-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:36.622-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (16666 records 171217492 bytes) are inconsistent with full validation results (16491 records 169417442 bytes). Updating counters with new values. 2015-03-02T11:52:36.622-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (17166 records 176360492 bytes) is inconsistent with full validation results (16491 records 169417442 bytes). Updating size storer with new values. 2015-03-02T11:52:36.622-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:36.632-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:36.637-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 128ms 2015-03-02T11:52:36.647-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 8261.0 } } ndeleted:13748 keyUpdates:0 writeConflicts:6 numYields:128 locks:{} 1718ms 2015-03-02T11:52:36.647-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8261.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1718ms 2015-03-02T11:52:36.650-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:52:36.665-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:36.795-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 177ms 2015-03-02T11:52:36.830-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (17144 records 176132402 bytes) are inconsistent with full validation results (15272 records 156889256 bytes). Updating counters with new values. 2015-03-02T11:52:36.830-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (16297 records 167431171 bytes) is inconsistent with full validation results (15272 records 156889256 bytes). Updating size storer with new values. 2015-03-02T11:52:36.830-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:36.832-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (15272 records 156889256 bytes) are inconsistent with full validation results (15277 records 156940621 bytes). Updating counters with new values. 2015-03-02T11:52:36.832-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15272 records 156889256 bytes) is inconsistent with full validation results (15277 records 156940621 bytes). Updating size storer with new values. 2015-03-02T11:52:36.832-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:52:36.846-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:36.847-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:52:36.849-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 198ms 2015-03-02T11:52:36.850-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 185ms 2015-03-02T11:52:36.863-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:36.923-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (15277 records 156940621 bytes) are inconsistent with full validation results (16214 records 166566422 bytes). Updating counters with new values. 2015-03-02T11:52:36.923-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15277 records 156940621 bytes) is inconsistent with full validation results (16214 records 166566422 bytes). Updating size storer with new values. 2015-03-02T11:52:36.923-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:36.926-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:36.937-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:36.990-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:36.993-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:37.006-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:37.051-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:37.053-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:37.058-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:37.153-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:37.158-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:37.160-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 101ms 2015-03-02T11:52:37.172-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:37.232-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:37.239-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:38.155-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 2831.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:15234 nscannedObjects:15234 nMatched:7617 nModified:7617 keyUpdates:1 writeConflicts:0 numYields:124 locks:{} 901ms 2015-03-02T11:52:38.155-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2831.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 901ms 2015-03-02T11:52:38.165-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:38.313-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (16425 records 168833046 bytes) are inconsistent with full validation results (16214 records 166665443 bytes). Updating counters with new values. 2015-03-02T11:52:38.313-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (16214 records 166659411 bytes) is inconsistent with full validation results (16214 records 166665443 bytes). Updating size storer with new values. 2015-03-02T11:52:38.313-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:38.319-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:38.329-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 163ms 2015-03-02T11:52:38.339-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:38.420-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (17003 records 174770840 bytes) are inconsistent with full validation results (16832 records 173014157 bytes). Updating counters with new values. 2015-03-02T11:52:38.420-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (16539 records 170004168 bytes) is inconsistent with full validation results (16832 records 173014157 bytes). Updating size storer with new values. 2015-03-02T11:52:38.421-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:38.429-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:38.657-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T11:52:39.713-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T11:52:39.830-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 945.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21006 nscannedObjects:21006 nMatched:10503 nModified:10503 keyUpdates:1 writeConflicts:0 numYields:176 locks:{} 1394ms 2015-03-02T11:52:39.830-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 945.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1394ms 2015-03-02T11:52:39.832-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:52:39.893-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (18832 records 193597675 bytes) are inconsistent with full validation results (19214 records 197521961 bytes). Updating counters with new values. 2015-03-02T11:52:39.893-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (18701 records 192251912 bytes) is inconsistent with full validation results (19214 records 197521961 bytes). Updating size storer with new values. 2015-03-02T11:52:39.893-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:52:39.896-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:52:40.244-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:52:40.898-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T11:52:41.100-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T11:52:41.668-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T11:52:41.743-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:52:42.381-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 158ms 2015-03-02T11:52:43.233-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 177ms 2015-03-02T11:52:43.389-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T11:52:43.922-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:52:43.926-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:44.309-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:52:44.321-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (30214 records 310524961 bytes) are inconsistent with full validation results (29214 records 300251961 bytes). Updating counters with new values. 2015-03-02T11:52:44.321-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (29247 records 300590970 bytes) is inconsistent with full validation results (29214 records 300251961 bytes). Updating size storer with new values. 2015-03-02T11:52:44.321-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:44.332-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:44.337-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 411ms 2015-03-02T11:52:45.084-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 6551.0 } } ndeleted:13952 keyUpdates:0 writeConflicts:0 numYields:109 locks:{} 740ms 2015-03-02T11:52:45.084-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6551.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 740ms 2015-03-02T11:52:45.088-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:52:45.216-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T11:52:45.253-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (16262 records 167059526 bytes) are inconsistent with full validation results (16277 records 167213621 bytes). Updating counters with new values. 2015-03-02T11:52:45.253-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (15343 records 157618639 bytes) is inconsistent with full validation results (16277 records 167213621 bytes). Updating size storer with new values. 2015-03-02T11:52:45.253-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:52:45.279-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:52:45.304-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 216ms 2015-03-02T11:52:45.457-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T11:52:46.489-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 203ms 2015-03-02T11:52:46.586-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 172ms 2015-03-02T11:52:47.185-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 163ms 2015-03-02T11:52:47.296-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T11:53:19.294-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:53:19.303-0500 I CONTROL [initandlisten] MongoDB starting : pid=2551 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:53:19.303-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:53:19.303-0500 I CONTROL [initandlisten] 2015-03-02T11:53:19.303-0500 I CONTROL [initandlisten] 2015-03-02T11:53:19.312-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:53:19.313-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:53:19.313-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:53:19.361-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:53:19.420-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:53:19.547-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59769 #1 (1 connection now open) 2015-03-02T11:53:20.922-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59776 #2 (2 connections now open) 2015-03-02T11:53:20.942-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:53:21.231-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59777 #3 (3 connections now open) 2015-03-02T11:53:21.264-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (15495 records 159196142 bytes) are inconsistent with full validation results (19990 records 205431712 bytes). Updating counters with new values. 2015-03-02T11:53:21.264-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16298 records 167455800 bytes) is inconsistent with full validation results (19990 records 205431712 bytes). Updating size storer with new values. 2015-03-02T11:53:21.264-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:53:21.268-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:53:21.284-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 334ms 2015-03-02T11:53:21.289-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:53:21.378-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (18134 records 186340896 bytes) are inconsistent with full validation results (15065 records 154773162 bytes). Updating counters with new values. 2015-03-02T11:53:21.378-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (18793 records 193119370 bytes) is inconsistent with full validation results (15065 records 154773162 bytes). Updating size storer with new values. 2015-03-02T11:53:21.378-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:53:21.388-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:53:21.390-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T11:53:21.393-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4204.0 } } ndeleted:23823 keyUpdates:0 writeConflicts:0 numYields:193 locks:{} 1837ms 2015-03-02T11:53:21.393-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4204.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{2015-03-02T11:54:25.087-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] MongoDB starting : pid=2557 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:54:25.098-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:54:25.098-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:54:25.134-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:54:25.186-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:54:26.464-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59802 #1 (1 connection now open) 2015-03-02T11:54:27.036-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 7826.0 } } ndeleted:15496 keyUpdates:0 writeConflicts:0 numYields:121 locks:{} 564ms 2015-03-02T11:54:27.037-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7826.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 565ms 2015-03-02T11:54:27.041-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:54:27.254-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22298 records 229063549 bytes) is inconsistent with full validation results (21803 records 223982219 bytes). Updating size storer with new values. 2015-03-02T11:54:27.254-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:54:27.258-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:54:27.261-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 219ms 2015-03-02T11:54:27.265-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:54:27.318-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:54:27.321-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:54:27.327-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:54:27.372-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:54:27.375-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:542015-03-02T11:55:34.905-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] MongoDB starting : pid=2533 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:55:34.922-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:55:34.922-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:55:34.965-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:55:35.029-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:55:36.117-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59830 #1 (1 connection now open) 2015-03-02T11:55:36.437-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59831 #2 (2 connections now open) 2015-03-02T11:55:42.099-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:55:42.980-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (51300 records 527149152 bytes) is inconsistent with full validation results (52299 records 537411879 bytes). Updating size storer with new values. 2015-03-02T11:55:42.980-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:55:42.986-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:55:42.993-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 890ms 2015-03-02T11:55:43.005-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:55:43.149-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:55:43.155-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:55:43.161-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 155ms 2015-03-02T11:55:43.574-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T11:55:44.778-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59834 #3 (3 connections now open) 2015-03-02T12015-03-02T11:56:40.821-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] MongoDB starting : pid=2499 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:56:40.830-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:56:40.831-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:56:40.831-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:56:40.894-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:56:40.949-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:56:41.541-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59860 #1 (1 connection now open) 2015-03-02T11:56:42.976-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8510.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28256 nscannedObjects:28256 nMatched:14128 nModified:14128 keyUpdates:1 writeConflicts:0 numYields:227 locks:{} 1421ms 2015-03-02T11:56:42.976-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8510.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1421ms 2015-03-02T11:56:42.980-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:56:43.377-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:56:43.382-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:56:43.387-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 407ms 2015-03-02T11:56:44.855-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59864 #2 (2 connections now open) 2015-03-02T11:56:46.220-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59866 #3 (3 connections now open) 2015-03-02T11:56:46.239-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:56:46.502-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40172 records 412860380 bytes) is inconsistent with full validation results (40299 records 414165051 bytes). Updating si2015-03-02T11:57:46.452-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] MongoDB starting : pid=2565 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:57:46.467-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:57:46.467-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:57:46.513-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:57:46.570-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:57:47.306-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59881 #1 (1 connection now open) 2015-03-02T11:57:47.331-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:57:48.035-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:57:48.040-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:57:48.043-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 711ms 2015-03-02T11:57:48.787-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1925.0 } } ndeleted:28585 keyUpdates:0 writeConflicts:0 numYields:223 locks:{} 739ms 2015-03-02T11:57:48.787-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1925.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 739ms 2015-03-02T11:57:48.790-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:57:48.838-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9298 records 95515706 bytes) is inconsistent with full validation results (8714 records 89518922 bytes). Updating size storer with new values. 2015-03-02T11:57:48.838-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:57:48.844-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:57:49.861-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59882 #2 (2 connections now open) 2015-03-02T11:57:49.873-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:57:49.908-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (9130 records 93792490 bytes) is inconsistent with full validation results (9714 records 99791922 bytes). Updating size storer with new values. 2015-03-02T11:57:49.912-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:57:49.913-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:57:51.518-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59886 #3 (3 connections now open) 2015-03-02T11:57:51.530-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:51.597-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12130 records 124611490 bytes) is inconsistent with full validation results (12714 records 130610922 bytes). Updating size storer with new values. 2015-03-02T11:57:51.597-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:51.599-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:51.611-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:51.685-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12714 records 130610922 bytes) is inconsistent with full validation results (12715 records 130610968 bytes). Updating size storer with new values. 2015-03-02T11:57:51.690-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:51.693-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:51.703-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:51.757-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:51.759-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:51.767-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:51.814-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:51.816-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:51.820-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:51.867-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:51.870-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:51.882-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:51.909-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:51.911-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:51.920-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:51.957-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:51.960-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:51.970-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:52.016-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:52.017-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:52.247-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1620.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3981 nscannedObjects:3981 nMatched:1991 nModified:1991 keyUpdates:1 writeConflicts:0 numYields:33 locks:{} 227ms 2015-03-02T11:57:52.247-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1620.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 227ms 2015-03-02T11:57:52.253-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:52.305-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12715 records 130629350 bytes) is inconsistent with full validation results (12715 records 130636838 bytes). Updating size storer with new values. 2015-03-02T11:57:52.305-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:52.307-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:52.731-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 207ms 2015-03-02T11:57:52.732-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 216ms 2015-03-02T11:57:53.710-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 260.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25269 nscannedObjects:25269 nMatched:12635 nModified:12635 keyUpdates:1 writeConflicts:0 numYields:205 locks:{} 1397ms 2015-03-02T11:57:53.710-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 260.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1397ms 2015-03-02T11:57:53.712-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:53.787-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:53.805-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:53.815-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 103ms 2015-03-02T11:57:53.824-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:53.923-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:53.934-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:53.935-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 110ms 2015-03-02T11:57:53.946-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:54.032-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:54.034-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:54.048-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:54.141-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (15462 records 158995141 bytes) are inconsistent with full validation results (14715 records 151321210 bytes). Updating counters with new values. 2015-03-02T11:57:54.141-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:54.146-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:54.158-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:54.221-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (14968 records 153920279 bytes) are inconsistent with full validation results (15715 records 161594210 bytes). Updating counters with new values. 2015-03-02T11:57:54.221-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (14756 records 151742403 bytes) is inconsistent with full validation results (15715 records 161594210 bytes). Updating size storer with new values. 2015-03-02T11:57:54.224-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:54.226-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:54.238-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:54.314-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:54.316-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:54.334-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:54.403-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:54.408-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:54.423-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T11:57:54.493-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T11:57:54.496-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T11:57:55.845-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T11:57:55.989-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T11:57:56.300-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T11:57:56.485-0500 I NETWORK [conn3] end connection 10.4.127.218:59886 (2 connections now open) 2015-03-02T11:57:56.529-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59889 #4 (3 connections now open) 2015-03-02T11:57:56.542-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:57:56.695-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (20503 records 210781334 bytes) is inconsistent with full validation results (20715 records 212959210 bytes). Updating size storer with new values. 2015-03-02T11:57:56.695-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:57:56.698-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:57:56.699-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 156ms 2015-03-02T11:57:58.295-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:57:58.625-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T11:57:58.631-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:57:59.299-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T11:57:59.572-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:58:00.820-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T11:58:01.128-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T11:58:01.133-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:01.733-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 168ms 2015-03-02T11:58:01.777-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (32715 records 336235210 bytes) are inconsistent with full validation results (31715 records 325962210 bytes). Updating counters with new values. 2015-03-02T11:58:01.777-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32503 records 334057334 bytes) is inconsistent with full validation results (31715 records 325962210 bytes). Updating size storer with new values. 2015-03-02T11:58:01.777-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:01.789-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:01.800-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 667ms 2015-03-02T11:58:02.019-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T11:58:02.024-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:58:02.291-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (27316 records 280771283 bytes) are inconsistent with full validation results (30823 records 316798694 bytes). Updating counters with new values. 2015-03-02T11:58:02.291-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (27927 records 287048086 bytes) is inconsistent with full validation results (30823 records 316798694 bytes). Updating size storer with new values. 2015-03-02T11:58:02.292-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:58:02.314-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:58:02.325-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 300ms 2015-03-02T11:58:03.430-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 118.0 } } ndeleted:237 keyUpdates:0 writeConflicts:66 numYields:137 locks:{} 1628ms 2015-03-02T11:58:03.430-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 118.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1628ms 2015-03-02T11:58:03.432-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:03.435-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 5617.0 } } ndeleted:0 keyUpdates:0 writeConflicts:63 numYields:95 locks:{} 1104ms 2015-03-02T11:58:03.435-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5617.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1104ms 2015-03-02T11:58:03.438-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:58:03.492-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (3691 records 37917643 bytes) are inconsistent with full validation results (1180 records 12122140 bytes). Updating counters with new values. 2015-03-02T11:58:03.492-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (4438 records 45591045 bytes) is inconsistent with full validation results (1180 records 12122140 bytes). Updating size storer with new values. 2015-03-02T11:58:03.493-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:58:03.493-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:03.499-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:58:03.500-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:03.503-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:03.506-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:03.506-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:58:03.510-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:03.512-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:58:03.512-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:58:03.515-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:03.519-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:03.520-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:03.526-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:03.531-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:03.532-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:03.536-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:03.540-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:03.541-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:03.546-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:03.551-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:03.552-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:04.977-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T11:58:06.032-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:58:06.053-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:58:06.124-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T11:58:06.178-0500 I NETWORK [conn1] end connection 10.4.127.218:59881 (2 connections now open) 2015-03-02T11:58:06.213-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59890 #5 (3 connections now open) 2015-03-02T11:58:07.039-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T11:58:07.397-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T11:58:07.918-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T11:58:08.457-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T11:58:09.781-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T11:58:09.905-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T11:58:10.221-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T11:58:11.144-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T11:58:11.148-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:58:11.178-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T11:58:11.481-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (22180 records 227855140 bytes) are inconsistent with full validation results (21950 records 225492350 bytes). Updating counters with new values. 2015-03-02T11:58:11.481-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21433 records 220181209 bytes) is inconsistent with full validation results (21950 records 225492350 bytes). Updating size storer with new values. 2015-03-02T11:58:11.481-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:58:11.487-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:58:11.491-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 342ms 2015-03-02T11:58:12.220-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T11:58:12.258-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T11:58:12.914-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5110.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17560 nscannedObjects:17560 nMatched:8780 nModified:8780 keyUpdates:1 writeConflicts:0 numYields:149 locks:{} 1418ms 2015-03-02T11:58:12.915-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5110.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1418ms 2015-03-02T11:58:12.917-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:58:13.052-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (23950 records 246152490 bytes) are inconsistent with full validation results (24180 records 248515280 bytes). Updating counters with new values. 2015-03-02T11:58:13.052-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (23950 records 246145639 bytes) is inconsistent with full validation results (24180 records 248515280 bytes). Updating size storer with new values. 2015-03-02T11:58:13.052-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:58:13.059-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:58:13.069-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 151ms 2015-03-02T11:58:13.525-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:58:13.549-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 4361.0 } } ndeleted:11917 keyUpdates:0 writeConflicts:0 numYields:93 locks:{} 478ms 2015-03-02T11:58:13.549-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4361.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 478ms 2015-03-02T11:58:13.551-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:58:13.639-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13565 records 139358094 bytes) is inconsistent with full validation results (13263 records 136250799 bytes). Updating size storer with new values. 2015-03-02T11:58:13.639-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T11:58:13.642-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (13263 records 136250799 bytes) are inconsistent with full validation results (13524 records 138935445 bytes). Updating counters with new values. 2015-03-02T11:58:13.642-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13263 records 136250799 bytes) is inconsistent with full validation results (13524 records 138935445 bytes). Updating size storer with new values. 2015-03-02T11:58:13.643-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:58:13.649-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:58:13.654-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T11:58:13.656-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T11:58:13.658-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 133ms 2015-03-02T11:58:14.127-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T11:58:14.510-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1757.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:15624 nscannedObjects:15624 nMatched:7812 nModified:7812 keyUpdates:1 writeConflicts:0 numYields:125 locks:{} 849ms 2015-03-02T11:58:14.510-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1757.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 849ms 2015-03-02T11:58:14.515-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:58:14.727-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (14524 records 149310001 bytes) are inconsistent with full validation results (14263 records 146625355 bytes). Updating counters with new values. 2015-03-02T11:58:14.728-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (14524 records 149306673 bytes) is inconsistent with full validation results (14263 records 146625355 bytes). Updating size storer with new values. 2015-03-02T11:58:14.728-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:58:14.732-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:58:14.734-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 219ms 2015-03-02T11:58:15.136-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T11:58:15.250-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T11:58:15.611-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1503.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17148 nscannedObjects:17148 nMatched:8574 nModified:8574 keyUpdates:1 writeConflicts:0 numYields:139 locks:{} 871ms 2015-03-02T11:58:15.612-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1503.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 871ms 2015-03-02T11:58:15.613-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:58:15.671-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:58:15.673-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:58:17.428-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T11:58:17.588-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (20433 records 210019671 bytes) is inconsistent with full validation results (21263 records 218546261 bytes). Updating size storer with new values. 2015-03-02T11:58:17.588-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T11:58:17.595-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T11:58:17.597-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 168ms 2015-03-02T11:58:18.640-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T11:58:18.645-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T11:58:18.937-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T11:58:19.826-0500 I NETWORK [conn2] end connection 10.4.127.218:59882 (2 connections now open) 2015-03-02T11:58:19.876-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59894 #6 (3 connections now open) 2015-03-02T11:58:19.897-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:58:19.956-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T11:58:20.271-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (28263 records 290457261 bytes) are inconsistent with full validation results (27753 records 285218031 bytes). Updating counters with new values. 2015-03-02T11:58:20.271-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (27433 records 281930671 bytes) is inconsistent with full validation results (27753 records 285218031 bytes). Updating size storer with new values. 2015-03-02T11:58:20.272-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:58:20.275-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:58:20.280-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 383ms 2015-03-02T11:58:20.289-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T11:58:20.397-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (27753 records 285218031 bytes) are inconsistent with full validation results (28263 records 290457261 bytes). Updating counters with new values. 2015-03-02T11:58:20.400-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (27753 records 285218031 bytes) is inconsistent with full validation results (28263 records 290457261 bytes). Updating size storer with new values. 2015-03-02T11:58:20.401-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T11:58:20.405-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T11:58:20.410-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 121ms 2015-03-02T11:58:22.398-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T11:58:22.408-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T11:58:23.238-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T11:58:23.941-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T11:58:24.325-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T11:58:25.521-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T11:58:56.413-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] MongoDB starting : pid=2548 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:58:56.425-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:58:56.426-0500 I CONTROL [initandlisten] 2015-03-02T11:58:56.426-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:58:56.426-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:58:56.426-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:58:56.426-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:58:56.426-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:58:56.426-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:58:56.466-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T11:58:56.524-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T11:58:56.581-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59909 #1 (1 connection now open) 2015-03-02T11:58:58.219-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8174.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29600 nscannedObjects:29600 nMatched:14800 nModified:14800 keyUpdates:1 writeConflicts:0 numYields:241 locks:{} 1627ms 2015-03-02T11:58:58.219-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8174.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1627ms 2015-03-02T11:58:58.222-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:58.567-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:58.573-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:58:58.578-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 356ms 2015-03-02T11:58:59.909-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4670.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44850 nscannedObjects:44850 nMatched:22425 nModified:22425 keyUpdates:1 writeConflicts:0 numYields:350 locks:{} 1328ms 2015-03-02T11:58:59.909-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4670.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1328ms 2015-03-02T11:58:59.911-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59910 #2 (2 connections now open) 2015-03-02T11:58:59.911-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T11:58:59.985-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T11:58:59.989-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T11:59:00.014-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:59:00.174-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:59:00.178-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T11:59:00.187-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 172ms 2015-03-02T11:59:00.203-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T11:59:00.360-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T11:59:00.367-0500 I INDEX [conn2] validating index te2015-03-02T11:59:59.910-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T11:59:59.924-0500 I CONTROL [initandlisten] MongoDB starting : pid=2469 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T11:59:59.927-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T11:59:59.927-0500 I CONTROL [initandlisten] 2015-03-02T11:59:59.927-0500 I CONTROL [initandlisten] 2015-03-02T11:59:59.927-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T11:59:59.927-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T11:59:59.928-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T11:59:59.928-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T11:59:59.972-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:00:00.055-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:00:01.301-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59949 #1 (1 connection now open) 2015-03-02T12:00:01.354-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:00:01.847-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:59950 #2 (2 connections now open) 2015-03-02T12:00:02.096-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:00:02.102-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:00:02.110-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 239ms 2015-03-02T12:00:02.111-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11682 locks:{} 757ms 2015-03-02T12:00:03.041-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 920.0 } } ndeleted:195 keyUpdates:0 writeConflicts:12 numYields:121 locks:{} 923ms 2015-03-02T12:00:03.041-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 920.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 923ms 2015-03-02T12:00:03.044-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:00:03.045-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6463.0 } } ndeleted:0 keyUpdates:0 writeConflicts:14 numYields:121 locks:{} 927ms 2015-03-02T12:00:03.045-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6463.0 } }, limit: 0.02015-03-02T12:01:24.190-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:01:24.203-0500 I CONTROL [initandlisten] MongoDB starting : pid=2495 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:01:24.203-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:01:24.203-0500 I CONTROL [initandlisten] 2015-03-02T12:01:24.203-0500 I CONTROL [initandlisten] 2015-03-02T12:01:24.203-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:01:24.203-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:01:24.204-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:01:24.204-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:01:24.242-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:01:24.293-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:01:26.646-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60056 #1 (1 connection now open) 2015-03-02T12:01:27.375-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60057 #2 (2 connections now open) 2015-03-02T12:01:27.385-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:01:27.871-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:01:27.882-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:01:27.891-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 503ms 2015-03-02T12:01:28.022-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:01:28.450-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 8643.0 } } ndeleted:13862 keyUpdates:0 writeConflicts:0 numYields:108 locks:{} 553ms 2015-03-02T12:01:28.450-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8643.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 553ms 2015-03-02T12:01:28.453-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:01:28.552-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25298 records 259887307 bytes) is inconsistent with full validation results (24437 records 251041301 bytes). Updating size storer with new values. 2015-03-02T12:01:28.552-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:01:28.559-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:01:28.562-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 109ms 2015-03-02T12:01:28.574-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:01:28.653-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:01:28.659-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:01:28.884-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 6369.0 } } ndeleted:4548 keyUpdates:0 writeConflicts:0 numYields:35 locks:{} 215ms 2015-03-02T12:01:28.884-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6369.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 215ms 2015-03-02T12:01:28.888-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:01:28.947-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (21298 records 218794354 bytes) is inconsistent with full validation results (20889 records 214592697 bytes). Updating size storer with new values. 2015-03-02T12:01:28.948-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:01:28.955-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:01:28.962-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:01:29.033-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:01:29.036-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:01:29.047-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:01:29.122-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (20889 records 214592697 bytes) is inconsistent with full validation results (20890 records 214592743 bytes). Updating size storer with new values. 2015-03-02T12:01:29.122-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:01:29.124-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:01:29.136-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:01:29.177-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:01:29.179-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:01:29.987-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60058 #3 (3 connections now open) 2015-03-02T12:01:31.539-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:01:32.370-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:01:32.524-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:01:33.030-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:01:33.294-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:01:34.921-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:01:35.714-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:01:35.744-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:01:36.291-0500 I NETWORK [conn2] end connection 10.4.127.218:60057 (2 connections now open) 2015-03-02T12:01:36.302-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (39480 records 405567813 bytes) is inconsistent with full validation results (39890 records 409779743 bytes). Updating size storer with new values. 2015-03-02T12:01:36.302-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:01:36.315-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:01:36.319-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 574ms 2015-03-02T12:01:36.331-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60060 #4 (3 connections now open) 2015-03-02T12:01:36.754-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 5834.0 } } ndeleted:5403 keyUpdates:0 writeConflicts:0 numYields:43 locks:{} 405ms 2015-03-02T12:01:36.754-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5834.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 406ms 2015-03-02T12:01:36.760-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:36.924-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:01:36.944-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (27614 records 283678622 bytes) are inconsistent with full validation results (28679 records 294619367 bytes). Updating counters with new values. 2015-03-02T12:01:36.945-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (27954 records 287171442 bytes) is inconsistent with full validation results (28679 records 294619367 bytes). Updating size storer with new values. 2015-03-02T12:01:36.945-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:36.981-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:36.994-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 234ms 2015-03-02T12:01:37.001-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:37.140-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (26072 records 267837656 bytes) are inconsistent with full validation results (26910 records 276446430 bytes). Updating counters with new values. 2015-03-02T12:01:37.140-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26365 records 270847645 bytes) is inconsistent with full validation results (26910 records 276446430 bytes). Updating size storer with new values. 2015-03-02T12:01:37.140-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:37.152-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:37.159-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 157ms 2015-03-02T12:01:37.183-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:37.313-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (24695 records 253691735 bytes) are inconsistent with full validation results (24486 records 251544678 bytes). Updating counters with new values. 2015-03-02T12:01:37.314-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25203 records 258910419 bytes) is inconsistent with full validation results (24486 records 251544678 bytes). Updating size storer with new values. 2015-03-02T12:01:37.314-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:37.320-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:37.325-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 142ms 2015-03-02T12:01:38.252-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 357.0 } } ndeleted:291 keyUpdates:0 writeConflicts:55 numYields:170 locks:{} 1925ms 2015-03-02T12:01:38.252-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 357.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1925ms 2015-03-02T12:01:38.254-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 2382.0 } } ndeleted:0 keyUpdates:0 writeConflicts:60 numYields:65 locks:{} 918ms 2015-03-02T12:01:38.255-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2382.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 919ms 2015-03-02T12:01:38.256-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:01:38.256-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:38.351-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (4907 records 50409611 bytes) are inconsistent with full validation results (3213 records 33007149 bytes). Updating counters with new values. 2015-03-02T12:01:38.351-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (4994 records 51303362 bytes) is inconsistent with full validation results (3213 records 33007149 bytes). Updating size storer with new values. 2015-03-02T12:01:38.351-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:01:38.353-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:38.364-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:01:38.365-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 109ms 2015-03-02T12:01:38.365-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:38.366-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 109ms 2015-03-02T12:01:38.369-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:38.381-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:38.381-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:39.688-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T12:01:39.710-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:01:39.714-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:01:39.723-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:01:39.816-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (7126 records 73205398 bytes) is inconsistent with full validation results (7213 records 74099149 bytes). Updating size storer with new values. 2015-03-02T12:01:39.816-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:01:39.819-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:01:40.275-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 601.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5596 nscannedObjects:5596 nMatched:2798 nModified:2798 keyUpdates:1 writeConflicts:0 numYields:47 locks:{} 450ms 2015-03-02T12:01:40.275-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 601.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 450ms 2015-03-02T12:01:40.277-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:01:40.300-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (7213 records 74124018 bytes) is inconsistent with full validation results (7213 records 74135523 bytes). Updating size storer with new values. 2015-03-02T12:01:40.301-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:01:40.302-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:01:40.312-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:01:40.348-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:01:40.355-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:01:40.363-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:01:40.403-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:01:40.408-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:01:40.417-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:01:40.442-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:01:40.446-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:01:41.013-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:01:41.514-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:01:41.564-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:01:41.921-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:01:43.231-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:01:43.286-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:01:43.934-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:01:45.957-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T12:01:45.972-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:01:46.382-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:01:46.974-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:01:47.001-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:01:47.368-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:01:48.047-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:01:48.136-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:01:48.348-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:01:49.140-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:01:49.678-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32328 records 332141918 bytes) is inconsistent with full validation results (33213 records 341233523 bytes). Updating size storer with new values. 2015-03-02T12:01:49.678-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:01:49.683-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:01:49.686-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 545ms 2015-03-02T12:01:49.949-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:49.971-0500 I NETWORK [conn3] end connection 10.4.127.218:60058 (2 connections now open) 2015-03-02T12:01:50.010-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60061 #5 (3 connections now open) 2015-03-02T12:01:50.067-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (34213 records 351556014 bytes) are inconsistent with full validation results (34213 records 351549371 bytes). Updating counters with new values. 2015-03-02T12:01:50.067-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (34137 records 350767258 bytes) is inconsistent with full validation results (34213 records 351549371 bytes). Updating size storer with new values. 2015-03-02T12:01:50.067-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:50.071-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:50.087-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 137ms 2015-03-02T12:01:50.091-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:01:50.107-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:50.276-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (34213 records 351567935 bytes) are inconsistent with full validation results (34213 records 351558432 bytes). Updating counters with new values. 2015-03-02T12:01:50.276-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (34213 records 351566375 bytes) is inconsistent with full validation results (34213 records 351558432 bytes). Updating size storer with new values. 2015-03-02T12:01:50.276-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:01:50.288-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (34213 records 351559264 bytes) are inconsistent with full validation results (34213 records 351559745 bytes). Updating counters with new values. 2015-03-02T12:01:50.290-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (34213 records 351558432 bytes) is inconsistent with full validation results (34213 records 351559745 bytes). Updating size storer with new values. 2015-03-02T12:01:50.290-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:50.295-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:01:50.303-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:50.305-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 213ms 2015-03-02T12:01:50.308-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 201ms 2015-03-02T12:01:51.364-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 6852.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25639 nscannedObjects:25639 nMatched:11362 nModified:11362 keyUpdates:1 writeConflicts:33 numYields:210 locks:{} 1676ms 2015-03-02T12:01:51.364-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6852.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1676ms 2015-03-02T12:01:51.370-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:01:51.561-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22870 records 234989526 bytes) are inconsistent with full validation results (24897 records 255855411 bytes). Updating counters with new values. 2015-03-02T12:01:51.561-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23252 records 238918778 bytes) is inconsistent with full validation results (24897 records 255855411 bytes). Updating size storer with new values. 2015-03-02T12:01:51.561-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:01:51.595-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:01:51.602-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 231ms 2015-03-02T12:01:51.624-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:01:51.728-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5224.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16678 nscannedObjects:16678 nMatched:8004 nModified:8004 keyUpdates:1 writeConflicts:218 numYields:142 locks:{} 1410ms 2015-03-02T12:01:51.728-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5224.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1410ms 2015-03-02T12:01:51.733-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:51.765-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23004 records 236384013 bytes) are inconsistent with full validation results (22451 records 230695855 bytes). Updating counters with new values. 2015-03-02T12:01:51.766-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23533 records 241825307 bytes) is inconsistent with full validation results (22451 records 230695855 bytes). Updating size storer with new values. 2015-03-02T12:01:51.766-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:01:51.778-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:01:51.785-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 160ms 2015-03-02T12:01:51.839-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (21376 records 219638405 bytes) are inconsistent with full validation results (21389 records 219772123 bytes). Updating counters with new values. 2015-03-02T12:01:51.839-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21980 records 225851149 bytes) is inconsistent with full validation results (21389 records 219772123 bytes). Updating size storer with new values. 2015-03-02T12:01:51.839-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:51.842-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:51.848-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 114ms 2015-03-02T12:01:51.861-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:51.977-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19704 records 202440213 bytes) are inconsistent with full validation results (19523 records 200578447 bytes). Updating counters with new values. 2015-03-02T12:01:51.982-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19993 records 205412867 bytes) is inconsistent with full validation results (19523 records 200578447 bytes). Updating size storer with new values. 2015-03-02T12:01:51.982-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:51.985-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:51.986-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 125ms 2015-03-02T12:01:51.992-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 5571.0 } } ndeleted:6810 keyUpdates:0 writeConflicts:62 numYields:109 locks:{} 1680ms 2015-03-02T12:01:51.992-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5571.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1680ms 2015-03-02T12:01:51.995-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:01:52.104-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (19463 records 199970127 bytes) are inconsistent with full validation results (18087 records 185807751 bytes). Updating counters with new values. 2015-03-02T12:01:52.104-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19463 records 199968840 bytes) is inconsistent with full validation results (18087 records 185807751 bytes). Updating size storer with new values. 2015-03-02T12:01:52.104-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:01:52.115-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:01:52.121-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 125ms 2015-03-02T12:01:52.247-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4461.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4578 nscannedObjects:4578 nMatched:2289 nModified:2289 keyUpdates:1 writeConflicts:0 numYields:36 locks:{} 248ms 2015-03-02T12:01:52.247-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4461.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 248ms 2015-03-02T12:01:52.249-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:52.321-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18087 records 185828668 bytes) are inconsistent with full validation results (18087 records 185837508 bytes). Updating counters with new values. 2015-03-02T12:01:52.321-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18087 records 185819464 bytes) is inconsistent with full validation results (18087 records 185837508 bytes). Updating size storer with new values. 2015-03-02T12:01:52.321-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:52.328-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:52.343-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:52.396-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:52.398-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:52.402-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:52.436-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:52.438-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:52.443-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:52.478-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:52.480-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:52.700-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 6502.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4578 nscannedObjects:4578 nMatched:2289 nModified:2289 keyUpdates:1 writeConflicts:0 numYields:35 locks:{} 216ms 2015-03-02T12:01:52.700-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6502.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 216ms 2015-03-02T12:01:52.708-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:52.790-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:52.799-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:53.919-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:01:54.119-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T12:01:54.438-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1033.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25146 nscannedObjects:25146 nMatched:12573 nModified:12573 keyUpdates:1 writeConflicts:0 numYields:206 locks:{} 1629ms 2015-03-02T12:01:54.438-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1033.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1629ms 2015-03-02T12:01:54.439-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:01:54.677-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:01:54.683-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:01:54.700-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 260ms 2015-03-02T12:01:55.539-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:01:56.620-0500 I NETWORK [conn1] end connection 10.4.127.218:60056 (2 connections now open) 2015-03-02T12:01:56.664-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60062 #6 (3 connections now open) 2015-03-02T12:01:57.642-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:01:58.472-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:01:58.998-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:01:59.405-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:02:00.277-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:02:00.515-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 207ms 2015-03-02T12:02:00.776-0500 I COMMAND [conn4] 2015-03-02T12:02:30.716-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] MongoDB starting : pid=2485 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:02:30.729-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:02:30.729-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:02:30.767-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:02:30.826-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:02:33.012-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60074 #1 (1 connection now open) 2015-03-02T12:02:33.023-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:02:33.347-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60075 #2 (2 connections now open) 2015-03-02T12:02:33.392-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:02:33.397-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:02:33.400-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 376ms 2015-03-02T12:02:33.411-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:02:33.537-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383333025 bytes) are inconsistent with full validation results (37299 records 383317776 bytes). Updating counters with new values. 2015-03-02T12:02:33.537-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329892 bytes) is inconsistent with full validation results (37299 records 383317776 bytes). Updating size storer with new values. 2015-03-02T12:02:33.537-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:02:33.544-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:02:33.546-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T12:02:34.736-0500 I WRITE [conn1] update test.foo que2015-03-02T12:03:35.543-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] MongoDB starting : pid=2487 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:03:35.564-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:03:35.564-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:03:35.599-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:03:35.652-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:03:36.358-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60089 #1 (1 connection now open) 2015-03-02T12:03:36.373-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:03:37.015-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:03:37.020-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:03:37.023-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 649ms 2015-03-02T12:03:37.028-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:03:37.095-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:03:37.099-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:03:37.110-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:03:37.172-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:03:37.176-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:03:37.789-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60090 #2 (2 connections now open) 2015-03-02T12:03:37.799-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:03:37.868-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37300 records 383327152 bytes) is inconsistent with full validation results (38299 records 393589879 bytes). Updating size storer with new values. 2015-03-02T12:03:37.869-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:03:37.873-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:03:44.513-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:03:45.023-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60091 #3 (3 connections now open) 2015-03-02T12:03:45.040-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:03:45.524-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:03:45.528-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:03:45.577-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (52299 records 537411879 bytes) are inconsistent with full validation results (51299 records 527138879 bytes). Updating counters with new values. 2015-03-02T12:03:45.577-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (51300 records 527149152 bytes) is inconsistent with full validation results (51299 records 527138879 bytes). Updating size storer with new values. 2015-03-02T12:03:45.577-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:03:45.592-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:03:45.611-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 570ms 2015-03-02T12:03:45.785-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (51299 records 527153413 bytes) are inconsistent with full validation results (52299 records 537411879 bytes). Updating counters with new values. 2015-03-02T12:03:45.785-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (51299 records 527151892 bytes) is inconsistent with full validation results (52299 records 537411879 bytes). Updating size storer with new values. 2015-03-02T12:03:45.785-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:03:45.802-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:03:45.813-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 284ms 2015-03-02T12:03:46.201-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:03:47.576-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 252ms 2015-03-02T12:03:48.094-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 350ms 2015-03-02T12:03:50.045-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60092 #4 (4 connections now open) 2015-03-02T12:03:50.135-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:03:50.234-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 286ms 2015-03-02T12:03:50.781-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (56952 records 585520404 bytes) are inconsistent with full validation results (55930 records 575015860 bytes). Updating counters with new values. 2015-03-02T12:03:50.781-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (56944 records 585438220 bytes) is inconsistent with full validation results (55930 records 575015860 bytes). Updating size storer with new values. 2015-03-02T12:03:50.782-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:03:50.807-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:03:50.834-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 699ms 2015-03-02T12:03:50.839-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 318ms 2015-03-02T12:03:52.508-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 290ms 2015-03-02T12:03:53.707-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 362ms 2015-03-02T12:03:53.790-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3096.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:68516 nscannedObjects:68516 nMatched:34465 nModified:34465 keyUpdates:1 writeConflicts:80 numYields:668 locks:{} 8172ms 2015-03-02T12:03:53.790-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3096.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 8173ms 2015-03-02T12:03:53.791-0500 I NETWORK [conn3] end connection 10.4.127.218:60091 (3 connections now open) 2015-03-02T12:03:54.620-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:03:55.410-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 9794.0 } } ndeleted:30905 keyUpdates:0 writeConflicts:55 numYields:313 locks:{} 4570ms 2015-03-02T12:03:55.412-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9794.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 4571ms 2015-03-02T12:03:55.422-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:03:55.888-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (22676 records 232930476 bytes) are inconsistent with full validation results (23585 records 242288705 bytes). Updating counters with new values. 2015-03-02T12:03:55.888-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (22775 records 233940019 bytes) is inconsistent with full validation results (23585 records 242288705 bytes). Updating size storer with new values. 2015-03-02T12:03:55.888-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:03:55.924-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:03:55.943-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 521ms 2015-03-02T12:03:55.955-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:03:56.053-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 205ms 2015-03-02T12:03:56.065-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:03:56.293-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (24472 records 251400856 bytes) are inconsistent with full validation results (24242 records 249038066 bytes). Updating counters with new values. 2015-03-02T12:03:56.293-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (24260 records 249222980 bytes) is inconsistent with full validation results (24242 records 249038066 bytes). Updating size storer with new values. 2015-03-02T12:03:56.294-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:03:56.295-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (24242 records 249038066 bytes) are inconsistent with full validation results (24585 records 252561705 bytes). Updating counters with new values. 2015-03-02T12:03:56.295-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (24242 records 249038066 bytes) is inconsistent with full validation results (24585 records 252561705 bytes). Updating size storer with new values. 2015-03-02T12:03:56.296-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:03:56.302-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:03:56.308-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 353ms 2015-03-02T12:03:56.309-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:03:56.311-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 245ms 2015-03-02T12:03:56.318-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:03:56.498-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25043 records 257266739 bytes) are inconsistent with full validation results (24585 records 252561705 bytes). Updating counters with new values. 2015-03-02T12:03:56.499-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:03:56.516-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:03:56.527-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 208ms 2015-03-02T12:03:56.568-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T12:03:56.656-0500 I NETWORK [conn2] end connection 10.4.127.218:60090 (2 connections now open) 2015-03-02T12:03:56.713-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60093 #5 (3 connections now open) 2015-03-02T12:03:57.721-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:04:00.896-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:04:00.965-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:04:01.978-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:04:02.340-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (36127 records 371132671 bytes) are inconsistent with full validation results (35585 records 365564705 bytes). Updating counters with new values. 2015-03-02T12:04:02.340-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (35915 records 368954795 bytes) is inconsistent with full validation results (35585 records 365564705 bytes). Updating size storer with new values. 2015-03-02T12:04:02.340-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:04:02.345-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:04:02.349-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 371ms 2015-03-02T12:04:04.735-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1319.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:49048 nscannedObjects:49048 nMatched:24524 nModified:24524 keyUpdates:1 writeConflicts:0 numYields:395 locks:{} 2379ms 2015-03-02T12:04:04.735-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1319.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2379ms 2015-03-02T12:04:04.737-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:04:04.917-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (38585 records 396702517 bytes) are inconsistent with full validation results (39585 records 406975517 bytes). Updating counters with new values. 2015-03-02T12:04:04.917-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37849 records 389141589 bytes) is inconsistent with full validation results (39585 records 406975517 bytes). Updating size storer with new values. 2015-03-02T12:04:04.918-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:04:04.924-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:04:04.933-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 195ms 2015-03-02T12:04:06.268-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:04:06.273-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:04:06.341-0500 I NETWORK [conn1] end connection 10.4.127.218:60089 (2 connections now open) 2015-03-02T12:04:06.382-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60095 #6 (3 connections now open) 2015-03-02T12:04:06.409-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:04:06.674-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (42849 records 440506589 bytes) is inconsistent with full validation results (43585 records 448067517 bytes). Updating size storer with new values. 2015-03-02T12:04:06.675-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:04:06.687-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:04:06.699-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 290ms 2015-03-02T12:04:09.248-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:04:09.454-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6202.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50644 nscannedObjects:50644 nMatched:25322 nModified:25322 keyUpdates:1 writeConflicts:0 numYields:412 locks:{} 2745ms 2015-03-02T12:04:09.454-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6202.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2745ms 2015-03-02T12:04:09.458-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:04:09.892-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (46527 records 478301057 bytes) is inconsistent with full validation results (46585 records 478896891 bytes). Updating size storer with new values. 2015-03-02T12:04:09.892-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:04:09.901-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:04:09.908-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 450ms 2015-03-02T12:04:09.933-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:04:10.175-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:04:10.193-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:04:10.199-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 266ms 2015-03-02T12:04:10.207-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:04:10.432-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (47169 records 484896323 bytes) are inconsistent with full validation results (46585 records 478896891 bytes). Updating counters with new values. 2015-03-02T12:04:10.432-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:04:10.444-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:04:10.454-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 247ms 2015-03-02T12:04:10.476-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:04:10.477-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:04:10.684-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:04:10.694-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:04:10.764-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (48001 records 493443459 bytes) are inconsistent with full validation results (47585 records 489169891 bytes). Updating counters with new values. 2015-03-02T12:04:10.765-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (47943 records 492847625 bytes) is inconsistent with full validation results (47585 records 489169891 bytes). Updating size storer with new values. 2015-03-02T12:04:10.765-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:04:10.782-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:04:10.789-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 313ms 2015-03-02T12:04:10.814-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:04:10.941-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (47585 records 489169891 bytes) are inconsistent with full validation results (48585 records 499442891 bytes). Updating counters with new values. 2015-03-02T12:04:10.941-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (47585 records 489169891 bytes) is inconsistent with full validation results (48585 records 499442891 bytes). Updating size storer with new values. 2015-03-02T12:04:10.941-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:04:10.955-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:04:10.961-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 266ms 2015-03-02T12:04:11.030-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:04:11.035-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:04:11.038-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 224ms 2015-03-02T12:04:11.049-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:04:11.247-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:04:11.252-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:04:11.255-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 206ms 2015-03-02T12:04:14.52015-03-02T12:04:46.125-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:04:46.139-0500 I CONTROL [initandlisten] MongoDB starting : pid=2607 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:04:46.139-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:04:46.139-0500 I CONTROL [initandlisten] 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:04:46.140-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:04:46.140-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:04:46.193-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:04:46.242-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:04:47.125-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60110 #1 (1 connection now open) 2015-03-02T12:04:47.370-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60111 #2 (2 connections now open) 2015-03-02T12:04:47.387-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:04:47.900-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:04:47.905-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:04:47.916-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 521ms 2015-03-02T12:04:47.926-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:04:48.030-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:04:48.034-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:04:48.037-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 110ms 2015-03-02T12:04:48.044-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:04:48.141-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:04:48.147-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:04:48.150-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 106ms 2015-03-02T12:04:48.161-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:04:48.253-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:04:48.257-0500 I INDEX 2015-03-02T12:05:52.640-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] MongoDB starting : pid=2481 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:05:52.645-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:05:52.645-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:05:52.699-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:05:52.744-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:05:55.257-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60129 #1 (1 connection now open) 2015-03-02T12:05:56.702-0500 I NETWORK [conn1] end connection 10.4.127.218:60129 (0 connections now open) 2015-03-02T12:05:56.741-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60130 #2 (1 connection now open) 2015-03-02T12:05:57.966-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 358.0 } } ndeleted:36793 keyUpdates:0 writeConflicts:0 numYields:287 locks:{} 1218ms 2015-03-02T12:05:57.966-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 358.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1218ms 2015-03-02T12:05:57.970-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.015-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (3298 records 33880410 bytes) is inconsistent with full validation results (2506 records 25744138 bytes). Updating size storer with new values. 2015-03-02T12:05:58.015-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.021-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:05:58.027-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.032-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.033-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:05:58.035-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.040-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.041-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:05:58.043-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.048-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.049-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:05:58.053-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.058-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (2506 records 25744138 bytes) is inconsistent with full validation results (2507 records 25744184 bytes). Updating size storer with new values. 2015-03-02T12:05:58.058-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.059-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:05:58.064-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.069-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.069-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:05:58.072-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.077-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.078-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:05:58.081-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:05:58.086-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:05:58.086-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:00.084-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60131 #3 (2 connections now open) 2015-03-02T12:06:01.416-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60132 #4 (3 connections now open) 2015-03-02T12:06:01.431-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.495-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (5713 records 58679422 bytes) is inconsistent with full validation results (6507 records 66836184 bytes). Updating size storer with new values. 2015-03-02T12:06:01.495-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.496-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.509-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.534-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.535-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.540-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.564-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.565-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.579-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.603-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.603-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.612-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.639-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.642-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.649-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.681-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.682-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.698-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.724-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.725-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.735-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.774-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.775-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.784-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.813-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.816-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.827-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.856-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.857-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.861-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.873-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.874-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.878-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.897-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.898-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.904-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.918-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.919-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:01.927-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:06:01.962-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:06:01.963-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:06:02.256-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:06:02.419-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:06:02.993-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:06:04.873-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T12:06:06.424-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60133 #5 (4 connections now open) 2015-03-02T12:06:06.513-0500 I NETWORK [conn4] end connection 10.4.127.218:60132 (3 connections now open) 2015-03-02T12:06:06.754-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:06:07.412-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:06:07.415-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:07.629-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (18507 records 190239688 bytes) are inconsistent with full validation results (18507 records 190223269 bytes). Updating counters with new values. 2015-03-02T12:06:07.629-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (18507 records 190231836 bytes) is inconsistent with full validation results (18507 records 190223269 bytes). Updating size storer with new values. 2015-03-02T12:06:07.635-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:07.639-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:07.648-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 232ms 2015-03-02T12:06:07.662-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:07.746-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (18507 records 190230250 bytes) are inconsistent with full validation results (18507 records 190242496 bytes). Updating counters with new values. 2015-03-02T12:06:07.746-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (18507 records 190228417 bytes) is inconsistent with full validation results (18507 records 190242496 bytes). Updating size storer with new values. 2015-03-02T12:06:07.746-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:07.751-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:07.762-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1631.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20691 nscannedObjects:20691 nMatched:10346 nModified:10346 keyUpdates:1 writeConflicts:0 numYields:172 locks:{} 1321ms 2015-03-02T12:06:07.762-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1631.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1322ms 2015-03-02T12:06:07.766-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:06:07.830-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (18507 records 190242496 bytes) are inconsistent with full validation results (18507 records 190246669 bytes). Updating counters with new values. 2015-03-02T12:06:07.830-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18507 records 190242496 bytes) is inconsistent with full validation results (18507 records 190246669 bytes). Updating size storer with new values. 2015-03-02T12:06:07.830-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:06:07.834-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:06:08.458-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 7003.0 } } ndeleted:10346 keyUpdates:0 writeConflicts:0 numYields:82 locks:{} 619ms 2015-03-02T12:06:08.458-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7003.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 619ms 2015-03-02T12:06:08.460-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:06:08.557-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (8649 records 88847281 bytes) is inconsistent with full validation results (8161 records 83837953 bytes). Updating size storer with new values. 2015-03-02T12:06:08.557-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:06:08.565-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:06:08.567-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 107ms 2015-03-02T12:06:08.581-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:06:08.613-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:06:08.614-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:06:08.624-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:06:08.662-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (8161 records 83837953 bytes) is inconsistent with full validation results (8162 records 83837999 bytes). Updating size storer with new values. 2015-03-02T12:06:08.662-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:06:08.663-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:06:08.672-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:06:08.700-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:06:08.706-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:06:08.710-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:06:08.740-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (8394 records 86221335 bytes) are inconsistent with full validation results (8162 records 83837999 bytes). Updating counters with new values. 2015-03-02T12:06:08.740-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:06:08.744-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:06:08.950-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:06:13.985-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:06:14.266-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:06:16.043-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:06:16.047-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:06:16.347-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:06:16.522-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27930 records 286914663 bytes) are inconsistent with full validation results (26246 records 269614931 bytes). Updating counters with new values. 2015-03-02T12:06:16.522-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (27441 records 281891166 bytes) is inconsistent with full validation results (26246 records 269614931 bytes). Updating size storer with new values. 2015-03-02T12:06:16.522-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:06:16.531-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:06:16.543-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 496ms 2015-03-02T12:06:16.549-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:06:16.681-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (26246 records 269614931 bytes) are inconsistent with full validation results (28162 records 289297999 bytes). Updating counters with new values. 2015-03-02T12:06:16.681-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26246 records 269614931 bytes) is inconsistent with full validation results (28162 records 289297999 bytes). Updating size storer with new values. 2015-03-02T12:06:16.681-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:06:16.687-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:06:16.690-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 140ms 2015-03-02T12:06:17.271-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:17.385-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28673 records 294547502 bytes) is inconsistent with full validation results (29162 records 299570999 bytes). Updating size storer with new values. 2015-03-02T12:06:17.386-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:17.390-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:17.392-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 120ms 2015-03-02T12:06:17.416-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:17.519-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:17.523-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:17.532-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T12:06:18.686-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 194ms 2015-03-02T12:06:19.217-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 216ms 2015-03-02T12:06:20.064-0500 I NETWORK [conn3] end connection 10.4.127.218:60131 (2 connections now open) 2015-03-02T12:06:20.096-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 732.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:45992 nscannedObjects:45992 nMatched:22996 nModified:22996 keyUpdates:1 writeConflicts:0 numYields:375 locks:{} 2559ms 2015-03-02T12:06:20.096-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 732.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2559ms 2015-03-02T12:06:20.099-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:20.103-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60140 #6 (3 connections now open) 2015-03-02T12:06:20.241-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (31162 records 320409642 bytes) is inconsistent with full validation results (31162 records 320415934 bytes). Updating size storer with new values. 2015-03-02T12:06:20.242-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:20.247-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:20.259-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 148ms 2015-03-02T12:06:20.259-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 160ms 2015-03-02T12:06:20.279-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:06:20.284-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:20.489-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:06:20.500-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:06:20.503-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 223ms 2015-03-02T12:06:20.505-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:20.519-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:20.526-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 241ms 2015-03-02T12:06:20.530-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:06:20.559-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:20.752-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:06:20.766-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:06:20.768-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:20.772-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 241ms 2015-03-02T12:06:20.787-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:20.793-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 233ms 2015-03-02T12:06:21.434-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T12:06:23.241-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 187ms 2015-03-02T12:06:23.350-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 178ms 2015-03-02T12:06:23.366-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 5459.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:45992 nscannedObjects:45992 nMatched:22996 nModified:22996 keyUpdates:1 writeConflicts:0 numYields:374 locks:{} 2570ms 2015-03-02T12:06:23.366-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5459.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2571ms 2015-03-02T12:06:23.368-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:23.580-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (33681 records 346293621 bytes) is inconsistent with full validation results (34162 records 351234934 bytes). Updating size storer with new values. 2015-03-02T12:06:23.581-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:23.585-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:23.596-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 227ms 2015-03-02T12:06:23.610-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:23.780-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:23.783-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:23.786-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 175ms 2015-03-02T12:06:23.794-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:23.921-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:23.925-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:23.927-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 133ms 2015-03-02T12:06:23.935-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:24.043-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:24.047-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:24.049-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 114ms 2015-03-02T12:06:24.075-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:24.158-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:24.173-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:24.185-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T12:06:24.199-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:24.306-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:24.311-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:24.314-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 114ms 2015-03-02T12:06:24.322-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:06:24.430-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:06:24.434-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:06:24.443-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 120ms 2015-03-02T12:06:26.739-0500 I NETWORK [conn2] end connection 10.4.127.218:60130 (2 connections now open) 2015-03-02T12:06:26.762-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60144 #7 (3 connections now open) 2015-03-02T12:06:26.851-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:06:28.424-0500 I COMMAND [conn7] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:06:28.435-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:06:28.439-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:06:28.976-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (42681 records 438750621 bytes) is inconsistent with full validation results (43162 records 443691934 bytes). Updating size storer with new values. 2015-03-02T12:06:28.976-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:06:29.000-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:06:29.014-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 575ms 2015-03-02T12:06:30.207-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:06:31.274-0500 I COMMAND [conn7] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:06:59.371-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:06:59.383-0500 I CONTROL [initandlisten] MongoDB starting : pid=2514 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:06:59.383-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:06:59.383-0500 I CONTROL [initandlisten] 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:06:59.384-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:06:59.384-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:06:59.421-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:06:59.468-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:07:01.061-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60157 #1 (1 connection now open) 2015-03-02T12:07:01.072-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:01.256-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60158 #2 (2 connections now open) 2015-03-02T12:07:01.452-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:01.457-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:01.460-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 197ms 2015-03-02T12:07:01.460-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 388ms 2015-03-02T12:07:02.964-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2967.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:30291 nscannedObjects:30291 nMatched:15325 nModified:15325 keyUpdates:1 writeConflicts:146 numYields:240 locks:{} 1499ms 2015-03-02T12:07:02.964-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2967.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1499ms 2015-03-02T12:07:02.968-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.062-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (13737 records 141153788 bytes) are inconsistent with full validation results (15501 records 159298184 bytes). Updating counters with new values. 2015-03-02T12:07:03.062-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (14663 records 150678624 bytes) is inconsistent with full validation results (15501 records 159298184 bytes). Updating size storer with new values. 2015-03-02T12:07:03.062-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.073-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.075-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 106ms 2015-03-02T12:07:03.227-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 8618.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4164 nscannedObjects:4164 nMatched:2082 nModified:2082 keyUpdates:1 writeConflicts:5 numYields:32 locks:{} 146ms 2015-03-02T12:07:03.227-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8618.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 146ms 2015-03-02T12:07:03.229-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.276-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (12188 records 125220666 bytes) are inconsistent with full validation results (11372 records 116827290 bytes). Updating counters with new values. 2015-03-02T12:07:03.276-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (12509 records 128522472 bytes) is inconsistent with full validation results (11372 records 116827290 bytes). Updating size storer with new values. 2015-03-02T12:07:03.276-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.278-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2755.0 } } ndeleted:998 keyUpdates:0 writeConflicts:97 numYields:164 locks:{} 1810ms 2015-03-02T12:07:03.278-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2755.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1810ms 2015-03-02T12:07:03.281-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.282-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.290-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.320-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11322 records 116323230 bytes) are inconsistent with full validation results (10374 records 106572102 bytes). Updating counters with new values. 2015-03-02T12:07:03.321-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11372 records 116827290 bytes) is inconsistent with full validation results (10374 records 106572102 bytes). Updating size storer with new values. 2015-03-02T12:07:03.321-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.323-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.326-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.327-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.332-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.338-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.368-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (10375 records 106572148 bytes) are inconsistent with full validation results (10374 records 106572102 bytes). Updating counters with new values. 2015-03-02T12:07:03.368-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.369-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.371-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (10374 records 106572102 bytes) are inconsistent with full validation results (10375 records 106572148 bytes). Updating counters with new values. 2015-03-02T12:07:03.371-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (10374 records 106572102 bytes) is inconsistent with full validation results (10375 records 106572148 bytes). Updating size storer with new values. 2015-03-02T12:07:03.371-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.373-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.381-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.414-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (9630 records 98918763 bytes) are inconsistent with full validation results (10248 records 105267477 bytes). Updating counters with new values. 2015-03-02T12:07:03.414-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9747 records 100120704 bytes) is inconsistent with full validation results (10248 records 105267477 bytes). Updating size storer with new values. 2015-03-02T12:07:03.415-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.416-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.425-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.455-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (9512 records 97706549 bytes) are inconsistent with full validation results (9430 records 96864163 bytes). Updating counters with new values. 2015-03-02T12:07:03.455-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10248 records 105267477 bytes) is inconsistent with full validation results (9430 records 96864163 bytes). Updating size storer with new values. 2015-03-02T12:07:03.456-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.457-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.469-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.495-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (8672 records 89077229 bytes) are inconsistent with full validation results (8589 records 88224570 bytes). Updating counters with new values. 2015-03-02T12:07:03.495-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9283 records 95354032 bytes) is inconsistent with full validation results (8589 records 88224570 bytes). Updating size storer with new values. 2015-03-02T12:07:03.495-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.500-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.510-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.536-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (7767 records 79780164 bytes) are inconsistent with full validation results (7783 records 79944532 bytes). Updating counters with new values. 2015-03-02T12:07:03.536-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (8201 records 84238646 bytes) is inconsistent with full validation results (7783 records 79944532 bytes). Updating size storer with new values. 2015-03-02T12:07:03.536-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.538-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.547-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.569-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (7192 records 73873189 bytes) are inconsistent with full validation results (7085 records 72773978 bytes). Updating counters with new values. 2015-03-02T12:07:03.573-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (7218 records 74140287 bytes) is inconsistent with full validation results (7085 records 72773978 bytes). Updating size storer with new values. 2015-03-02T12:07:03.573-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.575-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.582-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.605-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (6460 records 66353353 bytes) are inconsistent with full validation results (6418 records 65921887 bytes). Updating counters with new values. 2015-03-02T12:07:03.605-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (7085 records 72773978 bytes) is inconsistent with full validation results (6418 records 65921887 bytes). Updating size storer with new values. 2015-03-02T12:07:03.605-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.606-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.614-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.627-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 919.0 } } ndeleted:4861 keyUpdates:0 writeConflicts:0 numYields:37 locks:{} 250ms 2015-03-02T12:07:03.627-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 919.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 250ms 2015-03-02T12:07:03.631-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.635-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (5990 records 61535270 bytes) are inconsistent with full validation results (5756 records 59121161 bytes). Updating counters with new values. 2015-03-02T12:07:03.635-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6226 records 63949471 bytes) is inconsistent with full validation results (5756 records 59121161 bytes). Updating size storer with new values. 2015-03-02T12:07:03.635-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.636-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.645-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.649-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (5757 records 59121207 bytes) are inconsistent with full validation results (5514 records 56645322 bytes). Updating counters with new values. 2015-03-02T12:07:03.649-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (5756 records 59121161 bytes) is inconsistent with full validation results (5514 records 56645322 bytes). Updating size storer with new values. 2015-03-02T12:07:03.649-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.650-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.660-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.664-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (5514 records 56645322 bytes) are inconsistent with full validation results (5515 records 56645368 bytes). Updating counters with new values. 2015-03-02T12:07:03.664-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5514 records 56645322 bytes) is inconsistent with full validation results (5515 records 56645368 bytes). Updating size storer with new values. 2015-03-02T12:07:03.664-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.665-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.674-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.679-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.680-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.689-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.693-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.693-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.700-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.706-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.707-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.715-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.720-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.721-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.731-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.736-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.741-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.744-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.749-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.749-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.759-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:03.763-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.764-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.773-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.777-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:03.777-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:03.786-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.787-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.791-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.804-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.805-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.810-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.820-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.821-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.828-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.839-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (5515 records 56645368 bytes) is inconsistent with full validation results (5514 records 56645322 bytes). Updating size storer with new values. 2015-03-02T12:07:03.840-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.841-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.844-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.854-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.855-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.859-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.871-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (5514 records 56645322 bytes) is inconsistent with full validation results (5515 records 56645368 bytes). Updating size storer with new values. 2015-03-02T12:07:03.871-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.872-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.876-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.887-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.888-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.891-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.903-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.904-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:03.907-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:07:03.917-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:07:03.918-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:07:06.250-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60159 #3 (3 connections now open) 2015-03-02T12:07:06.266-0500 I NETWORK [conn2] end connection 10.4.127.218:60158 (2 connections now open) 2015-03-02T12:07:06.561-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60160 #4 (3 connections now open) 2015-03-02T12:07:06.577-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:07:06.740-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (11271 records 115776756 bytes) is inconsistent with full validation results (11515 records 118283368 bytes). Updating size storer with new values. 2015-03-02T12:07:06.740-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:07:06.742-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:07:06.746-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 168ms 2015-03-02T12:07:06.754-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:07:06.812-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:07:06.814-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:07:07.286-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T12:07:07.320-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:07:08.128-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:07:08.632-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:07:08.989-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:07:09.564-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:07:10.867-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:07:11.721-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:07:12.075-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:07:12.832-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T12:07:15.494-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:07:15.498-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:15.767-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T12:07:16.287-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33515 records 344289368 bytes) are inconsistent with full validation results (32515 records 334016368 bytes). Updating counters with new values. 2015-03-02T12:07:16.287-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (33270 records 341772483 bytes) is inconsistent with full validation results (32515 records 334016368 bytes). Updating size storer with new values. 2015-03-02T12:07:16.287-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:16.296-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:16.313-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 815ms 2015-03-02T12:07:16.416-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:16.421-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:07:16.619-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33515 records 344298572 bytes) are inconsistent with full validation results (34509 records 354509934 bytes). Updating counters with new values. 2015-03-02T12:07:16.619-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32895 records 337924983 bytes) is inconsistent with full validation results (34509 records 354509934 bytes). Updating size storer with new values. 2015-03-02T12:07:16.619-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:16.630-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:16.644-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 228ms 2015-03-02T12:07:16.660-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:16.866-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34509 records 354509934 bytes) are inconsistent with full validation results (34515 records 354571572 bytes). Updating counters with new values. 2015-03-02T12:07:16.868-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34509 records 354509934 bytes) is inconsistent with full validation results (34515 records 354571572 bytes). Updating size storer with new values. 2015-03-02T12:07:16.868-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:16.876-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:16.881-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 220ms 2015-03-02T12:07:16.897-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:17.098-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:17.110-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:17.118-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 220ms 2015-03-02T12:07:17.137-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:17.242-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:07:17.351-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (35515 records 364844572 bytes) are inconsistent with full validation results (34542 records 354848943 bytes). Updating counters with new values. 2015-03-02T12:07:17.351-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34561 records 355044130 bytes) is inconsistent with full validation results (34542 records 354848943 bytes). Updating size storer with new values. 2015-03-02T12:07:17.351-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:17.357-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:17.362-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 225ms 2015-03-02T12:07:17.367-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:17.452-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34542 records 354848943 bytes) are inconsistent with full validation results (35515 records 364844572 bytes). Updating counters with new values. 2015-03-02T12:07:17.452-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34542 records 354848943 bytes) is inconsistent with full validation results (35515 records 364844572 bytes). Updating size storer with new values. 2015-03-02T12:07:17.452-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:17.457-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:17.475-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:17.590-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:17.594-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:17.597-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T12:07:17.939-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:07:17.945-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:07:18.149-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27912 records 286738953 bytes) are inconsistent with full validation results (30788 records 316284101 bytes). Updating counters with new values. 2015-03-02T12:07:18.149-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (28469 records 292461014 bytes) is inconsistent with full validation results (30788 records 316284101 bytes). Updating size storer with new values. 2015-03-02T12:07:18.149-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:07:18.166-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:07:18.178-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 233ms 2015-03-02T12:07:18.183-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:07:18.338-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (28235 records 290057132 bytes) are inconsistent with full validation results (27512 records 282629753 bytes). Updating counters with new values. 2015-03-02T12:07:18.338-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (28345 records 291187162 bytes) is inconsistent with full validation results (27512 records 282629753 bytes). Updating size storer with new values. 2015-03-02T12:07:18.338-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:07:18.349-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:07:18.355-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 171ms 2015-03-02T12:07:18.586-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 8571.0 } } ndeleted:2859 keyUpdates:0 writeConflicts:0 numYields:22 locks:{} 220ms 2015-03-02T12:07:18.586-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8571.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 220ms 2015-03-02T12:07:18.589-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:07:18.716-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (19917 records 204607341 bytes) are inconsistent with full validation results (19420 records 199501660 bytes). Updating counters with new values. 2015-03-02T12:07:18.716-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20622 records 211849806 bytes) is inconsistent with full validation results (19420 records 199501660 bytes). Updating size storer with new values. 2015-03-02T12:07:18.718-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:07:18.729-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 3013.0 } } ndeleted:16103 keyUpdates:0 writeConflicts:0 numYields:128 locks:{} 1129ms 2015-03-02T12:07:18.729-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3013.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1129ms 2015-03-02T12:07:18.732-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:07:18.737-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:18.741-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 151ms 2015-03-02T12:07:18.835-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (19209 records 197343053 bytes) are inconsistent with full validation results (17553 records 180321969 bytes). Updating counters with new values. 2015-03-02T12:07:18.835-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19209 records 197335149 bytes) is inconsistent with full validation results (17553 records 180321969 bytes). Updating size storer with new values. 2015-03-02T12:07:18.836-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:18.843-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:18.849-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 111ms 2015-03-02T12:07:18.860-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:18.976-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17553 records 180332330 bytes) are inconsistent with full validation results (17553 records 180333266 bytes). Updating counters with new values. 2015-03-02T12:07:18.976-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17553 records 180327065 bytes) is inconsistent with full validation results (17553 records 180333266 bytes). Updating size storer with new values. 2015-03-02T12:07:18.976-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:18.985-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:18.991-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 131ms 2015-03-02T12:07:19.000-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:07:19.116-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17553 records 180343237 bytes) are inconsistent with full validation results (17553 records 180343549 bytes). Updating counters with new values. 2015-03-02T12:07:19.116-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17553 records 180341001 bytes) is inconsistent with full validation results (17553 records 180343549 bytes). Updating size storer with new values. 2015-03-02T12:07:19.116-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:07:19.124-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:07:19.129-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 128ms 2015-03-02T12:07:19.729-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 222ms 2015-03-02T12:07:19.925-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60165 #5 (4 connections now open) 2015-03-02T12:07:22.019-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 434ms 2015-03-02T12:07:22.023-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:07:22.322-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (20124 records 206942645 bytes) are inconsistent with full validation results (19553 records 201073057 bytes). Updating counters with new values. 2015-03-02T12:07:22.327-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19883 records 204463732 bytes) is inconsistent with full validation results (19553 records 201073057 bytes). Updating size storer with new values. 2015-03-02T12:07:22.327-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:07:22.335-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:07:22.373-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 349ms 2015-03-02T12:07:22.396-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:07:22.435-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 349ms 2015-03-02T12:07:22.609-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19960 records 205259420 bytes) are inconsistent with full validation results (20431 records 210107168 bytes). Updating counters with new values. 2015-03-02T12:07:22.609-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19960 records 205259095 bytes) is inconsistent with full validation results (20431 records 210107168 bytes). Updating size storer with new values. 2015-03-02T12:07:22.610-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:07:22.620-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:07:22.629-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 233ms 2015-03-02T12:07:22.655-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:07:22.707-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 247.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:35140 nscannedObjects:35140 nMatched:17083 nModified:17083 keyUpdates:1 writeConflicts:0 numYields:337 locks:{} 3962ms 2015-03-02T12:07:22.707-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 247.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3963ms 2015-03-02T12:07:22.710-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:07:22.850-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (20431 records 210107168 bytes) are inconsistent with full validation results (20553 records 211363048 bytes). Updating counters with new values. 2015-03-02T12:07:22.850-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (20431 records 210107168 bytes) is inconsistent with full validation results (20553 records 211363048 bytes). Updating size storer with new values. 2015-03-02T12:07:22.851-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:07:22.864-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:07:22.866-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 210ms 2015-03-02T12:07:22.897-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:07:22.904-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:07:22.921-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 210ms 2015-03-02T12:07:23.163-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5173.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:34166 nscannedObjects:34166 nMatched:17083 nModified:17083 keyUpdates:1 writeConflicts:0 numYields:331 locks:{} 4024ms 2015-03-02T12:07:23.170-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5173.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4031ms 2015-03-02T12:07:23.170-0500 I NETWORK [conn1] end connection 10.4.127.218:60157 (3 connections now open) 2015-03-02T12:07:23.817-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:07:24.399-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:07:24.540-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:07:25.463-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T12:07:26.311-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:07:26.529-0500 I NETWORK [conn4] end connection 10.4.127.218:60160 (2 connections now open) 2015-03-02T12:07:26.574-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60166 #6 (3 connections now open) 2015-03-02T12:07:27.099-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:07:27.700-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:07:28.471-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T12:07:28.608-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 1452.0 } } ndeleted:21727 keyUpdates:0 writeConflicts:0 numYields:181 locks:{} 2022ms 2015-03-02T12:07:28.608-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1452.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2022ms 2015-03-02T12:07:28.612-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:07:28.836-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:07:28.931-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (10826 records 111215498 bytes) are inconsistent with full validation results (9826 records 100942498 bytes). Updating counters with new values. 2015-03-02T12:07:28.932-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (10017 records 102904641 bytes) is inconsistent with full validation results (9826 records 100942498 bytes). Updating size storer with new values. 2015-03-02T12:07:28.932-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:07:28.968-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:07:28.989-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 376ms 2015-03-02T12:07:28.997-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:07:29.073-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (9826 records 100942498 bytes) are inconsistent with full validation results (10826 records 111215498 bytes). Updating counters with new values. 2015-03-02T12:07:29.073-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (9826 records 100942498 bytes) is inconsistent with full validation results (10826 records 111215498 bytes). Updating size storer with new values. 2015-03-02T12:07:29.073-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:07:29.075-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:07:29.089-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:07:29.158-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (10826 records 111215498 bytes) is inconsistent with full validation results (10827 records 111215544 bytes). Updating size storer with new values. 2015-03-02T12:07:29.159-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:07:29.167-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:07:29.179-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:07:29.229-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:07:29.234-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:07:29.250-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:07:29.334-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:07:29.336-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:07:31.499-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:07:32.446-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:07:32.452-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:07:32.694-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (18827 records 193399544 bytes) are inconsistent with full validation results (18093 records 185859162 bytes). Updating counters with new values. 2015-03-02T12:07:32.694-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18017 records 185078414 bytes) is inconsistent with full validation results (18093 records 185859162 bytes). Updating size storer with new values. 2015-03-02T12:07:32.694-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:07:32.696-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:07:32.698-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 246ms 2015-03-02T12:07:32.702-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:07:32.787-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (18093 records 185859162 bytes) are inconsistent with full validation results (18827 records 193399544 bytes). Updating counters with new values. 2015-03-02T12:07:32.788-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18093 records 185859162 bytes) is inconsistent with full validation results (18827 records 193399544 bytes). Updating size storer with new values. 2015-03-02T12:07:32.788-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:07:32.794-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:07:32.805-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:07:32.920-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:07:32.927-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:07:32.929-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 124ms 2015-03-02T12:07:34.828-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:07:34.955-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (22017 records 226170414 bytes) is inconsistent with full validation results (22827 records 234491544 bytes). Updating size storer with new values. 2015-03-02T12:07:34.955-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:07:34.962-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:07:34.969-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 140ms 2015-03-02T12:07:34.983-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:07:35.041-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:07:35.044-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:07:35.479-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:07:36.216-0500 I NETWORK [conn3] end connection 10.4.127.218:60159 (2 connections now open) 2015-03-02T12:07:36.280-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60184 #7 (3 connections now open) 2015-03-02T12:08:14.430-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:08:14.460-0500 I CONTROL [initandlisten] MongoDB starting : pid=2606 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:08:14.460-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:08:14.460-0500 I CONTROL [initandlisten] 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:08:14.470-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:08:14.471-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:08:14.572-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:08:14.712-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:08:15.724-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60248 #1 (1 connection now open) 2015-03-02T12:08:17.070-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60252 #2 (2 connections now open) 2015-03-02T12:08:17.105-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:08:17.124-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 5552.0 } } ndeleted:20044 keyUpdates:0 writeConflicts:0 numYields:163 locks:{} 1364ms 2015-03-02T12:08:17.128-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5552.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1364ms 2015-03-02T12:08:17.132-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:08:17.378-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17298 records 177692673 bytes) is inconsistent with full validation results (17255 records 177260615 bytes). Updating size storer with new values. 2015-03-02T12:08:17.378-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:08:17.381-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (17255 records 177260615 bytes) are inconsistent with full validation results (17448 records 179235573 bytes). Updating counters with new values. 2015-03-02T12:08:17.381-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (17255 records 177260615 bytes) is inconsistent with full validation results (17448 records 179235573 bytes). Updating size storer with new values. 2015-03-02T12:08:17.381-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:08:17.384-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:08:17.387-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:08:17.389-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 257ms 2015-03-02T12:08:17.391-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 285ms 2015-03-02T12:08:20.680-0500 I NETWORK [conn1] end connection 10.4.127.218:60248 (1 connection now open) 2015-03-02T12:08:20.707-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60257 #3 (2 connections now open) 2015-03-02T12:08:20.716-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:20.808-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (20448 records 210054573 bytes) are inconsistent with full validation results (20255 records 208079615 bytes). Updating counters with new values. 2015-03-02T12:08:20.808-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20405 records 209612834 bytes) is inconsistent with full validation results (20255 records 208079615 bytes). Updating size storer with new values. 2015-03-02T12:08:20.808-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:20.814-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:20.826-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:20.913-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20255 records 208079615 bytes) is inconsistent with full validation results (20256 records 208079661 bytes). Updating size storer with new values. 2015-03-02T12:08:20.913-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:20.925-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:20.938-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 111ms 2015-03-02T12:08:20.954-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:21.004-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:21.012-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:21.022-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:21.096-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:21.100-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:21.114-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:21.182-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:21.185-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:21.193-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:21.289-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20256 records 208079661 bytes) is inconsistent with full validation results (20255 records 208079615 bytes). Updating size storer with new values. 2015-03-02T12:08:21.289-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:21.294-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:21.297-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 103ms 2015-03-02T12:08:21.977-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3044.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12606 nscannedObjects:12606 nMatched:6303 nModified:6303 keyUpdates:1 writeConflicts:0 numYields:101 locks:{} 678ms 2015-03-02T12:08:21.978-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3044.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 678ms 2015-03-02T12:08:21.981-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:22.038-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20255 records 208157030 bytes) is inconsistent with full validation results (20255 records 208161554 bytes). Updating size storer with new values. 2015-03-02T12:08:22.038-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:22.041-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:22.051-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:22.130-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:22.133-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:22.402-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60259 #4 (3 connections now open) 2015-03-02T12:08:22.646-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T12:08:22.772-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7187.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12606 nscannedObjects:12606 nMatched:6303 nModified:6303 keyUpdates:1 writeConflicts:0 numYields:101 locks:{} 636ms 2015-03-02T12:08:22.773-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7187.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 636ms 2015-03-02T12:08:22.775-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:22.856-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:22.861-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:23.545-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3976.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12606 nscannedObjects:12606 nMatched:6303 nModified:6303 keyUpdates:1 writeConflicts:0 numYields:101 locks:{} 671ms 2015-03-02T12:08:23.545-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3976.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 671ms 2015-03-02T12:08:23.550-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:23.699-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:23.704-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:23.707-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 156ms 2015-03-02T12:08:23.727-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:23.836-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:23.839-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:23.841-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 114ms 2015-03-02T12:08:24.662-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:08:25.178-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 207ms 2015-03-02T12:08:25.401-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:08:26.752-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:08:27.238-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 186ms 2015-03-02T12:08:27.333-0500 I NETWORK [conn4] end connection 10.4.127.218:60259 (2 connections now open) 2015-03-02T12:08:27.378-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:08:27.379-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60264 #5 (3 connections now open) 2015-03-02T12:08:28.608-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:08:29.774-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T12:08:29.781-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T12:08:29.789-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:08:31.400-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:08:33.980-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:08:34.339-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:34.649-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:08:35.069-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (43255 records 444440554 bytes) are inconsistent with full validation results (42255 records 434167554 bytes). Updating counters with new values. 2015-03-02T12:08:35.069-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (42301 records 434640112 bytes) is inconsistent with full validation results (42255 records 434167554 bytes). Updating size storer with new values. 2015-03-02T12:08:35.069-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:35.078-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:35.083-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 744ms 2015-03-02T12:08:35.089-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:35.233-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (42255 records 434167554 bytes) are inconsistent with full validation results (43255 records 444440554 bytes). Updating counters with new values. 2015-03-02T12:08:35.233-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (42255 records 434167554 bytes) is inconsistent with full validation results (43255 records 444440554 bytes). Updating size storer with new values. 2015-03-02T12:08:35.233-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:35.243-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:35.252-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 163ms 2015-03-02T12:08:35.263-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:35.389-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:35.402-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:35.406-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 143ms 2015-03-02T12:08:35.420-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:35.611-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:35.617-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:35.622-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 201ms 2015-03-02T12:08:35.627-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:35.855-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:35.870-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:35.887-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 259ms 2015-03-02T12:08:36.134-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:08:36.274-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 9518.0 } } ndeleted:6785 keyUpdates:0 writeConflicts:0 numYields:54 locks:{} 382ms 2015-03-02T12:08:36.274-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9518.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 382ms 2015-03-02T12:08:36.275-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:36.403-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (38209 records 392530664 bytes) is inconsistent with full validation results (37470 records 384929310 bytes). Updating size storer with new values. 2015-03-02T12:08:36.403-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:36.417-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:36.423-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 147ms 2015-03-02T12:08:36.432-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:36.560-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:08:37.005-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (38470 records 395202310 bytes) are inconsistent with full validation results (37470 records 384929310 bytes). Updating counters with new values. 2015-03-02T12:08:37.010-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37731 records 387610563 bytes) is inconsistent with full validation results (37470 records 384929310 bytes). Updating size storer with new values. 2015-03-02T12:08:37.011-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:37.018-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:37.028-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 595ms 2015-03-02T12:08:37.044-0500 I NETWORK [conn2] end connection 10.4.127.218:60252 (2 connections now open) 2015-03-02T12:08:37.068-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60271 #6 (3 connections now open) 2015-03-02T12:08:37.180-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 7951.0 } } ndeleted:1616 keyUpdates:0 writeConflicts:0 numYields:13 locks:{} 149ms 2015-03-02T12:08:37.180-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7951.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T12:08:37.182-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:37.326-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (35854 records 368328142 bytes) are inconsistent with full validation results (36854 records 378601142 bytes). Updating counters with new values. 2015-03-02T12:08:37.326-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (36209 records 371975057 bytes) is inconsistent with full validation results (36854 records 378601142 bytes). Updating size storer with new values. 2015-03-02T12:08:37.326-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:37.331-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:37.336-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 153ms 2015-03-02T12:08:37.557-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 5653.0 } } ndeleted:4943 keyUpdates:0 writeConflicts:0 numYields:38 locks:{} 219ms 2015-03-02T12:08:37.557-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5653.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 219ms 2015-03-02T12:08:37.561-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:37.634-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (32209 records 330883057 bytes) is inconsistent with full validation results (31911 records 327821703 bytes). Updating size storer with new values. 2015-03-02T12:08:37.634-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:37.639-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:38.426-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:08:38.652-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3129.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17144 nscannedObjects:17144 nMatched:8572 nModified:8572 keyUpdates:1 writeConflicts:0 numYields:142 locks:{} 1004ms 2015-03-02T12:08:38.653-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3129.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1004ms 2015-03-02T12:08:38.659-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:38.953-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (32773 records 336778949 bytes) is inconsistent with full validation results (32911 records 338206139 bytes). Updating size storer with new values. 2015-03-02T12:08:38.953-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:38.976-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:38.996-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 337ms 2015-03-02T12:08:39.002-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:39.209-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:39.227-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:39.232-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 230ms 2015-03-02T12:08:40.243-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8073.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17144 nscannedObjects:17144 nMatched:8572 nModified:8572 keyUpdates:1 writeConflicts:0 numYields:141 locks:{} 1008ms 2015-03-02T12:08:40.244-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8073.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1008ms 2015-03-02T12:08:40.246-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:40.315-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:40.320-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:40.338-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:40.510-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (34367 records 353163627 bytes) are inconsistent with full validation results (32911 records 338206139 bytes). Updating counters with new values. 2015-03-02T12:08:40.510-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (33469 records 343938473 bytes) is inconsistent with full validation results (32911 records 338206139 bytes). Updating size storer with new values. 2015-03-02T12:08:40.510-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:40.526-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:40.542-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 203ms 2015-03-02T12:08:40.562-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:08:41.716-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2812.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21974 nscannedObjects:21974 nMatched:10987 nModified:10987 keyUpdates:1 writeConflicts:0 numYields:178 locks:{} 1168ms 2015-03-02T12:08:41.716-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2812.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1168ms 2015-03-02T12:08:41.718-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:41.868-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (33455 records 343826046 bytes) are inconsistent with full validation results (34911 records 358783534 bytes). Updating counters with new values. 2015-03-02T12:08:41.868-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (33455 records 343826046 bytes) is inconsistent with full validation results (34911 records 358783534 bytes). Updating size storer with new values. 2015-03-02T12:08:41.868-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:41.873-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:41.879-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 161ms 2015-03-02T12:08:42.235-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:08:42.595-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 3626.0 } } ndeleted:10987 keyUpdates:0 writeConflicts:0 numYields:87 locks:{} 706ms 2015-03-02T12:08:42.595-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3626.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 706ms 2015-03-02T12:08:42.600-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:42.724-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (25340 records 260323228 bytes) is inconsistent with full validation results (24924 records 256044252 bytes). Updating size storer with new values. 2015-03-02T12:08:42.724-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:42.730-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:42.735-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 135ms 2015-03-02T12:08:42.748-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:44.646-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24977 records 256588721 bytes) are inconsistent with full validation results (24924 records 256044252 bytes). Updating counters with new values. 2015-03-02T12:08:44.647-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:44.655-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:44.658-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 1909ms 2015-03-02T12:08:44.870-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1479ms 2015-03-02T12:08:44.876-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:08:44.882-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2033ms 2015-03-02T12:08:45.179-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 6762.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4000 nscannedObjects:4000 nMatched:2000 nModified:2000 keyUpdates:1 writeConflicts:0 numYields:38 locks:{} 515ms 2015-03-02T12:08:45.179-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6762.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 516ms 2015-03-02T12:08:45.183-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:45.215-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (26871 records 276071783 bytes) are inconsistent with full validation results (26911 records 276469729 bytes). Updating counters with new values. 2015-03-02T12:08:45.215-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26871 records 276066375 bytes) is inconsistent with full validation results (26911 records 276469729 bytes). Updating size storer with new values. 2015-03-02T12:08:45.216-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:08:45.235-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:08:45.257-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 380ms 2015-03-02T12:08:45.274-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:08:45.438-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (26911 records 276469729 bytes) are inconsistent with full validation results (26924 records 276616252 bytes). Updating counters with new values. 2015-03-02T12:08:45.438-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26911 records 276469729 bytes) is inconsistent with full validation results (26924 records 276616252 bytes). Updating size storer with new values. 2015-03-02T12:08:45.438-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:45.452-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:45.466-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 282ms 2015-03-02T12:08:45.479-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:45.503-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:08:45.527-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:08:45.534-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 259ms 2015-03-02T12:08:45.541-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:08:45.726-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:45.738-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:45.752-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 272ms 2015-03-02T12:08:45.784-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:45.803-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:08:45.814-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:08:45.831-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 290ms 2015-03-02T12:08:45.997-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:46.013-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:46.021-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 237ms 2015-03-02T12:08:46.046-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:46.269-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3253.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4000 nscannedObjects:4000 nMatched:2000 nModified:2000 keyUpdates:1 writeConflicts:0 numYields:37 locks:{} 427ms 2015-03-02T12:08:46.270-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3253.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 427ms 2015-03-02T12:08:46.277-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:08:46.331-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:46.356-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:46.378-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 331ms 2015-03-02T12:08:46.397-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:46.625-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:08:46.642-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:08:46.658-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 381ms 2015-03-02T12:08:46.704-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:46.711-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:46.714-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 317ms 2015-03-02T12:08:46.719-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:46.947-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:46.958-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:46.971-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 252ms 2015-03-02T12:08:46.977-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:47.160-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:47.179-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:47.195-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 217ms 2015-03-02T12:08:47.578-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5335.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4000 nscannedObjects:4000 nMatched:2000 nModified:2000 keyUpdates:1 writeConflicts:0 numYields:35 locks:{} 380ms 2015-03-02T12:08:47.579-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5335.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 380ms 2015-03-02T12:08:47.587-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:47.804-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:47.812-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:47.825-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 238ms 2015-03-02T12:08:47.837-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:47.988-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:48.001-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:48.008-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 170ms 2015-03-02T12:08:48.020-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:48.105-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:48.112-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:48.123-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 103ms 2015-03-02T12:08:48.275-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 6907.0 } } ndeleted:2000 keyUpdates:0 writeConflicts:0 numYields:15 locks:{} 144ms 2015-03-02T12:08:48.276-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6907.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:08:48.279-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:48.533-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (26596 records 273220708 bytes) are inconsistent with full validation results (25924 records 266317252 bytes). Updating counters with new values. 2015-03-02T12:08:48.533-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26508 records 272316684 bytes) is inconsistent with full validation results (25924 records 266317252 bytes). Updating size storer with new values. 2015-03-02T12:08:48.533-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:48.559-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:48.577-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 297ms 2015-03-02T12:08:48.584-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T12:08:48.587-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:48.776-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (26252 records 269686796 bytes) are inconsistent with full validation results (26924 records 276590252 bytes). Updating counters with new values. 2015-03-02T12:08:48.784-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (25924 records 266317252 bytes) is inconsistent with full validation results (26924 records 276590252 bytes). Updating size storer with new values. 2015-03-02T12:08:48.785-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:48.799-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:48.806-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 219ms 2015-03-02T12:08:48.815-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:49.006-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:49.017-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:49.021-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 206ms 2015-03-02T12:08:49.031-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:49.168-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:49.174-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:49.178-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 147ms 2015-03-02T12:08:49.182-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:49.263-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:49.266-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:49.272-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:49.369-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26924 records 276590252 bytes) is inconsistent with full validation results (26925 records 276590298 bytes). Updating size storer with new values. 2015-03-02T12:08:49.369-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:49.375-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:49.383-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 110ms 2015-03-02T12:08:49.390-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:49.501-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:49.505-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:49.508-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 118ms 2015-03-02T12:08:49.511-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:08:49.649-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:08:49.657-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:08:49.665-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 153ms 2015-03-02T12:08:50.681-0500 I NETWORK [conn3] end connection 10.4.127.218:60257 (2 connections now open) 2015-03-02T12:08:50.735-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60275 #7 (3 connections now open) 2015-03-02T12:08:50.756-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:08:51.085-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (28507 records 292842184 bytes) is inconsistent with full validation results (28925 records 297136298 bytes). Updating size storer with new values. 2015-03-02T12:08:51.085-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:08:51.091-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:08:51.094-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 338ms 2015-03-02T12:08:51.104-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:08:51.183-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (28925 records 297136298 bytes) is inconsistent with full validation results (28924 records 297136252 bytes). Updating size storer with new values. 2015-03-02T12:08:51.184-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:08:51.195-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:08:51.207-0500 I COMMAND [conn7] command test.$cmd command: validate { valida2015-03-02T12:09:27.038-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] MongoDB starting : pid=2488 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:09:27.047-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:09:27.047-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:09:27.084-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:09:27.146-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:09:30.154-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60286 #1 (1 connection now open) 2015-03-02T12:09:30.163-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:09:30.537-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:09:30.542-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:09:30.545-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 381ms 2015-03-02T12:09:31.488-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60287 #2 (2 connections now open) 2015-03-02T12:09:31.514-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:09:31.662-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:09:31.670-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:09:31.676-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 161ms 2015-03-02T12:09:32.684-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3125.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:56251 nscannedObjects:56251 nMatched:26185 nModified:26185 keyUpdates:1 writeConflicts:44 numYields:442 locks:{} 2135ms 2015-03-02T12:09:32.684-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3125.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2135ms 2015-03-02T12:09:32.2015-03-02T12:10:35.142-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] MongoDB starting : pid=2626 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:10:35.152-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:10:35.152-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:10:35.188-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:10:35.239-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:10:36.527-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60368 #1 (1 connection now open) 2015-03-02T12:10:36.854-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60369 #2 (2 connections now open) 2015-03-02T12:10:36.868-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:10:37.450-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:10:37.463-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:10:37.471-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 601ms 2015-03-02T12:10:45.193-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60371 #3 (3 connections now open) 2015-03-02T12:10:45.498-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:10:45.750-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:10:46.312-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T12:10:46.397-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (53299 records 547684879 bytes) are inconsistent with full validation results (52299 records 537411879 bytes). Updating counters with new values. 2015-03-02T12:10:46.397-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (52300 records 537422152 bytes) 2015-03-02T12:11:45.052-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] MongoDB starting : pid=2502 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:11:45.064-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:11:45.065-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:11:45.065-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:11:45.065-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:11:45.122-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:11:45.172-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:11:46.601-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60387 #1 (1 connection now open) 2015-03-02T12:11:47.116-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60388 #2 (2 connections now open) 2015-03-02T12:11:47.133-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:11:47.357-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 5961.0 } } ndeleted:19226 keyUpdates:0 writeConflicts:0 numYields:150 locks:{} 749ms 2015-03-02T12:11:47.357-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5961.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 749ms 2015-03-02T12:11:47.361-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:11:47.477-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18298 records 187968039 bytes) is inconsistent with full validation results (18073 records 185663929 bytes). Updating size storer with new values. 2015-03-02T12:11:47.478-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:11:47.479-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (18073 records 185663929 bytes) are inconsistent with full validation results (22208 records 228186299 bytes). Updating counters with new values. 2015-03-02T12:11:47.479-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (18073 records 185663929 bytes) is inconsistent with full validation results (22208 records 228186299 bytes). Updating size storer with new values. 20152015-03-02T12:12:56.150-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:12:56.158-0500 I CONTROL [initandlisten] MongoDB starting : pid=2818 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:12:56.158-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:12:56.158-0500 I CONTROL [initandlisten] 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:12:56.165-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:12:56.165-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:12:56.220-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:12:56.292-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:12:56.559-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60604 #1 (1 connection now open) 2015-03-02T12:12:59.927-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60606 #2 (2 connections now open) 2015-03-02T12:12:59.941-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:13:00.530-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (38300 records 393600152 bytes) is inconsistent with full validation results (39299 records 403862879 bytes). Updating size storer with new values. 2015-03-02T12:13:00.530-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:13:00.537-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:13:00.544-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 599ms 2015-03-02T12:13:01.231-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60607 #3 (3 connections now open) 2015-03-02T12:13:01.252-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:13:01.493-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (39300 records 403873152 bytes) is inconsistent with full validation results (40299 records 414135879 bytes). Updating size storer with new values. 2015-03-02T12:13:01.494-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:13:01.516-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:13:01.529-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 277ms 2015-03-02T12:13:02.255-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:13:03.044-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T12:13:03.368-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 315ms 2015-03-02T12:13:04.476-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 227ms 2015-03-02T12:13:04.933-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 240ms 2015-03-02T12:13:05.508-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 179ms 2015-03-02T12:13:05.923-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:13:06.263-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60612 #4 (4 connections now open) 2015-03-02T12:13:06.317-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:06.384-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 199ms 2015-03-02T12:13:06.397-0500 I NETWORK [conn3] end connection 10.4.127.218:60607 (3 connections now open) 2015-03-02T12:13:07.076-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (48299 records 496319879 bytes) are inconsistent with full validation results (47845 records 491655937 bytes). Updating counters with new values. 2015-03-02T12:13:07.076-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (47300 records 486057152 bytes) is inconsistent with full validation results (47845 records 491655937 bytes). Updating size storer with new values. 2015-03-02T12:13:07.076-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:07.087-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:07.100-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 783ms 2015-03-02T12:13:07.141-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:07.492-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 185ms 2015-03-02T12:13:07.504-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (48845 records 501928937 bytes) are inconsistent with full validation results (48299 records 496319879 bytes). Updating counters with new values. 2015-03-02T12:13:07.504-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (47846 records 491666210 bytes) is inconsistent with full validation results (48299 records 496319879 bytes). Updating size storer with new values. 2015-03-02T12:13:07.504-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:07.514-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:07.522-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 380ms 2015-03-02T12:13:07.539-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:07.748-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (48299 records 496319879 bytes) are inconsistent with full validation results (49299 records 506592879 bytes). Updating counters with new values. 2015-03-02T12:13:07.748-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (48299 records 496319879 bytes) is inconsistent with full validation results (49299 records 506592879 bytes). Updating size storer with new values. 2015-03-02T12:13:07.749-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:07.760-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:07.775-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 235ms 2015-03-02T12:13:07.797-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:08.174-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (50285 records 516722057 bytes) are inconsistent with full validation results (49299 records 506592879 bytes). Updating counters with new values. 2015-03-02T12:13:08.175-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (49300 records 506603152 bytes) is inconsistent with full validation results (49299 records 506592879 bytes). Updating size storer with new values. 2015-03-02T12:13:08.175-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:08.175-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 203ms 2015-03-02T12:13:08.186-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:08.193-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 395ms 2015-03-02T12:13:09.111-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 182ms 2015-03-02T12:13:10.814-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 373ms 2015-03-02T12:13:11.413-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 9636.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24496 nscannedObjects:24496 nMatched:12248 nModified:12248 keyUpdates:1 writeConflicts:0 numYields:251 locks:{} 3206ms 2015-03-02T12:13:11.413-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9636.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3206ms 2015-03-02T12:13:11.420-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:11.446-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 188ms 2015-03-02T12:13:11.894-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (52299 records 537416611 bytes) are inconsistent with full validation results (53179 records 546456851 bytes). Updating counters with new values. 2015-03-02T12:13:11.894-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (52052 records 534879180 bytes) is inconsistent with full validation results (53179 records 546456851 bytes). Updating size storer with new values. 2015-03-02T12:13:11.894-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:11.908-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:11.920-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 499ms 2015-03-02T12:13:13.600-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:13:13.624-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 4039.0 } } ndeleted:29240 keyUpdates:0 writeConflicts:0 numYields:234 locks:{} 1692ms 2015-03-02T12:13:13.624-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4039.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1692ms 2015-03-02T12:13:13.626-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:13.854-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T12:13:13.956-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25939 records 266471347 bytes) are inconsistent with full validation results (25059 records 257431107 bytes). Updating counters with new values. 2015-03-02T12:13:13.956-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25452 records 261468396 bytes) is inconsistent with full validation results (25059 records 257431107 bytes). Updating size storer with new values. 2015-03-02T12:13:13.956-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:13.971-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:13.977-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 351ms 2015-03-02T12:13:13.981-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:14.112-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25059 records 257431107 bytes) are inconsistent with full validation results (26059 records 267704107 bytes). Updating counters with new values. 2015-03-02T12:13:14.112-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25059 records 257431107 bytes) is inconsistent with full validation results (26059 records 267704107 bytes). Updating size storer with new values. 2015-03-02T12:13:14.112-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:14.117-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:14.119-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 137ms 2015-03-02T12:13:14.123-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:14.286-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:14.293-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:14.297-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 174ms 2015-03-02T12:13:15.211-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3162.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11094 nscannedObjects:11094 nMatched:5547 nModified:5547 keyUpdates:1 writeConflicts:0 numYields:96 locks:{} 909ms 2015-03-02T12:13:15.212-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3162.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 909ms 2015-03-02T12:13:15.216-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:15.380-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:13:15.475-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (27059 records 278049218 bytes) are inconsistent with full validation results (26059 records 267776218 bytes). Updating counters with new values. 2015-03-02T12:13:15.475-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (27025 records 277699936 bytes) is inconsistent with full validation results (26059 records 267776218 bytes). Updating size storer with new values. 2015-03-02T12:13:15.475-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:15.486-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:15.490-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 273ms 2015-03-02T12:13:15.508-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:15.667-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (26059 records 267776218 bytes) are inconsistent with full validation results (27059 records 278049218 bytes). Updating counters with new values. 2015-03-02T12:13:15.667-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26059 records 267776218 bytes) is inconsistent with full validation results (27059 records 278049218 bytes). Updating size storer with new values. 2015-03-02T12:13:15.668-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:15.674-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:15.677-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 169ms 2015-03-02T12:13:15.686-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:15.879-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:15.893-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:15.895-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 208ms 2015-03-02T12:13:16.147-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:13:17.008-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:13:17.018-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4075.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:15094 nscannedObjects:15094 nMatched:7547 nModified:7547 keyUpdates:1 writeConflicts:0 numYields:128 locks:{} 1116ms 2015-03-02T12:13:17.018-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4075.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1116ms 2015-03-02T12:13:17.021-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:17.216-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (28478 records 292652605 bytes) is inconsistent with full validation results (29059 records 298621218 bytes). Updating size storer with new values. 2015-03-02T12:13:17.217-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:17.223-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:17.232-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 210ms 2015-03-02T12:13:18.410-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7486.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17094 nscannedObjects:17094 nMatched:8547 nModified:8547 keyUpdates:1 writeConflicts:0 numYields:143 locks:{} 1170ms 2015-03-02T12:13:18.410-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7486.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1170ms 2015-03-02T12:13:18.415-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:13:18.591-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:13:18.599-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:13:18.614-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 199ms 2015-03-02T12:13:18.794-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:13:18.803-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:13:18.860-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:13:18.865-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:13:19.038-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31059 records 319180218 bytes) are inconsistent with full validation results (30514 records 313581433 bytes). Updating counters with new values. 2015-03-02T12:13:19.038-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (30931 records 317865274 bytes) is inconsistent with full validation results (30514 records 313581433 bytes). Updating size storer with new values. 2015-03-02T12:13:19.038-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:13:19.047-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:13:19.052-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 249ms 2015-03-02T12:13:19.062-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (30514 records 313581433 bytes) are inconsistent with full validation results (31059 records 319180218 bytes). Updating counters with new values. 2015-03-02T12:13:19.062-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (30514 records 313581433 bytes) is inconsistent with full validation results (31059 records 319180218 bytes). Updating size storer with new values. 2015-03-02T12:13:19.068-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:13:19.074-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:13:19.078-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:13:19.080-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 215ms 2015-03-02T12:13:19.244-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31059 records 319194713 bytes) are inconsistent with full validation results (31059 records 319180218 bytes). Updating counters with new values. 2015-03-02T12:13:19.244-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (31059 records 319191554 bytes) is inconsistent with full validation results (31059 records 319180218 bytes). Updating size storer with new values. 2015-03-02T12:13:19.244-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:13:19.250-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:13:19.256-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 181ms 2015-03-02T12:13:19.951-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60620 #5 (4 connections now open) 2015-03-02T12:13:20.008-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:13:20.312-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (31059 records 319191723 bytes) are inconsistent with full validation results (31059 records 319206218 bytes). Updating counters with new values. 2015-03-02T12:13:20.312-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (31059 records 319191723 bytes) is inconsistent with full validation results (31059 records 319206218 bytes). Updating size storer with new values. 2015-03-02T12:13:20.312-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:13:20.329-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:13:20.341-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 333ms 2015-03-02T12:13:21.807-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 257ms 2015-03-02T12:13:21.960-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3659.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29042 nscannedObjects:29042 nMatched:10547 nModified:10547 keyUpdates:1 writeConflicts:1367 numYields:273 locks:{} 2871ms 2015-03-02T12:13:21.960-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3659.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2871ms 2015-03-02T12:13:21.961-0500 I NETWORK [conn2] end connection 10.4.127.218:60606 (3 connections now open) 2015-03-02T12:13:22.331-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9687.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25976 nscannedObjects:25976 nMatched:10547 nModified:10547 keyUpdates:1 writeConflicts:2283 numYields:260 locks:{} 3069ms 2015-03-02T12:13:22.331-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9687.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3070ms 2015-03-02T12:13:22.334-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:13:22.581-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:13:22.592-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:13:22.639-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 304ms 2015-03-02T12:13:22.662-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:13:22.898-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:13:22.909-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:13:22.914-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 251ms 2015-03-02T12:13:23.159-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 7896.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21195 nscannedObjects:21195 nMatched:10547 nModified:10547 keyUpdates:1 writeConflicts:1970 numYields:218 locks:{} 2805ms 2015-03-02T12:13:23.159-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7896.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2805ms 2015-03-02T12:13:23.164-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:13:23.428-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:13:23.439-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:13:23.449-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 284ms 2015-03-02T12:13:24.366-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 183ms 2015-03-02T12:13:24.785-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4686.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21094 nscannedObjects:21094 nMatched:10547 nModified:10547 keyUpdates:1 writeConflicts:0 numYields:182 locks:{} 1866ms 2015-03-02T12:13:24.785-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4686.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1866ms 2015-03-02T12:13:24.789-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:13:25.110-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33059 records 339868711 bytes) are inconsistent with full validation results (33059 records 339851746 bytes). Updating counters with new values. 2015-03-02T12:13:25.110-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (33059 records 339865110 bytes) is inconsistent with full validation results (33059 records 339851746 bytes). Updating size storer with new values. 2015-03-02T12:13:25.110-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:13:25.123-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:13:25.154-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 364ms 2015-03-02T12:13:26.185-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 214ms 2015-03-02T12:13:26.581-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60625 #6 (4 connections now open) 2015-03-02T12:13:28.778-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 227ms 2015-03-02T12:13:29.507-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 292ms 2015-03-02T12:13:31.063-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 379ms 2015-03-02T12:13:31.710-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 158.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:67940 nscannedObjects:67940 nMatched:32479 nModified:32479 keyUpdates:1 writeConflicts:0 numYields:656 locks:{} 8258ms 2015-03-02T12:13:31.710-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 158.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 8258ms 2015-03-02T12:13:31.715-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:13:32.337-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 281ms 2015-03-02T12:13:32.478-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (38059 records 391385369 bytes) are inconsistent with full validation results (37059 records 381129334 bytes). Updating counters with new values. 2015-03-02T12:13:32.478-0500 W STORAGE [conn5] table:collection-2-23211545006892015-03-02T12:14:08.339-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] MongoDB starting : pid=2598 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:14:08.355-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:14:08.355-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:14:08.397-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:14:08.467-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:14:08.783-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60648 #1 (1 connection now open) 2015-03-02T12:14:10.442-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8554.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28080 nscannedObjects:28080 nMatched:14040 nModified:14040 keyUpdates:1 writeConflicts:0 numYields:233 locks:{} 1641ms 2015-03-02T12:14:10.442-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8554.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1641ms 2015-03-02T12:14:10.446-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:14:10.829-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:14:10.835-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:14:10.840-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 394ms 2015-03-02T12:14:10.846-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:14:10.939-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:14:10.943-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:14:15.122-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60653 #2 (2 connections now open) 2015-03-02T12:14:15.136-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:14:15.506-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42260 records 434309260 bytes) is inconsistent with full validation results (42299 records 434709907 bytes). Updating size storer with new values. 2015-03-02T12:14:15.510-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:14:15.529-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:14:15.538-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 401ms 2015-03-02T12:14:16.366-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 208ms 2015-03-02T12:14:16.405-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60655 #3 (3 connections now open) 2015-03-02T12:14:19.422-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 232ms 2015-03-02T12:14:20.150-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60656 #4 (4 connections now open) 2015-03-02T12:14:20.258-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:14:21.420-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:14:21.453-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:14:21.471-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1213ms 2015-03-02T12:14:23.215-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 292ms 2015-03-02T12:14:23.280-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2365.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:74959 nscannedObjects:74959 nMatched:31340 nModified:31340 keyUpdates:1 writeConflicts:135 numYields:704 locks:{} 7724ms 2015-03-02T12:14:23.280-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2365.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 7724ms 2015-03-02T12:14:23.288-0500 I NETWORK [conn2] end connection 10.4.127.218:60653 (3 connections now open) 2015-03-02T12:14:24.058-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8080.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:62680 nscannedObjects:62680 nMatched:31340 nModified:31340 keyUpdates:1 writeConflicts:88 numYields:619 locks:{} 7618ms 2015-03-02T12:14:24.058-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8080.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 7618ms 2015-03-02T12:14:24.063-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:14:24.082-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T12:14:24.541-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 207ms 2015-03-02T12:14:24.548-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486299807 bytes) are inconsistent with full validation results (46169 records 474691317 bytes). Updating counters with new values. 2015-03-02T12:14:24.549-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (46580 records 478913520 bytes) is inconsistent with full validation results (46169 records 474691317 bytes). Updating size storer with new values. 2015-03-02T12:14:24.549-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:14:24.567-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:14:24.583-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 519ms 2015-03-02T12:14:25.371-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T12:14:25.491-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:14:25.497-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:14:25.842-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (48169 records 495237317 bytes) are inconsistent with full validation results (49299 records 506845807 bytes). Updating counters with new values. 2015-03-02T12:14:25.842-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (47450 records 487851030 bytes) is inconsistent with full validation results (49299 records 506845807 bytes). Updating size storer with new values. 2015-03-02T12:14:25.842-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:14:25.848-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:14:25.851-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 353ms 2015-03-02T12:14:26.756-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60657 #5 (4 connections now open) 2015-03-02T12:14:27.113-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 249ms 2015-03-02T12:14:27.702-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 193ms 2015-03-02T12:14:29.485-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 231ms 2015-03-02T12:14:31.228-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f49a74280bcc8ca129f33b'), x: 1890.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 21 } }, Database: { acquireCount: { w: 21 } }, Collection: { acquireCount: { w: 21 } } } 104ms 2015-03-02T12:14:31.260-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 577ms 2015-03-02T12:14:31.875-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3725.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:51393 nscannedObjects:51393 nMatched:22943 nModified:22943 keyUpdates:1 writeConflicts:10990 numYields:503 locks:{} 6022ms 2015-03-02T12:14:31.875-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3725.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6022ms 2015-03-02T12:14:31.879-0500 I NETWORK [conn1] end connection 10.4.127.218:60648 (3 connections now open) 2015-03-02T12:14:31.887-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 277ms 2015-03-02T12:14:32.606-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 7506.0 } } ndeleted:14040 keyUpdates:0 writeConflicts:30 numYields:351 locks:{} 5822ms 2015-03-02T12:14:32.606-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7506.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 5822ms 2015-03-02T12:14:32.610-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:14:32.910-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18967 records 194837855 bytes) is inconsistent with full validation results (18959 records 194765807 bytes). Updating size storer with new values. 2015-03-02T12:14:32.910-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:14:32.945-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:14:32.949-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 339ms 2015-03-02T12:14:32.966-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:14:33.185-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:14:33.199-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:14:33.206-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 239ms 2015-03-02T12:14:33.216-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:14:33.390-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:14:33.405-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:14:33.414-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 198ms 2015-03-02T12:14:33.430-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:14:33.579-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:14:33.584-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:14:33.586-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 156ms 2015-03-02T12:14:33.602-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:14:33.736-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:14:33.744-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:14:33.746-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 144ms 2015-03-02T12:14:34.094-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T12:14:34.166-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 197ms 2015-03-02T12:14:36.076-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 197ms 2015-03-02T12:14:36.079-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 190ms 2015-03-02T12:14:36.175-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T12:14:36.395-0500 I NETWORK [conn3] end connection 10.4.127.218:60655 (2 connections now open) 2015-03-02T12:14:36.424-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60668 #6 (3 connections now open) 2015-03-02T12:14:36.445-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:14:36.758-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (24951 records 256321623 bytes) is inconsistent with full validation results (24959 records 256403807 bytes). Updating size storer with new values. 2015-03-02T12:14:36.759-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:14:36.767-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:14:36.771-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 326ms 2015-03-02T12:14:36.886-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6486.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:1028 nscannedObjects:1028 nMatched:514 nModified:514 keyUpdates:1 writeConflicts:0 numYields:9 locks:{} 109ms 2015-03-02T12:14:36.886-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6486.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 109ms 2015-03-02T12:14:36.889-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:14:37.043-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (24959 records 256403807 bytes) is inconsistent with full validation results (24959 records 256410489 bytes). Updating size storer with new values. 2015-03-02T12:14:37.043-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:14:37.049-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:14:37.051-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 162ms 2015-03-02T12:14:37.428-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T12:14:38.851-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:14:39.281-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:14:39.413-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:14:40.420-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 243ms 2015-03-02T12:14:41.558-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:14:42.044-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (33437 records 343504983 bytes) is inconsistent with full validation results (33959 records 348867489 bytes). Updating size storer with new values. 2015-03-02T12:14:42.044-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:14:42.067-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:14:42.081-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 523ms 2015-03-02T12:14:42.148-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:14:42.810-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 334ms 2015-03-02T12:14:43.740-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T12:14:44.524-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:2015-03-02T12:15:32.431-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:15:32.439-0500 I CONTROL [initandlisten] MongoDB starting : pid=2804 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:15:32.439-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:15:32.439-0500 I CONTROL [initandlisten] 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:15:32.440-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:15:32.440-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:15:32.508-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:15:32.577-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:15:36.748-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60705 #1 (1 connection now open) 2015-03-02T12:15:36.766-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:37.125-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60706 #2 (2 connections now open) 2015-03-02T12:15:37.185-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:37.192-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:37.201-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:15:37.203-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 430ms 2015-03-02T12:15:37.212-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:37.353-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:15:37.362-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:15:37.366-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:37.369-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 167ms 2015-03-02T12:15:37.373-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:37.380-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 168ms 2015-03-02T12:15:37.381-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:15:37.517-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383331192 bytes) are inconsistent with full validation results (37299 records 383316879 bytes). Updating counters with new values. 2015-03-02T12:15:37.517-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329892 bytes) is inconsistent with full validation results (37299 records 383316879 bytes). Updating size storer with new values. 2015-03-02T12:15:37.517-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:15:37.532-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:15:37.538-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 157ms 2015-03-02T12:15:37.549-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:15:37.698-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383326746 bytes) are inconsistent with full validation results (37299 records 383334611 bytes). Updating counters with new values. 2015-03-02T12:15:37.698-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383326746 bytes) is inconsistent with full validation results (37299 records 383334611 bytes). Updating size storer with new values. 2015-03-02T12:15:37.698-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:15:37.705-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:15:37.710-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 160ms 2015-03-02T12:15:38.872-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8702.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21013 nscannedObjects:21013 nMatched:10492 nModified:10492 keyUpdates:1 writeConflicts:50 numYields:172 locks:{} 1483ms 2015-03-02T12:15:38.872-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8702.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1483ms 2015-03-02T12:15:38.875-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:38.954-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 7043.0 } } ndeleted:10492 keyUpdates:0 writeConflicts:32 numYields:123 locks:{} 1235ms 2015-03-02T12:15:38.954-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7043.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1235ms 2015-03-02T12:15:38.961-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:15:39.000-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (20237 records 207888253 bytes) are inconsistent with full validation results (21610 records 222007139 bytes). Updating counters with new values. 2015-03-02T12:15:39.001-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20816 records 213833607 bytes) is inconsistent with full validation results (21610 records 222007139 bytes). Updating size storer with new values. 2015-03-02T12:15:39.001-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.015-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.020-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 145ms 2015-03-02T12:15:39.029-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.066-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (21610 records 222007139 bytes) are inconsistent with full validation results (20237 records 207894701 bytes). Updating counters with new values. 2015-03-02T12:15:39.066-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (21610 records 222007139 bytes) is inconsistent with full validation results (20237 records 207894701 bytes). Updating size storer with new values. 2015-03-02T12:15:39.066-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:15:39.069-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:15:39.070-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 108ms 2015-03-02T12:15:39.100-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.104-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.113-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.170-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.174-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.776-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 853.0 } } ndeleted:15119 keyUpdates:0 writeConflicts:0 numYields:118 locks:{} 598ms 2015-03-02T12:15:39.776-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 853.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 598ms 2015-03-02T12:15:39.777-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.807-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5816 records 59747768 bytes) is inconsistent with full validation results (5118 records 52577214 bytes). Updating size storer with new values. 2015-03-02T12:15:39.807-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.811-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.821-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.832-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.833-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.837-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.847-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.847-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.851-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.867-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.868-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.871-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.886-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.887-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.892-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.903-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.904-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.907-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.918-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.919-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.927-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.948-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.948-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.955-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.974-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5118 records 52577214 bytes) is inconsistent with full validation results (5119 records 52577260 bytes). Updating size storer with new values. 2015-03-02T12:15:39.974-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.975-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:39.978-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:39.997-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:39.998-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:40.002-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:40.013-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:40.014-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:40.017-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:40.036-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:40.037-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:40.042-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:40.056-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:40.058-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:40.063-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:40.073-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5119 records 52577260 bytes) is inconsistent with full validation results (5118 records 52577214 bytes). Updating size storer with new values. 2015-03-02T12:15:40.073-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:40.074-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:40.483-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60711 #3 (3 connections now open) 2015-03-02T12:15:40.496-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:15:40.512-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:15:40.513-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:15:42.746-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:15:43.770-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:15:43.928-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:15:45.360-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:15:45.939-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:15:46.067-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:15:46.579-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:15:48.067-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T12:15:48.138-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:15:48.840-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T12:15:48.844-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:49.638-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23418 records 240573114 bytes) is inconsistent with full validation results (24118 records 247764214 bytes). Updating size storer with new values. 2015-03-02T12:15:49.638-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:49.641-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:49.644-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 799ms 2015-03-02T12:15:49.661-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:49.801-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:49.805-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:49.807-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 146ms 2015-03-02T12:15:50.000-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8767.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2466 nscannedObjects:2466 nMatched:1233 nModified:1233 keyUpdates:1 writeConflicts:0 numYields:19 locks:{} 182ms 2015-03-02T12:15:50.000-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8767.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 182ms 2015-03-02T12:15:50.007-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:50.060-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:15:50.169-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (25118 records 258053243 bytes) are inconsistent with full validation results (24670 records 253450939 bytes). Updating counters with new values. 2015-03-02T12:15:50.170-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (24270 records 249340634 bytes) is inconsistent with full validation results (24670 records 253450939 bytes). Updating size storer with new values. 2015-03-02T12:15:50.170-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:50.180-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:50.184-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 176ms 2015-03-02T12:15:50.190-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:50.319-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (24670 records 253450939 bytes) are inconsistent with full validation results (25118 records 258053243 bytes). Updating counters with new values. 2015-03-02T12:15:50.320-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (24670 records 253450939 bytes) is inconsistent with full validation results (25118 records 258053243 bytes). Updating size storer with new values. 2015-03-02T12:15:50.320-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:50.331-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:50.336-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 145ms 2015-03-02T12:15:50.465-0500 I NETWORK [conn3] end connection 10.4.127.218:60711 (2 connections now open) 2015-03-02T12:15:50.498-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60713 #4 (3 connections now open) 2015-03-02T12:15:50.523-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:15:50.666-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (20907 records 214785372 bytes) are inconsistent with full validation results (22654 records 232740571 bytes). Updating counters with new values. 2015-03-02T12:15:50.666-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21051 records 216266556 bytes) is inconsistent with full validation results (22654 records 232740571 bytes). Updating size storer with new values. 2015-03-02T12:15:50.667-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:15:50.686-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:15:50.694-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 171ms 2015-03-02T12:15:50.705-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6096.0 } } ndeleted:4808 keyUpdates:0 writeConflicts:0 numYields:38 locks:{} 362ms 2015-03-02T12:15:50.705-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6096.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 362ms 2015-03-02T12:15:50.708-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:50.824-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22057 records 226599829 bytes) are inconsistent with full validation results (20310 records 208644630 bytes). Updating counters with new values. 2015-03-02T12:15:50.824-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22654 records 232740571 bytes) is inconsistent with full validation results (20310 records 208644630 bytes). Updating size storer with new values. 2015-03-02T12:15:50.824-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:50.835-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:50.841-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 133ms 2015-03-02T12:15:50.847-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:50.914-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20310 records 208644630 bytes) is inconsistent with full validation results (20311 records 208644676 bytes). Updating size storer with new values. 2015-03-02T12:15:50.914-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:50.919-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:50.924-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:50.972-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:50.976-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:50.985-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:51.071-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:51.074-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:51.082-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:51.146-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:51.151-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:51.162-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:51.260-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:51.263-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:51.279-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 117ms 2015-03-02T12:15:51.291-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:51.529-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:51.540-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:51.549-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 257ms 2015-03-02T12:15:51.561-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:15:51.634-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20311 records 208644676 bytes) is inconsistent with full validation results (20310 records 208644630 bytes). Updating size storer with new values. 2015-03-02T12:15:51.634-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:15:51.647-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:15:52.453-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 223ms 2015-03-02T12:15:53.758-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 278ms 2015-03-02T12:15:53.925-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 263ms 2015-03-02T12:15:54.220-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 260ms 2015-03-02T12:15:55.227-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T12:15:55.232-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T12:15:55.237-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:15:55.532-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (26566 records 272912518 bytes) is inconsistent with full validation results (27310 records 280555630 bytes). Updating size storer with new values. 2015-03-02T12:15:55.532-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:15:55.536-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:15:55.539-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 301ms 2015-03-02T12:15:57.162-0500 I NETWORK [conn2] end connection 10.4.127.218:60706 (2 connections now open) 2015-03-02T12:15:57.188-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60714 #5 (3 connections now open) 2015-03-02T12:15:57.297-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 188ms 2015-03-02T12:15:57.482-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 186ms 2015-03-02T12:15:57.598-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 8566.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2868 nscannedObjects:2868 nMatched:1434 nModified:1434 keyUpdates:1 writeConflicts:0 numYields:28 locks:{} 382ms 2015-03-02T12:15:57.598-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8566.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 383ms 2015-03-02T12:15:57.603-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:15:57.929-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (30310 records 311390958 bytes) is inconsistent with full validation results (30310 records 311393272 bytes). Updating size storer with new values. 2015-03-02T12:15:57.929-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:15:57.942-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:15:57.961-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 357ms 2015-03-02T12:15:57.968-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:15:58.171-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:15:58.179-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:15:58.193-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 224ms 2015-03-02T12:15:58.200-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:15:58.412-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:15:58.426-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:15:58.445-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 244ms 2015-03-02T12:15:58.661-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:16:00.376-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:16:00.649-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T12:16:02.698-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:16:03.517-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T12:16:03.917-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:16:04.908-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:16:05.084-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T12:16:05.089-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:16:05.533-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (46132 records 473932678 bytes) is inconsistent with full validation results (46310 records 475761272 bytes). Updating size storer with new values. 2015-03-02T12:16:05.534-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:16:05.541-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:16:05.550-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 461ms 2015-03-02T12:16:06.260-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:16:06.430-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (47132 records 484205678 bytes) is inconsistent with full validation results (47310 records 486034272 bytes). Updating size storer with new values. 2015-03-02T12:16:06.430-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:16:06.445-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:16:06.459-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 198ms 2015-03-02T12:16:06.470-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:16:06.646-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:16:06.741-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (48310 records 496307272 bytes) are inconsistent with full validation results (47310 records 486034272 bytes). Updating counters with new values. 2015-03-02T12:16:06.741-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (48132 records 494478678 bytes) is inconsistent with full validation results (47310 records 486034272 bytes). Updating size storer with new values. 2015-03-02T12:16:06.741-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:16:06.754-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:16:06.765-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 295ms 2015-03-02T12:16:06.766-0500 I NETWORK [conn1] end connection 10.4.127.218:60705 (2 connections now open) 2015-03-02T12:16:06.773-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60717 #6 (3 connections now open) 2015-03-02T12:16:07.174-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:16:08.569-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 202ms 2015-03-02T12:16:08.588-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T12:16:08.678-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 3156.0 } } ndeleted:24412 keyUpdates:0 writeConflicts:0 numYields:202 locks:{} 1897ms 2015-03-02T12:16:08.678-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3156.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1897ms 2015-03-02T12:16:08.685-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:16:09.125-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (25898 records 266050154 bytes) are inconsistent with full validation results (26898 records 276323154 bytes). Updating counters with new values. 2015-03-02T12:16:09.125-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (26488 records 272118894 bytes) is inconsistent with full validation results (26898 records 276323154 bytes). Updating size storer with new values. 2015-03-02T12:16:09.125-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:16:09.141-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:16:09.148-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 463ms 2015-03-02T12:16:09.160-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:16:09.267-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:16:09.274-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:16:09.281-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 121ms 2015-03-02T12:16:09.295-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:16:09.367-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:16:09.371-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:16:45.179-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] MongoDB starting : pid=2620 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:16:45.191-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:16:45.191-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:16:45.233-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:16:45.297-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:16:45.521-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60741 #1 (1 connection now open) 2015-03-02T12:16:45.536-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:16:46.437-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:16:46.447-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:16:46.455-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 918ms 2015-03-02T12:16:46.586-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60742 #2 (2 connections now open) 2015-03-02T12:16:46.608-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:16:46.783-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:16:46.793-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:16:46.799-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 190ms 2015-03-02T12:16:46.814-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:16:46.979-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:16:46.990-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:16:46.993-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 178ms 2015-03-02T12:16:47.002-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:16:47.170-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:16:47.178-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:16:47.183-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 180ms 2015-03-02T12:16:47.196-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:16:47.342-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:16:47.350-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:16:47.359-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 162ms 2015-03-02T12:16:47.368-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:16:47.521-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:16:47.528-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:16:47.533-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 164ms 2015-03-02T12:16:47.550-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:16:47.816-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:16:47.823-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:16:47.828-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 277ms 2015-03-02T12:16:48.395-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9106.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25872 nscannedObjects:25872 nMatched:12936 nModified:12936 keyUpdates:1 writeConflicts:0 numYields:218 locks:{} 1931ms 2015-03-02T12:16:48.395-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9106.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1931ms 2015-03-02T12:16:48.398-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:16:48.568-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:16:48.581-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:16:48.589-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 190ms 2015-03-02T12:16:50.059-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 8094.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:36925 nscannedObjects:36925 nMatched:14960 nModified:14960 keyUpdates:1 writeConflicts:91 numYields:303 locks:{} 2223ms 2015-03-02T12:16:50.059-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8094.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2223ms 2015-03-02T12:16:50.062-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:16:50.225-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:16:50.232-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:16:50.251-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 189ms 2015-03-02T12:16:50.317-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60744 #3 (3 connections now open) 2015-03-02T12:16:50.458-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8416.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29920 nscannedObjects:29920 nMatched:14960 nModified:14960 keyUpdates:1 writeConflicts:81 numYields:243 locks:{} 1865ms 2015-03-02T12:16:50.458-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8416.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1865ms 2015-03-02T12:16:50.460-0500 I NETWORK [conn1] end connection 10.4.127.218:60741 (2 connections now open) 2015-03-02T12:16:51.965-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60745 #4 (3 connections now open) 2015-03-02T12:16:52.034-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:16:52.039-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:16:53.131-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:16:54.724-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:16:56.029-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:16:56.916-0500 I NETWORK [conn4] end connection 10.4.127.218:60745 (2 connections now open) 2015-03-02T12:16:56.975-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60746 #5 (3 connections now open) 2015-03-02T12:16:57.001-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:16:57.231-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:16:57.576-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (50299 records 516905867 bytes) are inconsistent with full validation results (49299 records 506632867 bytes). Updating counters with new values. 2015-03-02T12:16:57.576-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (49444 records 508122452 bytes) is inconsistent with full validation results (49299 records 506632867 bytes). Updating size storer with new values. 2015-03-02T12:16:57.576-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:16:57.590-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:16:57.606-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 604ms 2015-03-02T12:16:57.796-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T12:16:58.822-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:16:59.447-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:17:00.457-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T12:17:01.702-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:17:01.993-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:17:03.371-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T12:17:03.829-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 198ms 2015-03-02T12:17:03.832-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:17:04.767-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (57299 records 589256813 bytes) are inconsistent with full validation results (58299 records 599529813 bytes). Updating counters with new values. 2015-03-02T12:17:04.767-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (57299 records 589256813 bytes) is inconsistent with full validation results (58299 records 599529813 bytes). Updating size storer with new values. 2015-03-02T12:17:04.767-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:17:04.787-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:17:04.802-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 969ms 2015-03-02T12:17:04.848-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:17:05.074-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 752.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:97604 nscannedObjects:97604 nMatched:48802 nModified:48802 keyUpdates:1 writeConflicts:0 numYields:832 locks:{} 7463ms 2015-03-02T12:17:05.075-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 752.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 7463ms 2015-03-02T12:17:05.079-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:17:05.465-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 164ms 2015-03-02T12:17:05.470-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:05.653-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (59299 records 609802813 bytes) are inconsistent with full validation results (58299 records 599529813 bytes). Updating counters with new values. 2015-03-02T12:17:05.653-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (58642 records 603053452 bytes) is inconsistent with full validation results (58299 records 599529813 bytes). Updating size storer with new values. 2015-03-02T12:17:05.653-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:17:05.659-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:17:05.685-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:17:05.690-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:17:05.705-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 857ms 2015-03-02T12:17:05.707-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 627ms 2015-03-02T12:17:05.968-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (58299 records 599547558 bytes) are inconsistent with full validation results (59299 records 609802813 bytes). Updating counters with new values. 2015-03-02T12:17:05.968-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (58299 records 599547272 bytes) is inconsistent with full validation results (59299 records 609802813 bytes). Updating size storer with new values. 2015-03-02T12:17:05.969-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:05.993-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:06.009-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 538ms 2015-03-02T12:17:06.542-0500 I NETWORK [conn2] end connection 10.4.127.218:60742 (2 connections now open) 2015-03-02T12:17:06.589-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60749 #6 (3 connections now open) 2015-03-02T12:17:06.635-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:07.199-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (51110 records 525667128 bytes) are inconsistent with full validation results (54523 records 560790991 bytes). Updating counters with new values. 2015-03-02T12:17:07.199-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (51515 records 529832958 bytes) is inconsistent with full validation results (54523 records 560790991 bytes). Updating size storer with new values. 2015-03-02T12:17:07.199-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:07.222-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:07.240-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 604ms 2015-03-02T12:17:12.820-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 191.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:59015 nscannedObjects:59015 nMatched:19836 nModified:19836 keyUpdates:1 writeConflicts:33022 numYields:544 locks:{} 7107ms 2015-03-02T12:17:12.820-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 191.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 7108ms 2015-03-02T12:17:12.823-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:17:13.151-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (8957 records 92099115 bytes) are inconsistent with full validation results (7913 records 81360531 bytes). Updating counters with new values. 2015-03-02T12:17:13.151-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (9039 records 92942567 bytes) is inconsistent with full validation results (7913 records 81360531 bytes). Updating size storer with new values. 2015-03-02T12:17:13.151-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:17:13.163-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:17:13.169-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 345ms 2015-03-02T12:17:13.263-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 8900.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39392 nscannedObjects:39392 nMatched:10936 nModified:10936 keyUpdates:1 writeConflicts:35847 numYields:389 locks:{} 6015ms 2015-03-02T12:17:13.265-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8900.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6018ms 2015-03-02T12:17:13.270-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.320-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (6026 records 61950849 bytes) are inconsistent with full validation results (4251 records 43693199 bytes). Updating counters with new values. 2015-03-02T12:17:13.320-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (6113 records 62845731 bytes) is inconsistent with full validation results (4251 records 43693199 bytes). Updating size storer with new values. 2015-03-02T12:17:13.320-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.321-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.330-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.359-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (3854 records 39609657 bytes) are inconsistent with full validation results (3497 records 35937555 bytes). Updating counters with new values. 2015-03-02T12:17:13.359-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (4251 records 43693199 bytes) is inconsistent with full validation results (3497 records 35937555 bytes). Updating size storer with new values. 2015-03-02T12:17:13.359-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.360-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.379-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.402-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (3148 records 32347741 bytes) are inconsistent with full validation results (3115 records 32008303 bytes). Updating counters with new values. 2015-03-02T12:17:13.402-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (3497 records 35937555 bytes) is inconsistent with full validation results (3115 records 32008303 bytes). Updating size storer with new values. 2015-03-02T12:17:13.402-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.403-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.415-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.435-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (2850 records 29282513 bytes) are inconsistent with full validation results (2748 records 28233341 bytes). Updating counters with new values. 2015-03-02T12:17:13.435-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (3013 records 30959131 bytes) is inconsistent with full validation results (2748 records 28233341 bytes). Updating size storer with new values. 2015-03-02T12:17:13.438-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.439-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.449-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.461-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (2463 records 25301831 bytes) are inconsistent with full validation results (2420 records 24859533 bytes). Updating counters with new values. 2015-03-02T12:17:13.461-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (2748 records 28233341 bytes) is inconsistent with full validation results (2420 records 24859533 bytes). Updating size storer with new values. 2015-03-02T12:17:13.461-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.462-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.473-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.485-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (2149 records 22072027 bytes) are inconsistent with full validation results (2136 records 21938309 bytes). Updating counters with new values. 2015-03-02T12:17:13.485-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (2420 records 24859533 bytes) is inconsistent with full validation results (2136 records 21938309 bytes). Updating size storer with new values. 2015-03-02T12:17:13.486-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.488-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.498-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.503-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (1886 records 19366809 bytes) are inconsistent with full validation results (1776 records 18235349 bytes). Updating counters with new values. 2015-03-02T12:17:13.503-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (2136 records 21938309 bytes) is inconsistent with full validation results (1776 records 18235349 bytes). Updating size storer with new values. 2015-03-02T12:17:13.503-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.503-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.506-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 1676.0 } } ndeleted:6855 keyUpdates:0 writeConflicts:97 numYields:471 locks:{} 7489ms 2015-03-02T12:17:13.506-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1676.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 7489ms 2015-03-02T12:17:13.508-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.511-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:17:13.515-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (1720 records 17669573 bytes) are inconsistent with full validation results (1719 records 17659287 bytes). Updating counters with new values. 2015-03-02T12:17:13.515-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (1745 records 17916483 bytes) is inconsistent with full validation results (1719 records 17659287 bytes). Updating size storer with new values. 2015-03-02T12:17:13.515-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.516-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:13.517-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:17:13.518-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:17:13.520-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.525-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.526-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:13.529-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.535-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.537-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:13.541-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.544-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.545-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:13.548-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.551-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.552-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:13.555-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.558-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.559-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:13.561-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.567-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.567-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:13.572-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:17:13.580-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (1719 records 17659287 bytes) is inconsistent with full validation results (1720 records 17659333 bytes). Updating size storer with new values. 2015-03-02T12:17:13.580-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:17:13.580-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:17:15.037-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:17:16.676-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T12:17:16.682-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:17:16.997-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:17:17.988-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 215ms 2015-03-02T12:17:19.149-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T12:17:19.897-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 163ms 2015-03-02T12:17:20.299-0500 I NETWORK [conn3] end connection 10.4.127.218:60744 (2 connections now open) 2015-03-02T12:17:20.334-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60763 #7 (3 connections now open) 2015-03-02T12:17:20.931-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 264ms 2015-03-02T12:17:20.952-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 236ms 2015-03-02T12:17:21.936-0500 I WRITE [conn7] update test.foo query: { x: { $gte: 1459.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:19248 nscannedObjects:19248 nMatched:9624 nModified:9624 keyUpdates:1 writeConflicts:0 numYields:172 locks:{} 1591ms 2015-03-02T12:17:21.936-0500 I COMMAND [conn7] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1459.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1591ms 2015-03-02T12:17:21.949-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:17:22.167-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (15720 records 161597995 bytes) is inconsistent with full validation results (15720 records 161606432 bytes). Updating size storer with new values. 2015-03-02T12:17:22.167-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:17:22.174-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:17:22.187-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 238ms 2015-03-02T12:17:22.638-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:17:58.929-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] MongoDB starting : pid=2828 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:17:58.942-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:17:58.942-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:17:58.984-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:17:59.047-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:18:01.036-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60779 #1 (1 connection now open) 2015-03-02T12:18:01.055-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:18:01.509-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:18:01.515-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:18:01.524-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 461ms 2015-03-02T12:18:02.316-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60780 #2 (2 connections now open) 2015-03-02T12:18:02.638-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9255.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25276 nscannedObjects:25276 nMatched:12638 nModified:12638 keyUpdates:1 writeConflicts:0 numYields:202 locks:{} 1109ms 2015-03-02T12:18:02.638-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9255.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1109ms 2015-03-02T12:18:02.641-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:18:02.723-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:18:02.728-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:18:04.009-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8991.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:26332 nscannedObjects:26332 nMatched:13166 nModified:13166 keyUpdates:1 writeConflicts:0 numYields:213 locks:{} 1273ms 2015-03-02T12:18:04.009-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8991.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1274ms 2015-03-02T12:18:04.010-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:18:04.113-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:18:04.117-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:18:04.122-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 111ms 2015-03-02T12:18:04.783-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 9351.0 } } ndeleted:13166 keyUpdates:0 writeConflicts:0 numYields:104 locks:{} 658ms 2015-03-02T12:18:04.784-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9351.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 659ms 2015-03-02T12:18:04.790-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:18:04.923-0500 W STORAG2015-03-02T12:19:02.156-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:19:02.166-0500 I CONTROL [initandlisten] MongoDB starting : pid=2506 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:19:02.167-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:19:02.167-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:19:02.208-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:19:02.268-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:19:04.404-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60807 #1 (1 connection now open) 2015-03-02T12:19:05.162-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60808 #2 (2 connections now open) 2015-03-02T12:19:05.181-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:19:05.690-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37300 records 383327152 bytes) is inconsistent with full validation results (38299 records 393589879 bytes). Updating size storer with new values. 2015-03-02T12:19:05.690-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:19:05.695-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:19:05.698-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 516ms 2015-03-02T12:19:05.703-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:19:05.767-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:19:05.771-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:19:06.650-0500 I NETWORK [conn2] end connection 10.4.127.218:60808 (1 connection now open) 2015-03-02T12:19:06.655-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60811 #3 (2 connections now open) 2015-03-02T12:19:06.670-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:06.819-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (39300 records 403873152 bytes) is inconsistent with full validation results (40299 records 414135879 bytes). Updating size storer with new values. 2015-03-02T12:19:06.820-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:06.824-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:06.827-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 156ms 2015-03-02T12:19:06.831-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:06.915-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:06.921-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:07.035-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60812 #4 (3 connections now open) 2015-03-02T12:19:07.060-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:07.257-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 193ms 2015-03-02T12:19:07.289-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (41299 records 424426013 bytes) are inconsistent with full validation results (40299 records 414149243 bytes). Updating counters with new values. 2015-03-02T12:19:07.289-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (41230 records 423717176 bytes) is inconsistent with full validation results (40299 records 414149243 bytes). Updating size storer with new values. 2015-03-02T12:19:07.289-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:07.301-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:07.308-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 247ms 2015-03-02T12:19:07.329-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:07.520-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (40299 records 414149243 bytes) are inconsistent with full validation results (41299 records 424426013 bytes). Updating counters with new values. 2015-03-02T12:19:07.520-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (40299 records 414149243 bytes) is inconsistent with full validation results (41299 records 424426013 bytes). Updating size storer with new values. 2015-03-02T12:19:07.521-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:07.530-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:07.535-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 206ms 2015-03-02T12:19:08.602-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8973.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21120 nscannedObjects:21120 nMatched:10551 nModified:10551 keyUpdates:1 writeConflicts:31 numYields:179 locks:{} 1666ms 2015-03-02T12:19:08.605-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8973.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1669ms 2015-03-02T12:19:08.609-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:08.755-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 7982.0 } } ndeleted:10551 keyUpdates:0 writeConflicts:27 numYields:115 locks:{} 1212ms 2015-03-02T12:19:08.755-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7982.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1212ms 2015-03-02T12:19:08.757-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:08.778-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (26452 records 271741396 bytes) are inconsistent with full validation results (28364 records 291402369 bytes). Updating counters with new values. 2015-03-02T12:19:08.778-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26375 records 270950375 bytes) is inconsistent with full validation results (28364 records 291402369 bytes). Updating size storer with new values. 2015-03-02T12:19:08.785-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:08.795-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:08.804-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 194ms 2015-03-02T12:19:08.819-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:08.841-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:19:08.925-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (29027 records 298213368 bytes) are inconsistent with full validation results (26266 records 269830618 bytes). Updating counters with new values. 2015-03-02T12:19:08.925-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (28364 records 291402369 bytes) is inconsistent with full validation results (26266 records 269830618 bytes). Updating size storer with new values. 2015-03-02T12:19:08.925-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:08.930-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:08.938-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 180ms 2015-03-02T12:19:08.941-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:08.951-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (26266 records 269830618 bytes) are inconsistent with full validation results (26923 records 276579979 bytes). Updating counters with new values. 2015-03-02T12:19:08.952-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26266 records 269830618 bytes) is inconsistent with full validation results (26923 records 276579979 bytes). Updating size storer with new values. 2015-03-02T12:19:08.957-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:08.963-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:08.965-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 146ms 2015-03-02T12:19:09.041-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25692 records 263933916 bytes) are inconsistent with full validation results (27115 records 278552395 bytes). Updating counters with new values. 2015-03-02T12:19:09.041-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26663 records 273908999 bytes) is inconsistent with full validation results (27115 records 278552395 bytes). Updating size storer with new values. 2015-03-02T12:19:09.041-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:09.052-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:09.054-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 112ms 2015-03-02T12:19:09.069-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:09.159-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (24827 records 255047771 bytes) are inconsistent with full validation results (25276 records 259660348 bytes). Updating counters with new values. 2015-03-02T12:19:09.159-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25086 records 257708478 bytes) is inconsistent with full validation results (25276 records 259660348 bytes). Updating size storer with new values. 2015-03-02T12:19:09.159-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:09.168-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:09.179-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:09.273-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (23439 records 240788847 bytes) are inconsistent with full validation results (23180 records 238128140 bytes). Updating counters with new values. 2015-03-02T12:19:09.273-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (23535 records 241775055 bytes) is inconsistent with full validation results (23180 records 238128140 bytes). Updating size storer with new values. 2015-03-02T12:19:09.273-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:09.288-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:09.289-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 109ms 2015-03-02T12:19:09.377-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:09.492-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (20275 records 208294071 bytes) are inconsistent with full validation results (20352 records 209085092 bytes). Updating counters with new values. 2015-03-02T12:19:09.492-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (20968 records 215413260 bytes) is inconsistent with full validation results (20352 records 209085092 bytes). Updating size storer with new values. 2015-03-02T12:19:09.492-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:09.500-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:09.508-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 130ms 2015-03-02T12:19:09.742-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 2650.0 } } ndeleted:13301 keyUpdates:0 writeConflicts:0 numYields:105 locks:{} 771ms 2015-03-02T12:19:09.742-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2650.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 771ms 2015-03-02T12:19:09.748-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:09.829-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (15312 records 157300176 bytes) are inconsistent with full validation results (13814 records 141911222 bytes). Updating counters with new values. 2015-03-02T12:19:09.829-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (16045 records 164839281 bytes) is inconsistent with full validation results (13814 records 141911222 bytes). Updating size storer with new values. 2015-03-02T12:19:09.829-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:09.839-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:09.851-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 102ms 2015-03-02T12:19:09.857-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:09.930-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:09.936-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:10.419-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:19:11.388-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 318ms 2015-03-02T12:19:11.437-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 215ms 2015-03-02T12:19:11.723-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:19:13.242-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T12:19:14.503-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T12:19:15.048-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:19:15.437-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:19:15.651-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:19:16.136-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:19:16.142-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:16.555-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (28081 records 288476113 bytes) is inconsistent with full validation results (28814 records 296006222 bytes). Updating size storer with new values. 2015-03-02T12:19:16.555-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:16.561-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:16.564-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 421ms 2015-03-02T12:19:16.572-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:16.674-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29814 records 306279222 bytes) are inconsistent with full validation results (28820 records 296067860 bytes). Updating counters with new values. 2015-03-02T12:19:16.674-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29081 records 298749113 bytes) is inconsistent with full validation results (28820 records 296067860 bytes). Updating size storer with new values. 2015-03-02T12:19:16.674-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:16.684-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:16.689-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 116ms 2015-03-02T12:19:17.048-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5251.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:10996 nscannedObjects:10996 nMatched:5498 nModified:5498 keyUpdates:1 writeConflicts:0 numYields:86 locks:{} 349ms 2015-03-02T12:19:17.048-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5251.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 349ms 2015-03-02T12:19:17.050-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:17.165-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29805 records 306258239 bytes) are inconsistent with full validation results (29814 records 306350696 bytes). Updating counters with new values. 2015-03-02T12:19:17.165-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29589 records 304039271 bytes) is inconsistent with full validation results (29814 records 306350696 bytes). Updating size storer with new values. 2015-03-02T12:19:17.165-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:17.169-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:17.173-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 123ms 2015-03-02T12:19:17.182-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:17.332-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29829 records 306504791 bytes) are inconsistent with full validation results (30814 records 316623696 bytes). Updating counters with new values. 2015-03-02T12:19:17.332-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29814 records 306350696 bytes) is inconsistent with full validation results (30814 records 316623696 bytes). Updating size storer with new values. 2015-03-02T12:19:17.332-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:17.346-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:17.348-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 166ms 2015-03-02T12:19:17.359-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:17.522-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:17.535-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:17.543-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 183ms 2015-03-02T12:19:17.555-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:17.940-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:17.964-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:17.987-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 432ms 2015-03-02T12:19:18.002-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:18.206-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31103 records 319582320 bytes) are inconsistent with full validation results (30814 records 316623696 bytes). Updating counters with new values. 2015-03-02T12:19:18.206-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:18.217-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:18.222-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 219ms 2015-03-02T12:19:18.231-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:19:18.336-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31525 records 323938072 bytes) are inconsistent with full validation results (31586 records 324554452 bytes). Updating counters with new values. 2015-03-02T12:19:18.336-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (31294 records 321565009 bytes) is inconsistent with full validation results (31586 records 324554452 bytes). Updating size storer with new values. 2015-03-02T12:19:18.336-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:19:18.348-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:19:18.363-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 131ms 2015-03-02T12:19:19.113-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:19:19.576-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:19:19.718-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:19:20.359-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:19:20.364-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:19:20.386-0500 I NETWORK [conn1] end connection 10.4.127.218:60807 (2 connections now open) 2015-03-02T12:19:20.413-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60816 #5 (3 connections now open) 2015-03-02T12:19:20.522-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (37056 records 380747762 bytes) are inconsistent with full validation results (36814 records 378261696 bytes). Updating counters with new values. 2015-03-02T12:19:20.522-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (36355 records 373546389 bytes) is inconsistent with full validation results (36814 records 378261696 bytes). Updating size storer with new values. 2015-03-02T12:19:20.522-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:19:20.526-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:19:20.530-0500 I COMMAND [conn5] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 104ms 2015-03-02T12:19:20.537-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 173ms 2015-03-02T12:19:20.539-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:19:20.570-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 199ms 2015-03-02T12:19:20.679-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (37344 records 383706386 bytes) are inconsistent with full validation results (37414 records 384425496 bytes). Updating counters with new values. 2015-03-02T12:19:20.679-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (37113 records 381333323 bytes) is inconsistent with full validation results (37414 records 384425496 bytes). Updating size storer with new values. 2015-03-02T12:19:20.680-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:19:20.698-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:19:20.707-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 167ms 2015-03-02T12:19:21.661-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:19:22.577-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:19:22.581-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:22.930-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (42414 records 435790496 bytes) are inconsistent with full validation results (42336 records 434989202 bytes). Updating counters with new values. 2015-03-02T12:19:22.930-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (42183 records 433417433 bytes) is inconsistent with full validation results (42336 records 434989202 bytes). Updating size storer with new values. 2015-03-02T12:19:22.930-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:22.949-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:22.967-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 386ms 2015-03-02T12:19:22.980-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:23.257-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (42336 records 434989202 bytes) are inconsistent with full validation results (42814 records 439899696 bytes). Updating counters with new values. 2015-03-02T12:19:23.257-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (42336 records 434989202 bytes) is inconsistent with full validation results (42814 records 439899696 bytes). Updating size storer with new values. 2015-03-02T12:19:23.257-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:23.279-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:23.291-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 310ms 2015-03-02T12:19:23.874-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 241ms 2015-03-02T12:19:23.896-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T12:19:25.364-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 176ms 2015-03-02T12:19:25.580-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 195ms 2015-03-02T12:19:25.874-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 4699.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31806 nscannedObjects:31806 nMatched:15903 nModified:15903 keyUpdates:1 writeConflicts:0 numYields:274 locks:{} 2578ms 2015-03-02T12:19:25.874-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4699.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2578ms 2015-03-02T12:19:25.878-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:26.224-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:26.245-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:26.271-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 392ms 2015-03-02T12:19:26.290-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:26.489-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:26.509-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:26.519-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 228ms 2015-03-02T12:19:26.540-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:26.853-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 194ms 2015-03-02T12:19:26.862-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (48567 records 499135530 bytes) are inconsistent with full validation results (46814 records 481126961 bytes). Updating counters with new values. 2015-03-02T12:19:26.862-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47680 records 490023379 bytes) is inconsistent with full validation results (46814 records 481126961 bytes). Updating size storer with new values. 2015-03-02T12:19:26.865-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:26.881-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:26.884-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:19:26.894-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 354ms 2015-03-02T12:19:26.910-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:27.010-0500 I NETWORK [conn4] end connection 10.4.127.218:60812 (2 connections now open) 2015-03-02T12:19:27.077-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60821 #6 (3 connections now open) 2015-03-02T12:19:27.394-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47061 records 483664392 bytes) are inconsistent with full validation results (48814 records 501672961 bytes). Updating counters with new values. 2015-03-02T12:19:27.394-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (46927 records 482287810 bytes) is inconsistent with full validation results (48814 records 501672961 bytes). Updating size storer with new values. 2015-03-02T12:19:27.394-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:27.408-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:27.413-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 330ms 2015-03-02T12:19:27.413-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 502ms 2015-03-02T12:19:27.432-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:19:27.693-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (48814 records 501695516 bytes) are inconsistent with full validation results (48814 records 501673520 bytes). Updating counters with new values. 2015-03-02T12:19:27.693-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (48814 records 501684219 bytes) is inconsistent with full validation results (48814 records 501673520 bytes). Updating size storer with new values. 2015-03-02T12:19:27.693-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:19:27.714-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:19:27.726-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 294ms 2015-03-02T12:19:28.661-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T12:19:29.055-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 179ms 2015-03-02T12:19:30.002-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:19:30.370-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:19:31.368-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2019.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:57634 nscannedObjects:57634 nMatched:28817 nModified:28817 keyUpdates:1 writeConflicts:0 numYields:478 locks:{} 3952ms 2015-03-02T12:19:31.368-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2019.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3953ms 2015-03-02T12:19:31.371-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:31.385-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:19:32.135-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 306ms 2015-03-02T12:19:32.635-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (54814 records 563456847 bytes) are inconsistent with full validation results (53673 records 551757350 bytes). Updating counters with new values. 2015-03-02T12:19:32.635-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (53863 records 553687224 bytes) is inconsistent with full validation results (53673 records 551757350 bytes). Updating size storer with new values. 2015-03-02T12:19:32.640-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:32.687-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:32.691-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 1319ms 2015-03-02T12:19:32.715-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:19:33.197-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (54069 records 555825458 bytes) are inconsistent with full validation results (54814 records 563478843 bytes). Updating counters with new values. 2015-03-02T12:19:33.197-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (53722 records 552260727 bytes) is inconsistent with full validation results (54814 records 563478843 bytes). Updating size storer with new values. 2015-03-02T12:19:33.198-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:19:33.210-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:19:33.217-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 501ms 2015-03-02T12:19:33.430-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:19:34.692-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:19:35.873-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:19:36.527-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (63418 records 651867735 bytes) are inconsistent with full validation results (63814 records 655935843 bytes). Updating counters with new values. 2015-03-02T12:19:36.527-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (62467 records 642098112 bytes) is inconsistent with full validation results (63814 records 655935843 bytes). Updating size storer with new values. 2015-03-02T12:19:36.528-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:19:36.535-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:19:36.540-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 667ms 2015-03-02T12:19:36.654-0500 I NETWORK [conn3] end connection 10.4.127.218:60811 (2 connections now open) 2015-03-02T12:19:36.677-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60828 #7 (3 connections now open) 2015-03-02T12:19:36.689-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:19:36.985-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:19:37.427-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (64814 records 666208843 bytes) are inconsistent with full validation results (63814 records 655935843 bytes). Updating counters with new values. 2015-03-02T12:19:37.427-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (63863 records 656439220 bytes) is inconsistent with full validation results (63814 records 655935843 bytes). Updating size storer with new values. 2015-03-02T12:19:37.427-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:19:37.445-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:19:37.455-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 765ms 2015-03-02T12:19:38.001-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:19:38.648-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 214ms 2015-03-02T12:19:39.330-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T12:19:39.335-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:19:40.071-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 253ms 2015-03-02T12:19:40.305-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:19:40.330-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:19:40.355-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 1020ms 2015-03-02T12:19:40.396-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:20:12.959-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:20:12.967-0500 I CONTROL [initandlisten] MongoDB starting : pid=2620 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:20:12.967-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:20:12.967-0500 I CONTROL [initandlisten] 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:20:12.968-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:20:12.968-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:20:13.003-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:20:13.067-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:20:15.489-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60842 #1 (1 connection now open) 2015-03-02T12:20:15.502-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:20:15.870-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:20:15.875-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:20:15.878-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 375ms 2015-03-02T12:20:16.742-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60843 #2 (2 connections now open) 2015-03-02T12:20:17.339-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7341.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32932 nscannedObjects:32932 nMatched:16466 nModified:16466 keyUpdates:1 writeConflicts:0 numYields:262 locks:{} 1456ms 2015-03-02T12:20:17.339-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7341.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1457ms 2015-03-02T12:20:17.343-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:20:17.462-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (26632 records 273746605 bytes) are inconsistent with full validation results (28865 records 296715243 bytes). Updating counters with new values. 2015-03-02T12:20:17.462-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26764 records 275104357 bytes) is inconsistent with full validation results (28865 records 296715243 bytes). Updating size storer with new values. 2015-03-02T12:20:17.462-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:20:17.473-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:20:17.480-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 136ms 2015-03-02T12:20:18.358-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2702.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:19253 nscannedObjects:19253 nMatched:9530 nModified:9530 keyUpdates:1 writeConflicts:390 numYields:151 locks:{} 876ms 2015-03-02T12:20:18.358-0500 I COMMAND [conn1] command test.$cmd command: update { upda2015-03-02T12:21:19.298-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:21:19.304-0500 I CONTROL [initandlisten] MongoDB starting : pid=2515 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:21:19.305-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:21:19.305-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:21:19.345-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:21:19.391-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:21:20.387-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60865 #1 (1 connection now open) 2015-03-02T12:21:20.409-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:21:20.867-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:21:20.872-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:21:20.875-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 465ms 2015-03-02T12:21:20.882-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:21:20.945-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:21:20.948-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:21:21.643-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60867 #2 (2 connections now open) 2015-03-02T12:21:22.035-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60868 #3 (3 connections now open) 2015-03-02T12:21:23.099-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4595.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50904 nscannedObjects:50904 nMatched:22650 nModified:22650 keyUpdates:1 writeConflicts:49 numYields:408 locks:{} 2144ms 2015-03-02T12:21:23.099-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4595.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2144ms 2015-03-02T12:21:23.103-0500 I COMMAND [conn1] CMD: validate test.foo 2015-032015-03-02T12:22:25.831-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] MongoDB starting : pid=2675 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:22:25.842-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:22:25.842-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:22:25.882-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:22:25.944-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:22:27.169-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60897 #1 (1 connection now open) 2015-03-02T12:22:27.184-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:22:27.554-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:22:27.560-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:22:27.562-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 377ms 2015-03-02T12:22:27.570-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:22:27.635-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:22:27.640-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:22:30.538-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60901 #2 (2 connections now open) 2015-03-02T12:22:31.023-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:22:31.791-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60904 #3 (3 connections now open) 2015-03-02T12:22:32.619-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 216ms 2015-03-02T12:22:32.815-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4972.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44378 nscannedObjects:44378 nMatched:21519 nModified:21519 keyUpdates:1 writeConflicts:17 numYields:354 locks:{} 2267ms 2015-03-02T12:22:32.815-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4972.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2267ms 2015-03-02T12:22:32.818-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:22:33.221-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:22:33.231-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:22:33.254-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 436ms 2015-03-02T12:22:34.247-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:22:35.491-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9376.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:48652 nscannedObjects:48652 nMatched:21519 nModified:21519 keyUpdates:1 writeConflicts:201 numYields:408 locks:{} 3668ms 2015-03-02T12:22:35.491-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9376.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3669ms 2015-03-02T12:22:35.497-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:22:35.636-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:22:35.956-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (45299 records 465626134 bytes) are inconsistent with full validation results (44299 records 455353134 bytes). Updating counters with new values. 2015-03-02T12:22:35.956-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (45299 records 465626134 bytes) is inconsistent with full validation results (44299 records 455353134 bytes). Updating size storer with new values. 2015-03-02T12:22:35.956-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:22:35.970-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:22:35.997-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 499ms 2015-03-02T12:22:36.032-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:22:36.310-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (44299 records 455353134 bytes) are inconsistent with full validation results (45299 records 465626134 bytes). Updating counters with new values. 2015-03-02T12:22:36.310-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (44299 records 455353134 bytes) is inconsistent with full validation results (45299 records 465626134 bytes). Updating size storer with new values. 2015-03-02T12:22:36.310-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:22:36.334-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:22:36.342-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 310ms 2015-03-02T12:22:36.370-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:22:36.601-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:22:36.620-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:22:36.632-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 261ms 2015-03-02T12:22:36.635-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7961.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:43038 nscannedObjects:43038 nMatched:21519 nModified:21519 keyUpdates:1 writeConflicts:182 numYields:363 locks:{} 3378ms 2015-03-02T12:22:36.635-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7961.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3378ms 2015-03-02T12:22:36.641-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:22:36.811-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60911 #4 (4 connections now open) 2015-03-02T12:22:36.908-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (45299 records 465642462 bytes) are inconsistent with full validation results (45299 records 465626719 bytes). Updating counters with new values. 2015-03-02T12:22:36.908-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (45299 records 465631906 bytes) is inconsistent with full validation results (45299 records 465626719 bytes). Updating size storer with new values. 2015-03-02T12:22:36.908-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:22:36.914-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:22:36.921-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 279ms 2015-03-02T12:22:36.953-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:22:37.311-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42504 records 436939788 bytes) are inconsistent with full validation results (44860 records 461135917 bytes). Updating counters with new values. 2015-03-02T12:22:37.317-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42870 records 440696469 bytes) is inconsistent with full validation results (44860 records 461135917 bytes). Updating size storer with new values. 2015-03-02T12:22:37.317-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:22:37.326-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:22:37.340-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 386ms 2015-03-02T12:22:37.371-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:22:37.672-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 249ms 2015-03-02T12:22:37.788-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42910 records 441132167 bytes) are inconsistent with full validation results (41806 records 429789579 bytes). Updating counters with new values. 2015-03-02T12:22:37.788-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (43401 records 446170659 bytes) is inconsistent with full validation results (41806 records 429789579 bytes). Updating size storer with new values. 2015-03-02T12:22:37.788-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:22:37.810-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:22:37.827-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 456ms 2015-03-02T12:22:39.405-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:22:39.408-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:22:39.718-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23425 records 240857316 bytes) are inconsistent with full validation results (24537 records 252336184 bytes). Updating counters with new values. 2015-03-02T12:22:39.718-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23814 records 244858570 bytes) is inconsistent with full validation results (24537 records 252336184 bytes). Updating size storer with new values. 2015-03-02T12:22:39.718-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:22:39.736-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:22:39.740-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 332ms 2015-03-02T12:22:41.102-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3314.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:43411 nscannedObjects:43411 nMatched:19184 nModified:19184 keyUpdates:1 writeConflicts:10101 numYields:386 locks:{} 4464ms 2015-03-02T12:22:41.102-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3314.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4464ms 2015-03-02T12:22:41.105-0500 I NETWORK [conn3] end connection 10.4.127.218:60904 (3 connections now open) 2015-03-02T12:22:41.675-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 437.0 } } ndeleted:21371 keyUpdates:0 writeConflicts:15 numYields:369 locks:{} 4751ms 2015-03-02T12:22:41.675-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 437.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 4751ms 2015-03-02T12:22:41.679-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:41.760-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (6525 records 67061992 bytes) are inconsistent with full validation results (4059 records 41698107 bytes). Updating counters with new values. 2015-03-02T12:22:41.760-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (7511 records 77193748 bytes) is inconsistent with full validation results (4059 records 41698107 bytes). Updating size storer with new values. 2015-03-02T12:22:41.760-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:41.773-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:41.827-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:41.857-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (4059 records 41698289 bytes) is inconsistent with full validation results (4059 records 41703567 bytes). Updating size storer with new values. 2015-03-02T12:22:41.857-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:41.858-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:41.924-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:41.940-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (4345 records 44641645 bytes) are inconsistent with full validation results (4193 records 43080149 bytes). Updating counters with new values. 2015-03-02T12:22:41.940-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (4233 records 43491069 bytes) is inconsistent with full validation results (4193 records 43080149 bytes). Updating size storer with new values. 2015-03-02T12:22:41.941-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:41.943-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:41.954-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:41.969-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (4618 records 47446174 bytes) are inconsistent with full validation results (4631 records 47579723 bytes). Updating counters with new values. 2015-03-02T12:22:41.969-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (4193 records 43080149 bytes) is inconsistent with full validation results (4631 records 47579723 bytes). Updating size storer with new values. 2015-03-02T12:22:41.969-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:41.972-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:42.002-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:42.018-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (4500 records 46228500 bytes) are inconsistent with full validation results (4639 records 47656447 bytes). Updating counters with new values. 2015-03-02T12:22:42.018-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (4742 records 48717738 bytes) is inconsistent with full validation results (4639 records 47656447 bytes). Updating size storer with new values. 2015-03-02T12:22:42.019-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:42.020-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:42.037-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:42.064-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (4639 records 47656447 bytes) is inconsistent with full validation results (4640 records 47656493 bytes). Updating size storer with new values. 2015-03-02T12:22:42.064-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:42.065-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:42.073-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:42.091-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:42.092-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:44.048-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:22:44.051-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:22:46.180-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:22:47.387-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:22:48.921-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T12:22:49.385-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:22:50.310-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:22:50.539-0500 I NETWORK [conn2] end connection 10.4.127.218:60901 (2 connections now open) 2015-03-02T12:22:50.564-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60916 #5 (3 connections now open) 2015-03-02T12:22:50.608-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (25393 records 260852062 bytes) is inconsistent with full validation results (25640 records 263389493 bytes). Updating size storer with new values. 2015-03-02T12:22:50.609-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:22:50.612-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:22:50.614-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 304ms 2015-03-02T12:22:50.620-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:22:50.666-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:22:50.669-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:22:50.675-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:22:50.772-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:22:50.782-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:22:50.789-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 114ms 2015-03-02T12:22:50.795-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:22:50.936-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (26362 records 270806599 bytes) are inconsistent with full validation results (25640 records 263389493 bytes). Updating counters with new values. 2015-03-02T12:22:50.936-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:22:50.946-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:22:50.955-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 160ms 2015-03-02T12:22:50.964-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:22:50.967-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:50.969-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:22:51.091-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (25918 records 266245387 bytes) are inconsistent with full validation results (26640 records 273662493 bytes). Updating counters with new values. 2015-03-02T12:22:51.091-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (25671 records 263707956 bytes) is inconsistent with full validation results (26640 records 273662493 bytes). Updating size storer with new values. 2015-03-02T12:22:51.091-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:22:51.093-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:51.098-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:22:51.100-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:51.103-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 133ms 2015-03-02T12:22:51.102-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 135ms 2015-03-02T12:22:51.111-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:22:51.120-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:51.254-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:22:51.261-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:22:51.268-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 157ms 2015-03-02T12:22:51.271-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:51.275-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:51.282-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 161ms 2015-03-02T12:22:51.285-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:22:51.296-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:51.410-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:22:51.417-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:22:51.423-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:51.428-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 143ms 2015-03-02T12:22:51.436-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:51.442-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 145ms 2015-03-02T12:22:51.477-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:51.539-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25887 records 265926924 bytes) is inconsistent with full validation results (25805 records 265094765 bytes). Updating size storer with new values. 2015-03-02T12:22:51.539-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:51.556-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:51.576-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:22:51.649-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:22:51.653-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:22:53.599-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:22:53.735-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:22:54.521-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:22:55.299-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:22:55.555-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:22:56.483-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:22:56.825-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:22:57.138-0500 I NETWORK [conn1] end connection 10.4.127.218:60897 (2 connections now open) 2015-03-02T12:22:57.182-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60917 #6 (3 connections now open) 2015-03-02T12:22:57.193-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:22:57.726-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (40805 records 419189765 bytes) are inconsistent with full validation results (39805 records 408916765 bytes). Updating counters with new values. 2015-03-02T12:22:57.726-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (40723 records 418347379 bytes) is inconsistent with full validation results (39805 records 408916765 bytes). Updating size storer with new values. 2015-03-02T12:22:57.726-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:22:57.732-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:22:57.741-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 547ms 2015-03-02T12:22:59.407-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 1119.0 } } ndeleted:32765 keyUpdates:0 writeConflicts:0 numYields:260 locks:{} 1653ms 2015-03-02T12:22:59.407-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1119.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1653ms 2015-03-02T12:22:59.410-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:22:59.516-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (9040 records 92867920 bytes) are inconsistent with full validation results (10040 records 103140920 bytes). Updating counters with new values. 2015-03-02T12:22:59.516-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (9887 records 101569151 bytes) is inconsistent with full validation results (10040 records 103140920 bytes). Updating size storer with new values. 2015-03-02T12:22:59.516-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:22:59.525-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:22:59.535-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 125ms 2015-03-02T12:22:59.541-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:22:59.561-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (10040 records 103140920 bytes) is inconsistent with full validation results (10041 records 103140966 bytes). Updating size storer with new values. 2015-03-02T12:22:59.561-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:22:59.563-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:22:59.573-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:22:59.609-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:22:59.611-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:23:00.280-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:23:01.470-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:23:01.637-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:23:02.007-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:23:02.451-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:23:02.652-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16192 records 166330189 bytes) is inconsistent with full validation results (17041 records 175051966 bytes). Updating size storer with new values. 2015-03-02T12:23:02.652-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:23:02.654-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:23:02.657-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 206ms 2015-03-02T12:23:02.929-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7941.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4119 nscannedObjects:4119 nMatched:2060 nModified:2060 keyUpdates:1 writeConflicts:0 numYields:35 locks:{} 267ms 2015-03-02T12:23:02.929-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7941.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 267ms 2015-03-02T12:23:02.931-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:23:03.053-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17041 2015-03-02T12:23:34.959-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] MongoDB starting : pid=2601 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:23:34.968-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:23:34.969-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:23:35.020-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:23:35.075-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:23:35.559-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60929 #1 (1 connection now open) 2015-03-02T12:23:35.577-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:23:36.350-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:23:36.355-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:23:36.358-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 780ms 2015-03-02T12:23:36.813-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60930 #2 (2 connections now open) 2015-03-02T12:23:36.823-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:23:36.904-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:23:36.908-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:23:36.924-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:23:37.003-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:23:37.013-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:23:37.033-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:23:37.126-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:23:37.132-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:23:37.135-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 101ms 2015-03-02T12:23:37.186-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60933 #3 (3 connections now open) 2015-03-02T12:23:37.541-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 174ms 2015-03-02T12:23:38.456-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 1798.0 } } ndeleted:16 keyUpdates:0 writeConflicts:49 numYields:107 locks:{} 1315ms 2015-03-02T12:23:38.456-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1798.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1315ms 2015-03-02T12:23:38.459-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:23:38.462-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 4927.0 } } ndeleted:0 keyUpdates:0 writeConflicts:56 numYields:96 locks:{} 1257ms 2015-03-02T12:23:38.462-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4927.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1257ms 2015-03-02T12:23:38.470-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:38.560-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (10298 records 105792008 bytes) is inconsistent with full validation results (9460 records 97182580 bytes). Updating size storer with new values. 2015-03-02T12:23:38.560-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:38.568-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:23:38.571-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:38.571-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 101ms 2015-03-02T12:23:38.575-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:23:38.576-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 116ms 2015-03-02T12:23:40.250-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:23:41.894-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:23:42.841-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:23:44.111-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:23:45.865-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:23:47.045-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:23:47.136-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:23:47.729-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (30622 records 314579806 bytes) is inconsistent with full validation results (31460 records 323188580 bytes). Updating size storer with new values. 2015-03-02T12:23:47.729-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:23:47.739-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:23:47.748-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 612ms 2015-03-02T12:23:49.255-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:23:49.886-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:23:50.355-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:50.533-0500 I NETWORK [conn1] end connection 10.4.127.218:60929 (2 connections now open) 2015-03-02T12:23:50.560-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37622 records 386490806 bytes) is inconsistent with full validation results (38460 records 395099580 bytes). Updating size storer with new values. 2015-03-02T12:23:50.560-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:50.565-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:50.570-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 214ms 2015-03-02T12:23:50.574-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60940 #4 (3 connections now open) 2015-03-02T12:23:51.782-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:23:52.587-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 547.0 } } ndeleted:33990 keyUpdates:0 writeConflicts:0 numYields:272 locks:{} 2015ms 2015-03-02T12:23:52.587-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 547.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2015ms 2015-03-02T12:23:52.589-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.664-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6298 records 64699354 bytes) is inconsistent with full validation results (5470 records 56193310 bytes). Updating size storer with new values. 2015-03-02T12:23:52.664-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.675-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:52.684-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.696-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.697-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:52.706-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.726-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.727-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:52.733-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.744-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.745-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:52.749-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.760-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.760-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:52.952-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 369.0 } } ndeleted:2370 keyUpdates:0 writeConflicts:0 numYields:18 locks:{} 186ms 2015-03-02T12:23:52.952-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 369.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 186ms 2015-03-02T12:23:52.954-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.966-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4298 records 44153354 bytes) is inconsistent with full validation results (4100 records 42119300 bytes). Updating size storer with new values. 2015-03-02T12:23:52.966-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.968-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:52.972-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.981-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.982-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:52.985-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:23:52.995-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:23:52.995-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:23:53.365-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:23:53.387-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (4902 records 50358246 bytes) is inconsistent with full validation results (5100 records 52392300 bytes). Updating size storer with new values. 2015-03-02T12:23:53.398-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:23:53.398-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:23:54.371-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:23:55.606-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:23:55.657-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:23:55.677-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:23:57.190-0500 I NETWORK [conn3] end connection 10.4.127.218:60933 (2 connections now open) 2015-03-02T12:23:57.248-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60943 #5 (3 connections now open) 2015-03-02T12:23:57.296-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:23:57.674-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 5758.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2000 nscannedObjects:2000 nMatched:1000 nModified:1000 keyUpdates:1 writeConflicts:0 numYields:27 locks:{} 414ms 2015-03-02T12:23:57.678-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5758.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 418ms 2015-03-02T12:23:57.687-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:23:58.113-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (15100 records 155132726 bytes) is inconsistent with full validation results (15100 records 155135300 bytes). Updating size storer with new values. 2015-03-02T12:23:58.116-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:23:58.118-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:23:58.123-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 435ms 2015-03-02T12:23:58.126-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:23:58.157-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:23:58.159-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:23:58.247-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:23:58.279-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (14298 records 146885928 bytes) is inconsistent with full validation results (14100 records 144849300 bytes). Updating size storer with new values. 2015-03-02T12:23:58.279-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:23:58.293-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:23:58.305-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:23:58.377-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:23:58.383-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:23:58.390-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:23:58.444-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:23:58.450-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:23:58.485-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:23:58.552-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (14100 records 144849300 bytes) is inconsistent with full validation results (14100 records 144851003 bytes). Updating size storer with new values. 2015-03-02T12:23:58.552-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:23:58.557-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:24:00.100-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:24:00.841-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 179ms 2015-03-02T12:24:01.695-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T12:24:02.720-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:24:03.024-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (24771 records 254474186 bytes) is inconsistent with full validation results (25100 records 257854003 bytes). Updating size storer with new values. 2015-03-02T12:24:03.024-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:24:03.032-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:24:03.034-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 314ms 2015-03-02T12:24:03.049-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:24:03.121-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:24:03.125-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:24:04.195-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:24:05.752-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:24:06.820-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60949 #6 (4 connections now open) 2015-03-02T12:24:06.825-0500 I NETWORK [conn2] end connection 10.4.127.218:60930 (3 connections now open) 2015-03-02T12:24:06.835-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:07.217-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (34100 records 350311003 bytes) are inconsistent with full validation results (33100 records 340038003 bytes). Updating counters with new values. 2015-03-02T12:24:07.217-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (33771 records 346931186 bytes) is inconsistent with full validation results (33100 records 340038003 bytes). Updating size storer with new values. 2015-03-02T12:24:07.217-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:07.222-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:07.225-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 390ms 2015-03-02T12:24:07.230-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:07.324-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (33100 records 340038003 bytes) are inconsistent with full validation results (34100 records 350311003 bytes). Updating counters with new values. 2015-03-02T12:24:07.324-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (33100 records 340038003 bytes) is inconsistent with full validation results (34100 records 350311003 bytes). Updating size storer with new values. 2015-03-02T12:24:07.324-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:07.329-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:07.332-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 101ms 2015-03-02T12:24:07.337-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:07.414-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:07.421-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:07.433-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:07.578-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (35100 records 360584003 bytes) are inconsistent with full validation results (34100 records 350311003 bytes). Updating counters with new values. 2015-03-02T12:24:07.578-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (34771 records 357204186 bytes) is inconsistent with full validation results (34100 records 350311003 bytes). Updating size storer with new values. 2015-03-02T12:24:07.578-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:07.582-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:07.586-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 153ms 2015-03-02T12:24:07.603-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:07.714-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (34100 records 350311003 bytes) are inconsistent with full validation results (35100 records 360584003 bytes). Updating counters with new values. 2015-03-02T12:24:07.714-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (34100 records 350311003 bytes) is inconsistent with full validation results (35100 records 360584003 bytes). Updating size storer with new values. 2015-03-02T12:24:07.714-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:07.719-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:07.724-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 121ms 2015-03-02T12:24:07.728-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:07.879-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:07.891-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:07.901-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 172ms 2015-03-02T12:24:07.910-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:08.038-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:08.043-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:08.046-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 136ms 2015-03-02T12:24:08.051-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:08.167-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:08.172-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:08.176-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 124ms 2015-03-02T12:24:08.183-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:24:08.321-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:24:08.333-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:24:08.340-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11679 locks:{} 157ms 2015-03-02T12:24:09.210-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:24:09.947-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:24:12.337-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:24:45.715-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:24:45.728-0500 I CONTROL [initandlisten] MongoDB starting : pid=2665 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:24:45.728-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:24:45.728-0500 I CONTROL [initandlisten] 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:24:45.729-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:24:45.729-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:24:45.791-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:24:45.846-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:24:46.728-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60969 #1 (1 connection now open) 2015-03-02T12:24:50.498-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:60970 #2 (2 connections now open) 2015-03-02T12:24:51.438-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T12:24:51.690-0500 I WRITE [conn2] remove test.foo2015-03-02T12:25:50.146-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:25:50.165-0500 I CONTROL [initandlisten] MongoDB starting : pid=2572 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:25:50.165-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:25:50.165-0500 I CONTROL [initandlisten] 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:25:50.166-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:25:50.166-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:25:50.200-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:25:50.260-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:25:50.405-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61001 #1 (1 connection now open) 2015-03-02T12:25:50.590-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61002 #2 (2 connections now open) 2015-03-02T12:25:52.208-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61003 #3 (3 connections now open) 2015-03-02T12:25:54.216-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 6561.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:46755 nscannedObjects:46755 nMatched:18026 nModified:18026 keyUpdates:1 writeConflicts:156 numYields:405 locks:{} 3798ms 2015-03-02T12:25:54.216-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6561.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3798ms 2015-03-02T12:25:54.220-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:54.407-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9859.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:38168 nscannedObjects:38168 nMatched:18026 nModified:18026 keyUpdates:1 writeConflicts:168 numYields:345 locks:{} 3796ms 2015-03-02T12:25:54.407-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9859.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3796ms 2015-03-02T12:25:54.415-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:25:54.929-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:25:54.930-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:54.943-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:25:54.947-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:54.973-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 752ms 2015-03-02T12:25:54.979-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 564ms 2015-03-02T12:25:56.165-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 4569.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:45456 nscannedObjects:45456 nMatched:22728 nModified:22728 keyUpdates:1 writeConflicts:2 numYields:401 locks:{} 3937ms 2015-03-02T12:25:56.166-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4569.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3939ms 2015-03-02T12:25:56.170-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:25:56.379-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (17854 records 183550438 bytes) are inconsistent with full validation results (20863 records 214501012 bytes). Updating counters with new values. 2015-03-02T12:25:56.379-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (18078 records 185854502 bytes) is inconsistent with full validation results (20863 records 214501012 bytes). Updating size storer with new values. 2015-03-02T12:25:56.379-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:25:56.402-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:25:56.415-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 245ms 2015-03-02T12:25:56.428-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:25:56.533-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (18781 records 193085560 bytes) are inconsistent with full validation results (17388 records 178757162 bytes). Updating counters with new values. 2015-03-02T12:25:56.533-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (19087 records 196233076 bytes) is inconsistent with full validation results (17388 records 178757162 bytes). Updating size storer with new values. 2015-03-02T12:25:56.533-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:25:56.544-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:25:56.545-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 117ms 2015-03-02T12:25:57.153-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 4426.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3565 nscannedObjects:3565 nMatched:234 nModified:234 keyUpdates:1 writeConflicts:6164 numYields:33 locks:{} 601ms 2015-03-02T12:25:57.153-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4426.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 601ms 2015-03-02T12:25:57.161-0500 I NETWORK [conn3] end connection 10.4.127.218:61003 (2 connections now open) 2015-03-02T12:25:57.166-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 2241.0 } } ndeleted:429 keyUpdates:0 writeConflicts:122 numYields:110 locks:{} 2183ms 2015-03-02T12:25:57.166-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2241.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2183ms 2015-03-02T12:25:57.171-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:25:57.173-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1098.0 } } ndeleted:0 keyUpdates:0 writeConflicts:127 numYields:109 locks:{} 2183ms 2015-03-02T12:25:57.173-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1098.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2184ms 2015-03-02T12:25:57.177-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:57.226-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61004 #4 (3 connections now open) 2015-03-02T12:25:57.227-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (8198 records 84239062 bytes) are inconsistent with full validation results (6582 records 67616886 bytes). Updating counters with new values. 2015-03-02T12:25:57.227-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (8928 records 91737602 bytes) is inconsistent with full validation results (6582 records 67616886 bytes). Updating size storer with new values. 2015-03-02T12:25:57.227-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:25:57.230-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:57.235-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:57.237-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:25:57.243-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:25:57.245-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:57.249-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:25:57.287-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6582 records 67616886 bytes) is inconsistent with full validation results (6583 records 67616932 bytes). Updating size storer with new values. 2015-03-02T12:25:57.287-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:57.289-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:57.290-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:25:57.293-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (6583 records 67616932 bytes) are inconsistent with full validation results (6582 records 67616886 bytes). Updating counters with new values. 2015-03-02T12:25:57.293-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (6583 records 67616932 bytes) is inconsistent with full validation results (6582 records 67616886 bytes). Updating size storer with new values. 2015-03-02T12:25:57.293-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:25:57.295-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:25:57.297-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:25:57.300-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:57.305-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:25:57.315-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:25:57.336-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (6582 records 67616886 bytes) are inconsistent with full validation results (6583 records 67616932 bytes). Updating counters with new values. 2015-03-02T12:25:57.336-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6582 records 67616886 bytes) is inconsistent with full validation results (6583 records 67616932 bytes). Updating size storer with new values. 2015-03-02T12:25:57.336-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:57.338-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (6583 records 67616932 bytes) are inconsistent with full validation results (6582 records 67616886 bytes). Updating counters with new values. 2015-03-02T12:25:57.338-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (6583 records 67616932 bytes) is inconsistent with full validation results (6582 records 67616886 bytes). Updating size storer with new values. 2015-03-02T12:25:57.339-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:25:57.341-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:57.342-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:25:57.344-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (6582 records 67616886 bytes) are inconsistent with full validation results (6583 records 67616932 bytes). Updating counters with new values. 2015-03-02T12:25:57.344-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (6582 records 67616886 bytes) is inconsistent with full validation results (6583 records 67616932 bytes). Updating size storer with new values. 2015-03-02T12:25:57.345-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:25:57.346-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:25:57.349-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:25:57.350-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:57.380-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:57.386-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:57.389-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:25:57.392-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:25:57.393-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:57.416-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:57.418-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:57.976-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 56.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12493 nscannedObjects:12493 nMatched:6247 nModified:6247 keyUpdates:1 writeConflicts:0 numYields:99 locks:{} 555ms 2015-03-02T12:25:57.976-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 56.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 555ms 2015-03-02T12:25:57.979-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:57.995-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6583 records 67685377 bytes) is inconsistent with full validation results (6583 records 67698130 bytes). Updating size storer with new values. 2015-03-02T12:25:57.995-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:57.996-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:58.002-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:25:58.018-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:25:58.019-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:25:59.315-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:26:00.660-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:26:01.032-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:26:02.177-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 213ms 2015-03-02T12:26:02.257-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T12:26:02.621-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:26:04.028-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:26:04.041-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:26:04.432-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:26:05.669-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:26:06.787-0500 I NETWORK [conn1] end connection 10.4.127.218:61001 (2 connections now open) 2015-03-02T12:26:06.836-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61006 #5 (3 connections now open) 2015-03-02T12:26:06.860-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:26:07.262-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (27583 records 283431130 bytes) are inconsistent with full validation results (26865 records 276055116 bytes). Updating counters with new values. 2015-03-02T12:26:07.268-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26601 records 273343044 bytes) is inconsistent with full validation results (26865 records 276055116 bytes). Updating size storer with new values. 2015-03-02T12:26:07.268-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:26:07.282-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:26:07.289-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 428ms 2015-03-02T12:26:07.304-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:26:07.423-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:26:07.437-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (27865 records 286328116 bytes) are inconsistent with full validation results (27588 records 283482495 bytes). Updating counters with new values. 2015-03-02T12:26:07.437-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26883 records 276240030 bytes) is inconsistent with full validation results (27588 records 283482495 bytes). Updating size storer with new values. 2015-03-02T12:26:07.437-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:26:07.442-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:26:07.447-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 143ms 2015-03-02T12:26:08.150-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 8670.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13153 nscannedObjects:13153 nMatched:6577 nModified:6577 keyUpdates:1 writeConflicts:0 numYields:106 locks:{} 695ms 2015-03-02T12:26:08.150-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8670.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 695ms 2015-03-02T12:26:08.153-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:26:08.302-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (28422 records 292054467 bytes) are inconsistent with full validation results (28583 records 293708420 bytes). Updating counters with new values. 2015-03-02T12:26:08.302-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (28029 records 288017178 bytes) is inconsistent with full validation results (28583 records 293708420 bytes). Updating size storer with new values. 2015-03-02T12:26:08.302-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:26:08.311-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:26:08.315-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:26:08.323-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 170ms 2015-03-02T12:26:09.445-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:26:10.192-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:26:10.355-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (32749 records 336505738 bytes) are inconsistent with full validation results (33583 records 345073420 bytes). Updating counters with new values. 2015-03-02T12:26:10.356-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (32190 records 330763131 bytes) is inconsistent with full validation results (33583 records 345073420 bytes). Updating size storer with new values. 2015-03-02T12:26:10.356-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:26:10.366-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:26:10.371-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 179ms 2015-03-02T12:26:10.764-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:26:11.066-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9883.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13387 nscannedObjects:13387 nMatched:6694 nModified:6694 keyUpdates:1 writeConflicts:0 numYields:107 locks:{} 693ms 2015-03-02T12:26:11.066-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9883.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 693ms 2015-03-02T12:26:11.070-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:26:11.233-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:26:11.241-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:26:11.246-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 175ms 2015-03-02T12:26:12.153-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:26:12.507-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:26:12.635-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6459.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:27739 nscannedObjects:27739 nMatched:13870 nModified:13870 keyUpdates:1 writeConflicts:0 numYields:224 locks:{} 1386ms 2015-03-02T12:26:12.635-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6459.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1386ms 2015-03-02T12:26:12.640-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:26:12.828-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:26:12.841-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:26:12.848-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 208ms 2015-03-02T12:26:13.504-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:26:14.587-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:26:14.590-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:26:14.948-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (39583 records 406984199 bytes) are inconsistent with full validation results (39583 records 406957510 bytes). Updating counters with new values. 2015-03-02T12:26:14.948-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (39583 records 406973630 bytes) is inconsistent with full validation results (39583 records 406957510 bytes). Updating size storer with new values. 2015-03-02T12:26:14.951-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:26:14.963-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:26:14.985-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 395ms 2015-03-02T12:26:15.668-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 382ms 2015-03-02T12:26:17.398-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 275ms 2015-03-02T12:26:17.488-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 281ms 2015-03-02T12:26:17.783-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1461.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:66805 nscannedObjects:66805 nMatched:33403 nModified:33403 keyUpdates:1 writeConflicts:0 numYields:583 locks:{} 4933ms 2015-03-02T12:26:17.788-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1461.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4938ms 2015-03-02T12:26:17.790-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:26:18.321-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42583 records 437852469 bytes) are inconsistent with full validation results (42583 records 437879158 bytes). Updating counters with new values. 2015-03-02T12:26:18.321-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42583 records 437852469 bytes) is inconsistent with full validation results (42583 records 437879158 bytes). Updating size storer with new values. 2015-03-02T12:26:18.321-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:26:18.331-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:26:18.348-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 558ms 2015-03-02T12:26:18.363-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:26:18.594-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:26:18.603-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:26:18.606-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 242ms 2015-03-02T12:26:19.020-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:26:19.220-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:26:20.372-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:26:20.610-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61012 #6 (4 connections now open) 2015-03-02T12:26:20.649-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:26:20.927-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 211ms 2015-03-02T12:26:21.413-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (46583 records 478971158 bytes) are inconsistent with full validation results (45583 records 468698158 bytes). Updating counters with new values. 2015-03-02T12:26:21.413-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (46583 records 478971158 bytes) is inconsistent with full validation results (45583 records 468698158 bytes). Updating size storer with new values. 2015-03-02T12:26:21.413-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:26:21.439-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:26:21.450-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 800ms 2015-03-02T12:26:21.897-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 241ms 2015-03-02T12:26:23.781-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 290ms 2015-03-02T12:26:24.650-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 237ms 2015-03-02T12:26:24.654-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:26:25.011-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7444.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:69965 nscannedObjects:69965 nMatched:33403 nModified:33403 keyUpdates:1 writeConflicts:0 numYields:632 locks:{} 6398ms 2015-03-02T12:26:25.011-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7444.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6398ms 2015-03-02T12:26:25.014-0500 I NETWORK [conn2] end connection 10.4.127.218:61002 (3 connections now open) 2015-03-02T12:26:25.556-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (48583 records 499550308 bytes) are inconsistent with full validation results (49583 records 509823308 bytes). Updating counters with new values. 2015-03-02T12:26:25.556-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (48583 records 499550308 bytes) is inconsistent with full validation results (49583 records 509823308 bytes). Updating size storer with new values. 2015-03-02T12:26:25.556-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:26:25.586-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:26:25.640-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 986ms 2015-03-02T12:26:25.664-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:26:26.341-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:26:26.384-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:26:26.401-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 737ms 2015-03-02T12:26:26.646-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 184ms 2015-03-02T12:26:27.287-0500 I NETWORK [conn4] end connection 10.4.127.218:61004 (2 connections now open) 2015-03-02T12:26:27.298-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61013 #7 (3 connections now open) 2015-03-02T12:26:59.637-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:26:59.647-0500 I CONTROL [initandlisten] MongoDB starting : pid=2672 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:26:59.647-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:26:59.647-0500 I CONTROL [initandlisten] 2015-03-02T12:26:59.648-0500 I CONTROL [initandlisten] 2015-03-02T12:26:59.648-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:26:59.648-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:26:59.650-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:26:59.650-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:26:59.702-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:26:59.750-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:27:00.483-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61026 #1 (1 connection now open) 2015-03-02T12:27:00.522-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:27:01.291-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:27:01.301-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:27:01.307-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 784ms 2015-03-02T12:27:01.329-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:27:01.442-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:27:01.446-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:27:01.449-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 119ms 2015-03-02T12:27:01.722-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61027 #2 (2 connections now open) 2015-03-02T12:27:01.732-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:27:01.798-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:27:01.803-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:27:04.690-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T12:27:05.672-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:27:06.717-0500 I NETWORK [conn2] end connection 10.4.127.218:61027 (1 connection now open) 2015-03-02T12:27:06.732-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61028 #3 (2 connections now open) 2015-03-02T12:27:07.171-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61029 #4 (3 connections now open) 2015-03-02T12:27:07.211-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:27:07.700-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (44299 records 455272001 bytes) are inconsistent with full validation results (44299 records 455260925 bytes). Updating counters with new values. 2015-03-02T12:27:07.700-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (44299 records 455272001 bytes) is inconsistent with full validation results (44299 records 455260925 bytes). Updating size storer with new values. 2015-03-02T12:27:07.700-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:27:07.716-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:27:07.725-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 513ms 2015-03-02T12:27:08.570-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:27:09.527-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7935.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:30556 nscannedObjects:30556 nMatched:15278 nModified:15278 keyUpdates:1 writeConflicts:0 numYields:274 locks:{} 2787ms 2015-03-02T12:27:09.527-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7935.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2787ms 2015-03-02T12:27:09.532-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:27:09.798-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (45299 records 465533925 bytes) are inconsistent with full validation results (45299 records 465545001 bytes). Updating counters with new values. 2015-03-02T12:27:09.798-0500 W 2015-03-02T12:28:02.649-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] MongoDB starting : pid=2481 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:28:02.667-0500 I CONTROL [initandlisten] 2015-03-02T12:28:02.668-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:28:02.668-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:28:02.668-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:28:02.668-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:28:02.668-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:28:02.669-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:28:02.741-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:28:02.796-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:28:04.205-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61045 #1 (1 connection now open) 2015-03-02T12:28:05.846-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3312.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:51622 nscannedObjects:51622 nMatched:25811 nModified:25811 keyUpdates:1 writeConflicts:0 numYields:403 locks:{} 1634ms 2015-03-02T12:28:05.846-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3312.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1634ms 2015-03-02T12:28:05.850-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:06.060-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:06.065-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:06.073-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 223ms 2015-03-02T12:28:06.082-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:06.153-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:06.156-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:06.917-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61047 #2 (2 connections now open) 2015-03-02T12:28:06.947-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:07.106-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:07.114-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:07.120-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 173ms 2015-03-02T12:28:07.136-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:07.302-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:07.313-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:07.316-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 179ms 2015-03-02T12:28:07.327-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61048 #3 (3 connections now open) 2015-03-02T12:28:07.354-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:28:07.620-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (34651 records 356260602 bytes) are inconsistent with full validation results (36968 records 380093264 bytes). Updating counters with new values. 2015-03-02T12:28:07.620-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (34777 records 357556638 bytes) is inconsistent with full validation results (36968 records 380093264 bytes). Updating size storer with new values. 2015-03-02T12:28:07.620-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:28:07.635-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:28:07.639-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 285ms 2015-03-02T12:28:07.664-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:28:07.903-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (33933 records 348875254 bytes) are inconsistent with full validation results (34310 records 352753076 bytes). Updating counters with new values. 2015-03-02T12:28:07.903-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (34284 records 352485640 bytes) is inconsistent with full validation results (34310 records 352753076 bytes). Updating size storer with new values. 2015-03-02T12:28:07.904-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:28:07.917-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:28:07.928-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 264ms 2015-03-02T12:28:08.372-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3912.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:48523 nscannedObjects:48523 nMatched:24416 nModified:24416 keyUpdates:1 writeConflicts:26 numYields:385 locks:{} 2210ms 2015-03-02T12:28:08.372-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3912.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2211ms 2015-03-02T12:28:08.373-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:08.484-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (25663 records 263810034 bytes) are inconsistent with full validation results (25097 records 257988158 bytes). Updating counters with new values. 2015-03-02T12:28:08.485-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26219 records 269529050 bytes) is inconsistent with full validation results (25097 records 257988158 bytes). Updating size storer with new values. 2015-03-02T12:28:08.485-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:08.497-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:08.501-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 128ms 2015-03-02T12:28:08.523-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:08.668-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22801 records 234371502 bytes) are inconsistent with full validation results (22330 records 229526796 bytes). Updating counters with new values. 2015-03-02T12:28:08.668-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23653 records 243135174 bytes) is inconsistent with full validation results (22330 records 229526796 bytes). Updating size storer with new values. 2015-03-02T12:28:08.668-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:08.674-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:08.678-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 155ms 2015-03-02T12:28:09.005-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 4356.0 } } ndeleted:22994 keyUpdates:0 writeConflicts:29 numYields:194 locks:{} 1682ms 2015-03-02T12:28:09.006-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4356.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1683ms 2015-03-02T12:28:09.009-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:09.062-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (13145 records 135060126 bytes) are inconsistent with full validation results (11488 records 118016224 bytes). Updating counters with new values. 2015-03-02T12:28:09.062-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13182 records 135430468 bytes) is inconsistent with full validation results (11488 records 118016224 bytes). Updating size storer with new values. 2015-03-02T12:28:09.062-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:09.068-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:09.079-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:09.119-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:09.122-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:09.126-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:09.147-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:09.148-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:09.153-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:09.176-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:09.178-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:09.809-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:28:11.768-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:28:13.954-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:28:14.057-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:28:16.867-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:17.012-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:28:17.309-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (32488 records 333749224 bytes) are inconsistent with full validation results (31488 records 323476224 bytes). Updating counters with new values. 2015-03-02T12:28:17.309-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32451 records 333369123 bytes) is inconsistent with full validation results (31488 records 323476224 bytes). Updating size storer with new values. 2015-03-02T12:28:17.309-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:17.316-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:17.320-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 452ms 2015-03-02T12:28:17.324-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:17.470-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31488 records 323476224 bytes) are inconsistent with full validation results (32488 records 333749224 bytes). Updating counters with new values. 2015-03-02T12:28:17.470-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (31488 records 323476224 bytes) is inconsistent with full validation results (32488 records 333749224 bytes). Updating size storer with new values. 2015-03-02T12:28:17.470-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:17.483-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:17.492-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 167ms 2015-03-02T12:28:18.220-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2373.0 } } ndeleted:15759 keyUpdates:0 writeConflicts:0 numYields:124 locks:{} 718ms 2015-03-02T12:28:18.220-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2373.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 718ms 2015-03-02T12:28:18.228-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:18.347-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:28:18.358-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17729 records 182130017 bytes) are inconsistent with full validation results (16729 records 171857017 bytes). Updating counters with new values. 2015-03-02T12:28:18.358-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16933 records 173952709 bytes) is inconsistent with full validation results (16729 records 171857017 bytes). Updating size storer with new values. 2015-03-02T12:28:18.358-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:18.370-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:18.388-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 159ms 2015-03-02T12:28:18.405-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:18.469-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16729 records 171857017 bytes) are inconsistent with full validation results (17729 records 182130017 bytes). Updating counters with new values. 2015-03-02T12:28:18.470-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16729 records 171857017 bytes) is inconsistent with full validation results (17729 records 182130017 bytes). Updating size storer with new values. 2015-03-02T12:28:18.470-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:18.473-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:18.571-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:18.655-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17265 records 177363345 bytes) are inconsistent with full validation results (16320 records 167655360 bytes). Updating counters with new values. 2015-03-02T12:28:18.655-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17113 records 175801849 bytes) is inconsistent with full validation results (16320 records 167655360 bytes). Updating size storer with new values. 2015-03-02T12:28:18.655-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:18.660-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:18.826-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2573.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2000 nscannedObjects:2000 nMatched:1000 nModified:1000 keyUpdates:1 writeConflicts:0 numYields:17 locks:{} 160ms 2015-03-02T12:28:18.826-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2573.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 161ms 2015-03-02T12:28:18.828-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:28:18.882-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16374 records 168223102 bytes) are inconsistent with full validation results (17319 records 177931087 bytes). Updating counters with new values. 2015-03-02T12:28:18.882-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16374 records 168220424 bytes) is inconsistent with full validation results (17319 records 177931087 bytes). Updating size storer with new values. 2015-03-02T12:28:18.883-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:28:18.890-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:28:19.994-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:28:19.998-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:28:20.143-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20113 records 206633849 bytes) is inconsistent with full validation results (20319 records 208750087 bytes). Updating size storer with new values. 2015-03-02T12:28:20.143-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:28:20.149-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:28:20.151-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 152ms 2015-03-02T12:28:20.160-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:28:20.264-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:28:20.271-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:28:20.274-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 114ms 2015-03-02T12:28:20.283-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:28:20.371-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:28:20.373-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:28:20.652-0500 I NETWORK [conn1] end connection 10.4.127.218:61045 (2 connections now open) 2015-03-02T12:28:20.691-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61052 #4 (3 connections now open) 2015-03-02T12:28:20.703-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:28:20.756-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21113 records 216906849 bytes) is inconsistent with full validation results (21319 records 219023087 bytes). Updating size storer with new values. 2015-03-02T12:28:20.756-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:28:20.759-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:28:20.866-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:28:20.931-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:28:20.935-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:28:21.112-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8587.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4000 nscannedObjects:4000 nMatched:2000 nModified:2000 keyUpdates:1 writeConflicts:0 numYields:32 locks:{} 170ms 2015-03-02T12:28:21.112-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8587.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 170ms 2015-03-02T12:28:21.120-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:28:21.206-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:28:21.209-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:28:27.327-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61053 #5 (4 connections now open) 2015-03-02T12:28:27.344-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:28:27.556-0500 I NETWORK [conn3] end connection 10.4.127.218:61048 (3 connections now open) 2015-03-02T12:28:27.676-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (35554 records 365272242 bytes) are inconsistent with full validation results (35319 records 362858087 bytes). Updating counters with new values. 2015-03-02T12:28:27.676-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (34612 records 355595076 bytes) is inconsistent with full validation results (35319 records 362858087 bytes). Updating size storer with new values. 2015-03-02T12:28:27.679-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:28:27.689-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:28:27.696-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 351ms 2015-03-02T12:28:27.708-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:28:27.742-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:27.897-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (36084 records 370716932 bytes) are inconsistent with full validation results (35941 records 369247893 bytes). Updating counters with new values. 2015-03-02T12:28:27.897-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35377 records 363453921 bytes) is inconsistent with full validation results (35941 records 369247893 bytes). Updating size storer with new values. 2015-03-02T12:28:27.897-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:28:27.910-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:28:27.917-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (35941 records 369247893 bytes) are inconsistent with full validation results (36319 records 373131087 bytes). Updating counters with new values. 2015-03-02T12:28:27.921-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (35941 records 369247893 bytes) is inconsistent with full validation results (36319 records 373131087 bytes). Updating size storer with new values. 2015-03-02T12:28:27.921-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:27.925-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 216ms 2015-03-02T12:28:27.937-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:27.941-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 199ms 2015-03-02T12:28:27.945-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:28.042-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:28.058-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:28.071-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 125ms 2015-03-02T12:28:29.146-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:28:29.713-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1737.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:35118 nscannedObjects:35118 nMatched:17559 nModified:17559 keyUpdates:1 writeConflicts:0 numYields:282 locks:{} 1631ms 2015-03-02T12:28:29.713-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1737.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1631ms 2015-03-02T12:28:29.715-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:29.873-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:29.879-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:29.901-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 185ms 2015-03-02T12:28:30.958-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 5177.0 } } ndeleted:17559 keyUpdates:0 writeConflicts:0 numYields:139 locks:{} 1051ms 2015-03-02T12:28:30.958-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5177.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1051ms 2015-03-02T12:28:30.967-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:28:31.079-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (21585 records 221753430 bytes) is inconsistent with full validation results (20760 records 213267480 bytes). Updating size storer with new values. 2015-03-02T12:28:31.079-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:28:31.102-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:28:31.114-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 146ms 2015-03-02T12:28:31.191-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:28:36.695-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:28:36.911-0500 I NETWORK [conn2] end connection 10.4.127.218:61047 (2 connections now open) 2015-03-02T12:28:36.938-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61054 #6 (3 connections now open) 2015-03-02T12:28:37.067-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (33935 records 348614255 bytes) is inconsistent with full validation results (34760 records 357089480 bytes). Updating size storer with new values. 2015-03-02T12:28:37.067-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:28:37.072-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:28:37.077-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 130ms 2015-03-02T12:28:37.077-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 382ms 2015-03-02T12:28:37.903-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:28:39.006-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T12:28:39.274-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:28:40.393-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:28:40.568-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:28:40.739-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (42760 records 439273480 bytes) are inconsistent with full validation results (41760 records 429000480 bytes). Updating counters with new values. 2015-03-02T12:28:40.739-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (41935 records 430798255 bytes) is inconsistent with full validation results (41760 records 429000480 bytes). Updating size storer with new values. 2015-03-02T12:28:40.740-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:28:40.750-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:28:40.768-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 375ms 2015-03-02T12:28:40.780-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:28:40.939-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (42536 records 436972328 bytes) are inconsistent with full validation results (42760 records 439273480 bytes). Updating counters with new values. 2015-03-02T12:28:40.939-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (41935 records 430798255 bytes) is inconsistent with full validation results (42760 records 439273480 bytes). Updating size storer with new values. 2015-03-02T12:28:40.939-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:28:40.954-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:28:40.955-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:28:40.960-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 180ms 2015-03-02T12:29:13.609-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:29:13.620-0500 I CONTROL [initandlisten] MongoDB starting : pid=2599 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:29:13.620-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:29:13.620-0500 I CONTROL [initandlisten] 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:29:13.621-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:29:13.621-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:29:13.672-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:29:13.718-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:29:15.714-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61064 #1 (1 connection now open) 2015-03-02T12:29:15.728-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:29:16.128-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:29:16.133-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:29:16.136-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 407ms 2015-03-02T12:29:16.954-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61066 #2 (2 connections now open) 2015-03-02T12:29:16.993-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:17.055-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9312.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25144 nscannedObjects:25144 nMatched:12572 nModified:12572 keyUpdates:1 writeConflicts:0 numYields:197 locks:{} 913ms 2015-03-02T12:29:17.055-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9312.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 914ms 2015-03-02T12:29:17.059-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:29:17.182-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:17.189-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:17.197-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 204ms 2015-03-02T12:29:17.211-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:17.234-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:29:17.242-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:29:17.244-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 184ms 2015-03-02T12:29:17.327-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:17.334-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:17.338-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 127ms 2015-03-02T12:29:17.345-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:17.472-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:17.479-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:17.485-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 140ms 2015-03-02T12:29:18.067-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 6624.0 } } ndeleted:17900 keyUpdates:0 writeConflicts:0 numYields:139 locks:{} 575ms 2015-03-02T12:29:18.067-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6624.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 575ms 2015-03-02T12:29:18.073-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:18.174-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19870 records 204120393 bytes) is inconsistent with full validation results (19399 records 199285927 bytes). Updating size storer with new values. 2015-03-02T12:29:18.174-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:18.178-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:18.182-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 108ms 2015-03-02T12:29:18.651-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3110.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16630 nscannedObjects:16630 nMatched:8315 nModified:8315 keyUpdates:1 writeConflicts:0 numYields:130 locks:{} 465ms 2015-03-02T12:29:18.651-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3110.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 466ms 2015-03-02T12:29:18.658-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:18.716-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19399 records 199383804 bytes) is inconsistent with full validation results (19399 records 199394022 bytes). Updating size storer with new values. 2015-03-02T12:29:18.720-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:18.722-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:19.327-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3491.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16630 nscannedObjects:16630 nMatched:8315 nModified:8315 keyUpdates:1 writeConflicts:0 numYields:130 locks:{} 596ms 2015-03-02T12:29:19.327-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3491.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 596ms 2015-03-02T12:29:19.330-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:19.374-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:19.376-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:20.671-0500 I NETWORK [conn1] end connection 10.4.127.218:61064 (1 connection now open) 2015-03-02T12:29:20.707-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61067 #3 (2 connections now open) 2015-03-02T12:29:20.968-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 5693.0 } } ndeleted:8315 keyUpdates:0 writeConflicts:0 numYields:64 locks:{} 253ms 2015-03-02T12:29:20.968-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5693.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 254ms 2015-03-02T12:29:20.972-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:29:21.032-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (14500 records 148963908 bytes) is inconsistent with full validation results (14084 records 144684932 bytes). Updating size storer with new values. 2015-03-02T12:29:21.032-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:29:21.036-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:29:22.372-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61068 #4 (3 connections now open) 2015-03-02T12:29:27.306-0500 I NETWORK [conn4] end connection 10.4.127.218:61068 (2 connections now open) 2015-03-02T12:29:27.352-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61069 #5 (3 connections now open) 2015-03-02T12:29:27.361-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:27.556-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (25668 records 263687364 bytes) is inconsistent with full validation results (26084 records 267960932 bytes). Updating size storer with new values. 2015-03-02T12:29:27.556-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:27.559-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:27.562-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 200ms 2015-03-02T12:29:27.573-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:27.638-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26084 records 267960932 bytes) is inconsistent with full validation results (26085 records 267960978 bytes). Updating size storer with new values. 2015-03-02T12:29:27.638-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:27.642-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:27.648-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:27.734-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:27.738-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:28.902-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:29:30.215-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:29:30.237-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:29:31.691-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:29:32.943-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:33.419-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (39085 records 401509978 bytes) are inconsistent with full validation results (38085 records 391236978 bytes). Updating counters with new values. 2015-03-02T12:29:33.419-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (38668 records 397226137 bytes) is inconsistent with full validation results (38085 records 391236978 bytes). Updating size storer with new values. 2015-03-02T12:29:33.419-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:33.420-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:29:33.430-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:33.437-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 494ms 2015-03-02T12:29:33.447-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:33.598-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (38085 records 391236978 bytes) are inconsistent with full validation results (39085 records 401509978 bytes). Updating counters with new values. 2015-03-02T12:29:33.598-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (38085 records 391236978 bytes) is inconsistent with full validation results (39085 records 401509978 bytes). Updating size storer with new values. 2015-03-02T12:29:33.598-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:33.613-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:33.622-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 174ms 2015-03-02T12:29:33.627-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:33.830-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:33.836-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:33.841-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 214ms 2015-03-02T12:29:33.844-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:34.010-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:34.019-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:34.028-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 184ms 2015-03-02T12:29:34.039-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:29:34.219-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:29:34.233-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:29:34.239-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 199ms 2015-03-02T12:29:35.880-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:29:35.886-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:29:36.010-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:29:36.205-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (44085 records 452874978 bytes) are inconsistent with full validation results (43085 records 442601978 bytes). Updating counters with new values. 2015-03-02T12:29:36.205-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (43668 records 448591137 bytes) is inconsistent with full validation results (43085 records 442601978 bytes). Updating size storer with new values. 2015-03-02T12:29:36.205-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:29:36.219-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:29:36.225-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 338ms 2015-03-02T12:29:36.570-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:29:36.959-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61079 #6 (4 connections now open) 2015-03-02T12:29:37.177-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T12:29:37.181-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 9291.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2838 nscannedObjects:2838 nMatched:1419 nModified:1419 keyUpdates:1 writeConflicts:0 numYields:23 locks:{} 204ms 2015-03-02T12:29:37.181-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9291.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 204ms 2015-03-02T12:29:37.186-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:29:37.240-0500 I NETWORK [conn2] end connection 10.4.127.218:61066 (3 connections now open) 2015-03-02T12:29:37.323-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 5675.0 } } ndeleted:2419 keyUpdates:0 writeConflicts:1 numYields:97 locks:{} 1092ms 2015-03-02T12:29:37.323-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5675.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1092ms 2015-03-02T12:29:37.328-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:29:37.538-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (33109 records 340128757 bytes) are inconsistent with full validation results (35412 records 363794175 bytes). Updating counters with new values. 2015-03-02T12:29:37.538-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (33921 records 348470749 bytes) is inconsistent with full validation results (35412 records 363794175 bytes). Updating size storer with new values. 2015-03-02T12:29:37.538-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:29:37.579-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:29:37.582-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (35412 records 363794175 bytes) are inconsistent with full validation results (34109 records 350401757 bytes). Updating counters with new values. 2015-03-02T12:29:37.582-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (35412 records 363794175 bytes) is inconsistent with full validation results (34109 records 350401757 bytes). Updating size storer with new values. 2015-03-02T12:29:37.582-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:29:37.595-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:29:37.596-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 410ms 2015-03-02T12:29:37.608-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 280ms 2015-03-02T12:29:37.619-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:29:37.627-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:29:37.804-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:29:37.810-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:29:37.817-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:29:37.822-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:29:37.824-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 205ms 2015-03-02T12:29:37.829-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 201ms 2015-03-02T12:29:38.755-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T12:29:38.758-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:38.955-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (35109 records 360804393 bytes) are inconsistent with full validation results (35109 records 360787818 bytes). Updating counters with new values. 2015-03-02T12:29:38.957-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35109 records 360794201 bytes) is inconsistent with full validation results (35109 records 360787818 bytes). Updating size storer with new values. 2015-03-02T12:29:38.957-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:38.965-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:38.985-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 226ms 2015-03-02T12:29:39.235-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 191ms 2015-03-02T12:29:41.202-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 211ms 2015-03-02T12:29:42.626-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 402.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:67933 nscannedObjects:67933 nMatched:30285 nModified:30285 keyUpdates:1 writeConflicts:0 numYields:564 locks:{} 4798ms 2015-03-02T12:29:42.626-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 402.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4798ms 2015-03-02T12:29:42.629-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:29:42.945-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 198ms 2015-03-02T12:29:43.200-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (38109 records 391870341 bytes) are inconsistent with full validation results (37109 records 381614462 bytes). Updating counters with new values. 2015-03-02T12:29:43.200-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (38109 records 391870341 bytes) is inconsistent with full validation results (37109 records 381614462 bytes). Updating size storer with new values. 2015-03-02T12:29:43.200-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:29:43.210-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:29:43.241-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 611ms 2015-03-02T12:29:43.773-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4419.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:60570 nscannedObjects:60570 nMatched:30285 nModified:30285 keyUpdates:1 writeConflicts:0 numYields:508 locks:{} 4784ms 2015-03-02T12:29:43.777-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4419.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4788ms 2015-03-02T12:29:43.779-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:43.984-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (37109 records 381614462 bytes) are inconsistent with full validation results (38109 records 391887462 bytes). Updating counters with new values. 2015-03-02T12:29:43.984-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (37109 records 381614462 bytes) is inconsistent with full validation results (38109 records 391887462 bytes). Updating size storer with new values. 2015-03-02T12:29:43.984-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:43.995-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:44.001-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 222ms 2015-03-02T12:29:44.501-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:29:45.126-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:29:45.581-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:29:46.882-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 253ms 2015-03-02T12:29:47.314-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 176ms 2015-03-02T12:29:47.878-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 2835.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:60900 nscannedObjects:60900 nMatched:30450 nModified:30450 keyUpdates:1 writeConflicts:0 numYields:506 locks:{} 3875ms 2015-03-02T12:29:47.878-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2835.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3875ms 2015-03-02T12:29:47.882-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:48.232-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:48.248-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:48.273-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 390ms 2015-03-02T12:29:48.285-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:48.444-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:29:48.535-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (44109 records 453527607 bytes) are inconsistent with full validation results (43109 records 443254607 bytes). Updating counters with new values. 2015-03-02T12:29:48.535-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (43277 records 444980471 bytes) is inconsistent with full validation results (43109 records 443254607 bytes). Updating size storer with new values. 2015-03-02T12:29:48.535-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:48.555-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:48.565-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 280ms 2015-03-02T12:29:48.593-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:48.804-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (43109 records 443254607 bytes) are inconsistent with full validation results (44109 records 453527607 bytes). Updating counters with new values. 2015-03-02T12:29:48.806-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (43109 records 443254607 bytes) is inconsistent with full validation results (44109 records 453527607 bytes). Updating size storer with new values. 2015-03-02T12:29:48.806-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:48.827-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:48.838-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 245ms 2015-03-02T12:29:48.852-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:29:49.095-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:29:49.103-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:29:49.112-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11691 locks:{} 260ms 2015-03-02T12:29:49.516-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:29:49.521-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 185ms 2015-03-02T12:29:50.708-0500 I NETWORK [conn3] end connection 10.4.127.218:61067 (2 connections now open) 2015-03-02T12:29:50.736-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61088 #7 (3 connections now open) 2015-03-02T12:29:51.268-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T12:29:53.373-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T12:29:53.376-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:29:53.805-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 8225.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:64270 nscannedObjects:64270 nMatched:30450 nModified:30450 keyUpdates:1 writeConflicts:0 numYields:534 locks:{} 4691ms 2015-03-02T12:29:53.805-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8225.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4691ms 2015-03-02T12:30:24.204-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:30:24.215-0500 I CONTROL [initandlisten] MongoDB starting : pid=2473 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:30:24.215-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:30:24.215-0500 I CONTROL [initandlisten] 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:30:24.217-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:30:24.218-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:30:24.218-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:30:24.218-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:30:24.266-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:30:24.319-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:30:25.821-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61101 #1 (1 connection now open) 2015-03-02T12:30:25.829-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:30:26.200-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:30:26.205-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:30:26.208-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 378ms 2015-03-02T12:30:26.216-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:30:26.278-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:30:26.282-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:30:27.251-0500 I NETWORK [conn1] end connection 10.4.127.218:61101 (0 connections now open) 2015-03-02T12:30:27.267-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61102 #2 (1 connection now open) 2015-03-02T12:30:27.278-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:27.343-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37300 records 383327152 bytes) is inconsistent with full validation results (38299 records 393589879 bytes). Updating size storer with new values. 2015-03-02T12:30:27.343-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:27.348-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:27.360-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:27.433-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:27.437-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:29.112-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2812.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53622 nscannedObjects:53622 nMatched:26811 nModified:26811 keyUpdates:1 writeConflicts:0 numYields:418 locks:{} 1668ms 2015-03-02T12:30:29.112-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2812.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1668ms 2015-03-02T12:30:29.115-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:29.185-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:29.189-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:29.204-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:29.283-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:29.287-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:29.297-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:29.367-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:29.371-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:29.380-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:29.448-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:29.452-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:30.088-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 9510.0 } } ndeleted:26811 keyUpdates:0 writeConflicts:0 numYields:209 locks:{} 632ms 2015-03-02T12:30:30.089-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9510.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 632ms 2015-03-02T12:30:30.090-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:30.140-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (12109 records 124393590 bytes) is inconsistent with full validation results (11488 records 118016224 bytes). Updating size storer with new values. 2015-03-02T12:30:30.141-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:30.146-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:30.153-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:30.173-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:30.175-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:30.180-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:30.199-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:30.201-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:30.640-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61103 #3 (2 connections now open) 2015-03-02T12:30:30.649-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:30.691-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (11546 records 118612058 bytes) are inconsistent with full validation results (10488 records 107743224 bytes). Updating counters with new values. 2015-03-02T12:30:30.691-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11488 records 118016224 bytes) is inconsistent with full validation results (10488 records 107743224 bytes). Updating size storer with new values. 2015-03-02T12:30:30.691-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:30.693-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:30.707-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:30.759-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (11430 records 117420390 bytes) are inconsistent with full validation results (11857 records 121806961 bytes). Updating counters with new values. 2015-03-02T12:30:30.759-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (10809 records 111040857 bytes) is inconsistent with full validation results (11857 records 121806961 bytes). Updating size storer with new values. 2015-03-02T12:30:30.759-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:30.761-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:30.766-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:30.819-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (11857 records 121806961 bytes) are inconsistent with full validation results (12488 records 128289224 bytes). Updating counters with new values. 2015-03-02T12:30:30.823-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11857 records 121806961 bytes) is inconsistent with full validation results (12488 records 128289224 bytes). Updating size storer with new values. 2015-03-02T12:30:30.823-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:30.830-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:30.842-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:30.878-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12488 records 128289224 bytes) is inconsistent with full validation results (12489 records 128289270 bytes). Updating size storer with new values. 2015-03-02T12:30:30.878-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:30.880-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:30.888-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:30.935-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:30.940-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:30.951-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:31.001-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:31.005-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:31.011-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:31.059-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:31.063-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:31.071-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:31.119-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:31.121-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:31.127-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:31.167-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:31.169-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:31.392-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1607.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4821 nscannedObjects:4821 nMatched:2411 nModified:2411 keyUpdates:1 writeConflicts:0 numYields:38 locks:{} 216ms 2015-03-02T12:30:31.393-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1607.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 216ms 2015-03-02T12:30:31.397-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:31.445-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12489 records 128320171 bytes) is inconsistent with full validation results (12489 records 128320600 bytes). Updating size storer with new values. 2015-03-02T12:30:31.445-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:31.447-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:31.872-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61104 #4 (3 connections now open) 2015-03-02T12:30:34.391-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:30:35.071-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:30:36.220-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:30:36.832-0500 I NETWORK [conn4] end connection 10.4.127.218:61104 (2 connections now open) 2015-03-02T12:30:36.889-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61105 #5 (3 connections now open) 2015-03-02T12:30:37.502-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T12:30:37.652-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:38.115-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (28489 records 292829988 bytes) are inconsistent with full validation results (28489 records 292789610 bytes). Updating counters with new values. 2015-03-02T12:30:38.115-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28489 records 292818158 bytes) is inconsistent with full validation results (28489 records 292789610 bytes). Updating size storer with new values. 2015-03-02T12:30:38.119-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:38.126-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:38.137-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 485ms 2015-03-02T12:30:38.152-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:38.269-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (28489 records 292809227 bytes) are inconsistent with full validation results (28489 records 292835331 bytes). Updating counters with new values. 2015-03-02T12:30:38.269-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28489 records 292803780 bytes) is inconsistent with full validation results (28489 records 292835331 bytes). Updating size storer with new values. 2015-03-02T12:30:38.269-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:38.276-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:38.283-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 130ms 2015-03-02T12:30:38.307-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:38.440-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (28489 records 292852712 bytes) are inconsistent with full validation results (28489 records 292853050 bytes). Updating counters with new values. 2015-03-02T12:30:38.440-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28489 records 292842884 bytes) is inconsistent with full validation results (28489 records 292853050 bytes). Updating size storer with new values. 2015-03-02T12:30:38.440-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:38.451-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:38.460-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 153ms 2015-03-02T12:30:38.477-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:38.656-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (28489 records 292870821 bytes) are inconsistent with full validation results (28489 records 292870327 bytes). Updating counters with new values. 2015-03-02T12:30:38.656-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28489 records 292869222 bytes) is inconsistent with full validation results (28489 records 292870327 bytes). Updating size storer with new values. 2015-03-02T12:30:38.656-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:38.666-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:38.693-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 216ms 2015-03-02T12:30:38.713-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:38.876-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (28489 records 292890048 bytes) are inconsistent with full validation results (28489 records 292889073 bytes). Updating counters with new values. 2015-03-02T12:30:38.876-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28489 records 292881728 bytes) is inconsistent with full validation results (28489 records 292889073 bytes). Updating size storer with new values. 2015-03-02T12:30:38.876-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:38.887-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:38.892-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 179ms 2015-03-02T12:30:39.203-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 213ms 2015-03-02T12:30:40.470-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 323.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:58520 nscannedObjects:58520 nMatched:26259 nModified:26259 keyUpdates:1 writeConflicts:0 numYields:479 locks:{} 3569ms 2015-03-02T12:30:40.470-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 323.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3569ms 2015-03-02T12:30:40.473-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:40.671-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (29489 records 303256219 bytes) are inconsistent with full validation results (29489 records 303271624 bytes). Updating counters with new values. 2015-03-02T12:30:40.671-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (29489 records 303256219 bytes) is inconsistent with full validation results (29489 records 303271624 bytes). Updating size storer with new values. 2015-03-02T12:30:40.671-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:40.681-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:40.699-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 225ms 2015-03-02T12:30:40.715-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:40.908-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (29743 records 305880966 bytes) are inconsistent with full validation results (29489 records 303271624 bytes). Updating counters with new values. 2015-03-02T12:30:40.908-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (29565 records 304052372 bytes) is inconsistent with full validation results (29489 records 303271624 bytes). Updating size storer with new values. 2015-03-02T12:30:40.908-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:40.918-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:40.922-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 207ms 2015-03-02T12:30:41.029-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T12:30:42.130-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7791.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:41763 nscannedObjects:41763 nMatched:20860 nModified:20860 keyUpdates:1 writeConflicts:74 numYields:351 locks:{} 3230ms 2015-03-02T12:30:42.130-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7791.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3235ms 2015-03-02T12:30:42.133-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:42.237-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:30:42.316-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (17011 records 174913218 bytes) are inconsistent with full validation results (18308 records 188263858 bytes). Updating counters with new values. 2015-03-02T12:30:42.316-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (17412 records 179037904 bytes) is inconsistent with full validation results (18308 records 188263858 bytes). Updating size storer with new values. 2015-03-02T12:30:42.317-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:42.340-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:42.346-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 212ms 2015-03-02T12:30:43.129-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 3822.0 } } ndeleted:20860 keyUpdates:0 writeConflicts:49 numYields:204 locks:{} 2196ms 2015-03-02T12:30:43.129-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3822.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2196ms 2015-03-02T12:30:43.134-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:43.212-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (5273 records 54196088 bytes) are inconsistent with full validation results (4230 records 43454790 bytes). Updating counters with new values. 2015-03-02T12:30:43.212-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (5709 records 58670544 bytes) is inconsistent with full validation results (4230 records 43454790 bytes). Updating size storer with new values. 2015-03-02T12:30:43.212-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:43.226-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:43.240-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 105ms 2015-03-02T12:30:43.406-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T12:30:43.426-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 455.0 } } ndeleted:2000 keyUpdates:0 writeConflicts:0 numYields:16 locks:{} 181ms 2015-03-02T12:30:43.426-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 455.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 181ms 2015-03-02T12:30:43.428-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:43.445-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (3666 records 37660818 bytes) is inconsistent with full validation results (3230 records 33181790 bytes). Updating size storer with new values. 2015-03-02T12:30:43.445-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:43.449-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:43.454-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:43.463-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:43.464-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:43.468-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:43.474-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:43.475-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:43.478-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:43.485-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:43.485-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:43.491-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:43.503-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (3230 records 33181790 bytes) is inconsistent with full validation results (3231 records 33181836 bytes). Updating size storer with new values. 2015-03-02T12:30:43.503-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:43.504-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:43.511-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:30:43.536-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:30:43.537-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:30:44.335-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:30:44.342-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.398-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4793 records 49228262 bytes) is inconsistent with full validation results (5231 records 53727836 bytes). Updating size storer with new values. 2015-03-02T12:30:44.399-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.399-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.408-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.434-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.438-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.524-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.539-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4669 records 47954410 bytes) is inconsistent with full validation results (4230 records 43454790 bytes). Updating size storer with new values. 2015-03-02T12:30:44.539-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.540-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.554-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.577-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4230 records 43454790 bytes) is inconsistent with full validation results (4231 records 43454836 bytes). Updating size storer with new values. 2015-03-02T12:30:44.577-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.578-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.584-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.607-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.608-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.615-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.630-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.630-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.647-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.668-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (4665 records 47913318 bytes) are inconsistent with full validation results (4508 records 46300457 bytes). Updating counters with new values. 2015-03-02T12:30:44.669-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4231 records 43454836 bytes) is inconsistent with full validation results (4508 records 46300457 bytes). Updating size storer with new values. 2015-03-02T12:30:44.669-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.674-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.684-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.699-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (4914 records 50471295 bytes) are inconsistent with full validation results (4935 records 50687028 bytes). Updating counters with new values. 2015-03-02T12:30:44.699-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4634 records 47594855 bytes) is inconsistent with full validation results (4935 records 50687028 bytes). Updating size storer with new values. 2015-03-02T12:30:44.699-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.700-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.710-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.726-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (5094 records 52330662 bytes) are inconsistent with full validation results (5230 records 53727790 bytes). Updating counters with new values. 2015-03-02T12:30:44.726-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4935 records 50687028 bytes) is inconsistent with full validation results (5230 records 53727790 bytes). Updating size storer with new values. 2015-03-02T12:30:44.726-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.727-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.895-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1172.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:1656 nscannedObjects:1656 nMatched:828 nModified:828 keyUpdates:1 writeConflicts:0 numYields:14 locks:{} 164ms 2015-03-02T12:30:44.895-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1172.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 165ms 2015-03-02T12:30:44.896-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.908-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (5230 records 53735057 bytes) is inconsistent with full validation results (5230 records 53738554 bytes). Updating size storer with new values. 2015-03-02T12:30:44.909-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.910-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:44.962-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:44.998-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:44.999-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:45.007-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:45.036-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:45.039-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:45.118-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:45.135-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (5230 records 53738554 bytes) is inconsistent with full validation results (4402 records 45221746 bytes). Updating size storer with new values. 2015-03-02T12:30:45.135-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:45.136-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:45.154-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:45.172-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4402 records 45221746 bytes) is inconsistent with full validation results (4403 records 45221792 bytes). Updating size storer with new values. 2015-03-02T12:30:45.172-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:45.173-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:45.190-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:45.201-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4403 records 45221792 bytes) is inconsistent with full validation results (4402 records 45221746 bytes). Updating size storer with new values. 2015-03-02T12:30:45.202-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:45.202-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:45.210-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:45.235-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:45.236-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:45.244-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:45.269-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:45.270-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:45.276-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:30:45.292-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:30:45.293-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:30:47.000-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:30:48.054-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:30:49.281-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:30:49.956-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:30:50.361-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:30:50.614-0500 I NETWORK [conn3] end connection 10.4.127.218:61103 (2 connections now open) 2015-03-02T12:30:50.649-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61107 #6 (3 connections now open) 2015-03-02T12:30:50.804-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T12:30:50.865-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:30:50.982-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 5627.0 } } ndeleted:3746 keyUpdates:0 writeConflicts:0 numYields:31 locks:{} 317ms 2015-03-02T12:30:50.982-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5627.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 317ms 2015-03-02T12:30:50.985-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:30:51.137-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (18329 records 188293817 bytes) is inconsistent with full validation results (17656 records 181380088 bytes). Updating size storer with new values. 2015-03-02T12:30:51.137-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:30:51.143-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:30:51.147-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 161ms 2015-03-02T12:30:51.962-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:52.111-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19446 records 199768758 bytes) are inconsistent with full validation results (18656 records 191653088 bytes). Updating counters with new values. 2015-03-02T12:30:52.111-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (18983 records 195012359 bytes) is inconsistent with full validation results (18656 records 191653088 bytes). Updating size storer with new values. 2015-03-02T12:30:52.111-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:52.121-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:52.122-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 160ms 2015-03-02T12:30:52.133-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:30:52.136-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:52.229-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (18866 records 193810418 bytes) are inconsistent with full validation results (19656 records 201926088 bytes). Updating counters with new values. 2015-03-02T12:30:52.229-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (18656 records 191653088 bytes) is inconsistent with full validation results (19656 records 201926088 bytes). Updating size storer with new values. 2015-03-02T12:30:52.229-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:52.235-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:52.240-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 103ms 2015-03-02T12:30:52.251-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:52.345-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:52.347-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:52.356-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:52.425-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:52.432-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:52.448-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:52.553-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (20571 records 211325883 bytes) are inconsistent with full validation results (19656 records 201926088 bytes). Updating counters with new values. 2015-03-02T12:30:52.553-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19983 records 205285359 bytes) is inconsistent with full validation results (19656 records 201926088 bytes). Updating size storer with new values. 2015-03-02T12:30:52.553-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:52.562-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:52.564-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 115ms 2015-03-02T12:30:52.570-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:30:52.668-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19741 records 202799293 bytes) are inconsistent with full validation results (20656 records 212199088 bytes). Updating counters with new values. 2015-03-02T12:30:52.668-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19656 records 201926088 bytes) is inconsistent with full validation results (20656 records 212199088 bytes). Updating size storer with new values. 2015-03-02T12:30:52.668-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:30:52.671-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:30:52.673-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 102ms 2015-03-02T12:30:53.759-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:30:54.375-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:30:55.250-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:30:56.127-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:30:57.276-0500 I NETWORK [conn2] end connection 10.4.127.218:61102 (2 connections now open) 2015-03-02T12:30:57.286-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61109 #7 (3 connections now open) 2015-03-02T12:30:57.400-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:30:57.751-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:30:57.798-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (33656 records 345765157 bytes) are inconsistent with full validation results (32656 records 335492157 bytes). Updating counters with new values. 2015-03-02T12:30:57.798-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (32670 records 335635979 bytes) is inconsistent with full validation results (32656 records 335492157 bytes). Updating size storer with new values. 2015-03-02T12:30:57.799-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:30:57.816-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:30:57.826-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 425ms 2015-03-02T12:31:00.788-0500 I WRITE [conn7] update test.foo query: { x: { $gte: 456.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:60292 nscannedObjects:60292 nMatched:30146 nModified:30146 keyUpdates:1 writeConflicts:0 numYields:491 locks:{} 2959ms 2015-03-02T12:31:00.788-0500 I COMMAND [conn7] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 456.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2959ms 2015-03-02T12:31:00.790-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:31:01.031-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:31:01.035-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (35524 records 365329950 bytes) is inconsistent with full validation results (35656 records 366685986 bytes). Updating size storer with new values. 2015-03-02T12:31:01.035-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:31:01.042-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:31:01.088-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 298ms 2015-03-02T12:31:01.116-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:31:01.291-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:31:01.297-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (36524 records 375602950 bytes) is inconsistent with full validation results (36656 records 376958986 bytes). Updating size storer with new values. 2015-03-02T12:31:01.298-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:31:01.307-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:31:01.313-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 281ms 2015-03-02T12:31:01.364-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (36656 records 37695942015-03-02T12:31:34.338-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] MongoDB starting : pid=2527 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:31:34.348-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:31:34.348-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:31:34.384-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:31:34.437-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:31:35.760-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61116 #1 (1 connection now open) 2015-03-02T12:31:37.001-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61118 #2 (2 connections now open) 2015-03-02T12:31:37.391-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61119 #3 (3 connections now open) 2015-03-02T12:31:39.305-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:31:39.616-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:31:40.966-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:31:43.334-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:31:43.599-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:31:44.455-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:31:45.052-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:31:45.675-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:31:45.906-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (60299 records 619595879 bytes) are inconsistent with full validation results (58299 records 599049879 bytes). Updating counters with new values. 2015-03-02T12:31:45.906-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (59300 records 609333152 bytes) is inconsistent with full validation results (58299 records 599049879 bytes). Updating size storer with new values. 2015-03-02T12:31:45.907-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:31:45.919-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:31:45.926-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1471ms 2015-03-02T12:31:46.781-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:31:46.973-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:31:47.983-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:31:48.237-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17697 records 181945533 bytes) are inconsistent with full validation results (23223 records 238714131 bytes). Updating counters with new values. 2015-03-02T12:31:48.237-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18298 records 188119606 bytes) is inconsistent with full validation results (23223 records 238714131 bytes). Updating size storer with new values. 2015-03-02T12:31:48.237-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:31:48.264-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:31:48.279-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 296ms 2015-03-02T12:31:48.293-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:31:48.396-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (20715 records 212949447 bytes) are inconsistent with full validation results (18736 records 192619180 bytes). Updating counters with new values. 2015-03-02T12:31:48.396-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20824 records 214069204 bytes) is inconsistent with full validation results (18736 records 192619180 bytes). Updating size storer with new values. 2015-03-02T12:31:48.396-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:31:48.403-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:31:48.409-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 115ms 2015-03-02T12:31:48.419-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:31:48.504-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17177 records 176603573 bytes) are inconsistent with full validation results (16774 records 172463554 bytes). Updating counters with new values. 2015-03-02T12:31:48.504-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17845 records 183465937 bytes) is inconsistent with full validation results (16774 records 172463554 bytes). Updating size storer with new values. 2015-03-02T12:31:48.509-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:31:48.516-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:31:49.030-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 147.0 } } ndeleted:61976 keyUpdates:0 writeConflicts:0 numYields:486 locks:{} 3100ms 2015-03-02T12:31:49.030-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 147.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3101ms 2015-03-02T12:31:49.032-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:31:49.050-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (2467 records 25343491 bytes) are inconsistent with full validation results (1323 records 13591179 bytes). Updating counters with new values. 2015-03-02T12:31:49.050-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (3442 records 35362101 bytes) is inconsistent with full validation results (1323 records 13591179 bytes). Updating size storer with new values. 2015-03-02T12:31:49.050-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:31:49.054-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:31:49.058-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:31:49.061-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:31:49.061-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:31:49.926-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:31:50.586-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:31:50.760-0500 I NETWORK [conn1] end connection 10.4.127.218:61116 (2 connections now open) 2015-03-02T12:31:50.780-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61121 #4 (3 connections now open) 2015-03-02T12:31:53.327-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:53.567-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11348 records 116578004 bytes) is inconsistent with full validation results (12323 records 126594179 bytes). Updating size storer with new values. 2015-03-02T12:31:53.567-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:53.572-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:53.573-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 245ms 2015-03-02T12:31:53.576-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:53.599-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:53.601-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:53.835-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 4288.0 } } ndeleted:4712 keyUpdates:0 writeConflicts:0 numYields:36 locks:{} 231ms 2015-03-02T12:31:53.835-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4288.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 232ms 2015-03-02T12:31:53.838-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:53.891-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (8298 records 85245354 bytes) is inconsistent with full validation results (7611 records 78187803 bytes). Updating size storer with new values. 2015-03-02T12:31:53.892-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:53.897-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:53.902-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:53.916-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:53.918-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:53.921-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:53.936-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:53.937-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:53.942-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:53.958-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (7611 records 78187803 bytes) is inconsistent with full validation results (7612 records 78187849 bytes). Updating size storer with new values. 2015-03-02T12:31:53.959-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:53.960-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:53.969-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:53.994-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (7612 records 78187849 bytes) is inconsistent with full validation results (7611 records 78187803 bytes). Updating size storer with new values. 2015-03-02T12:31:53.994-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:53.998-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:54.018-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:31:54.032-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (7611 records 78191846 bytes) is inconsistent with full validation results (7611 records 78192093 bytes). Updating size storer with new values. 2015-03-02T12:31:54.032-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:31:54.033-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:31:55.561-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:31:56.987-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:31:57.079-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:31:57.216-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16592 records 170453906 bytes) is inconsistent with full validation results (16611 records 170649093 bytes). Updating size storer with new values. 2015-03-02T12:31:57.217-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:31:57.219-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:31:57.220-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 141ms 2015-03-02T12:31:57.369-0500 I NETWORK [conn3] end connection 10.4.127.218:61119 (2 connections now open) 2015-03-02T12:31:57.416-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61122 #5 (3 connections now open) 2015-03-02T12:31:59.208-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:32:02.783-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:32:04.935-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:05.367-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (36611 records 376109093 bytes) are inconsistent with full validation results (35611 records 365836093 bytes). Updating counters with new values. 2015-03-02T12:32:05.367-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (36592 records 375913906 bytes) is inconsistent with full validation results (35611 records 365836093 bytes). Updating size storer with new values. 2015-03-02T12:32:05.367-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:05.371-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:05.374-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 439ms 2015-03-02T12:32:05.629-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 7739.0 } } ndeleted:6113 keyUpdates:0 writeConflicts:0 numYields:48 locks:{} 249ms 2015-03-02T12:32:05.630-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7739.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 249ms 2015-03-02T12:32:05.631-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:05.732-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (29498 records 303032954 bytes) are inconsistent with full validation results (30498 records 313305954 bytes). Updating counters with new values. 2015-03-02T12:32:05.732-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (29630 records 304390706 bytes) is inconsistent with full validation results (30498 records 313305954 bytes). Updating size storer with new values. 2015-03-02T12:32:05.732-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:05.743-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:05.746-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 115ms 2015-03-02T12:32:05.759-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:05.844-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:05.848-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:05.872-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:05.945-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:05.949-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:05.981-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:06.068-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:06.076-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:06.083-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:06.174-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (30498 records 313305954 bytes) is inconsistent with full validation results (30499 records 313306000 bytes). Updating size storer with new values. 2015-03-02T12:32:06.174-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:06.178-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:06.862-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:32:06.983-0500 I NETWORK [conn2] end connection 10.4.127.218:61118 (2 connections now open) 2015-03-02T12:32:07.028-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61125 #6 (3 connections now open) 2015-03-02T12:32:07.168-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32366 records 332485691 bytes) is inconsistent with full validation results (32499 records 333852000 bytes). Updating size storer with new values. 2015-03-02T12:32:07.168-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:32:07.172-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:32:07.175-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 139ms 2015-03-02T12:32:07.176-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 313ms 2015-03-02T12:32:07.184-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:32:07.190-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:32:07.331-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:32:07.333-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:32:07.339-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:32:07.342-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:32:07.345-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 154ms 2015-03-02T12:32:07.345-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 161ms 2015-03-02T12:32:07.352-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:32:07.363-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:32:07.503-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:32:07.507-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:32:07.513-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 160ms 2015-03-02T12:32:07.514-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:32:07.517-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:32:07.520-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:32:07.525-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 162ms 2015-03-02T12:32:07.532-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:32:07.671-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:32:07.678-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:32:07.681-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:32:07.684-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 163ms 2015-03-02T12:32:07.687-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:32:07.690-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 158ms 2015-03-02T12:32:07.703-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:32:07.780-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:32:07.784-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:32:07.799-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:32:07.908-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:32:07.913-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:32:07.929-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 130ms 2015-03-02T12:32:15.052-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:32:44.901-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] MongoDB starting : pid=2490 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:32:44.910-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:32:44.910-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:32:44.948-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:32:45.016-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:32:46.539-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61139 #1 (1 connection now open) 2015-03-02T12:32:47.044-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61140 #2 (2 connections now open) 2015-03-02T12:32:47.062-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:47.462-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (15667 records 161010106 bytes) are inconsistent with full validation results (22440 records 230670372 bytes). Updating counters with new values. 2015-03-02T12:32:47.462-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16298 records 167500572 bytes) is inconsistent with full validation results (22440 records 230670372 bytes). Updating size storer with new values. 2015-03-02T12:32:47.465-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:47.474-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:47.482-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 414ms 2015-03-02T12:32:47.490-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:32:47.551-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (20580 records 211538412 bytes) are inconsistent with full validation results (15041 records 154571070 bytes). Updating counters with new values. 2015-03-02T12:32:47.552-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (21071 records 216588838 bytes) is inconsistent with full validation results (15041 records 154571070 bytes). Updating size storer with new values. 2015-03-02T12:32:47.555-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:32:47.558-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:32:47.648-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2584.0 } } ndeleted:27267 keyUpdates:0 writeConflicts:0 numYields:213 locks:{} 1102ms 2015-03-02T12:32:47.648-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2584.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1103ms 2015-03-02T12:32:47.652-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:32:47.674-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11266 records 115751660 bytes) are inconsistent with full validation results (10032 records 103058736 bytes). Updating counters with new values. 2015-03-02T12:32:47.674-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11532 records 118477496 bytes) is inconsistent with full validation results (10032 records 103058736 bytes). Updating size storer with new values. 2015-03-02T12:32:47.674-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:32:47.677-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:32:50.768-0500 I NETWORK [conn1] end connection 10.4.127.218:61139 (1 connection now open) 2015-03-02T12:32:50.800-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61141 #3 (2 connections now open) 2015-03-02T12:32:50.805-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:32:50.832-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11766 records 120872118 bytes) is inconsistent with full validation results (12032 records 123604736 bytes). Updating size storer with new values. 2015-03-02T12:32:50.833-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:32:50.834-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:32:52.430-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61142 #4 (3 connections now open) 2015-03-02T12:32:52.440-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:32:52.486-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14766 records 151691118 bytes) is inconsistent with full validation results (15032 records 154423736 bytes). Updating size storer with new values. 2015-03-02T12:32:52.487-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:32:52.489-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:32:57.405-0500 I NETWORK [conn4] end connection 10.4.127.218:61142 (2 connections now open) 2015-03-02T12:32:57.432-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61143 #5 (3 connections now open) 2015-03-02T12:32:57.442-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:32:57.685-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24766 records 254421118 bytes) is inconsistent with full validation results (25032 records 257153736 bytes). Updating size storer with new values. 2015-03-02T12:32:57.685-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:32:57.688-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:32:57.694-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 251ms 2015-03-02T12:32:57.699-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:32:59.966-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f49ec933f81d588df58e2e'), x: 8236.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 26 } }, Database: { acquireCount: { w: 26 } }, Collection: { acquireCount: { w: 26 } } } 107ms 2015-03-02T12:33:00.017-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f49ec8680d1722974465ff'), x: 5023.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 24 } }, Database: { acquireCount: { w: 24 } }, Collection: { acquireCount: { w: 24 } } } 102ms 2015-03-02T12:33:05.559-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f49ec933f81d588df58e6f'), x: 8301.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 91 } }, Database: { acquireCount: { w: 91 } }, Collection: { acquireCount: { w: 91 } } } 113ms 2015-03-02T12:33:07.043-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61148 #6 (4 connections now open) 2015-03-02T12:33:07.194-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f49ec8680d172297446652'), x: 5106.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 107 } }, Database: { acquireCount: { w: 107 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 52220 } }, Collection: { acquireCount: { w: 107 } } } 137ms 2015-03-02T12:33:07.279-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f49ec933f81d588df58e82'), x: 8320.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 110 } }, Database: { acquireCount: { w: 110 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 85197 } }, Collection: { acquireCount: { w: 110 } } } 171ms 2015-03-02T12:33:07.365-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (25460 records 261550580 bytes) are inconsistent with full validation results (25032 records 257153736 bytes). Updating counters with new values. 2015-03-02T12:33:07.365-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:33:07.367-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f49ec8680d172297446653'), x: 5107.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 108 } }, Database: { acquireCount: { w: 108 }, acquireWaitCount: { w: 2 }, timeAcquiringMicros: { w: 138152 } }, Collection: { acquireCount: { w: 108 } } } 173ms 2015-03-02T12:33:07.374-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:33:07.379-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 9680ms 2015-03-02T12:33:07.386-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 341ms 2015-03-02T12:33:07.390-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:33:07.502-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 9713ms 2015-03-02T12:33:07.507-0500 I NETWORK [conn2] end connection 10.4.127.218:61140 (3 connections now open) 2015-03-02T12:33:07.508-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 9563ms 2015-03-02T12:33:07.565-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (26604 records 273302892 bytes) are inconsistent with full validation results (25780 records 264837940 bytes). Updating counters with new values. 2015-03-02T12:33:07.565-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26338 records 270570274 bytes) is inconsistent with full validation results (25780 records 264837940 bytes). Updating size storer with new values. 2015-03-02T12:33:07.565-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:33:07.575-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:33:07.585-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 193ms 2015-03-02T12:33:08.359-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 1292.0 } } ndeleted:15798 keyUpdates:0 writeConflicts:0 numYields:124 locks:{} 768ms 2015-03-02T12:33:08.360-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1292.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 769ms 2015-03-02T12:33:08.363-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:33:08.462-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (9982 records 102545086 bytes) are inconsistent with full validation results (11234 records 115406882 bytes). Updating counters with new values. 2015-03-02T12:33:08.462-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (10046 records 103202558 bytes) is inconsistent with full validation results (11234 records 115406882 bytes). Updating size storer with new values. 2015-03-02T12:33:08.462-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:33:08.482-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:33:08.494-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 131ms 2015-03-02T12:33:08.906-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:33:09.967-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T12:33:10.426-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:33:10.785-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:33:11.744-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:33:12.812-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:33:12.816-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:33:12.868-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:33:13.244-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24234 records 248955882 bytes) are inconsistent with full validation results (23710 records 243572830 bytes). Updating counters with new values. 2015-03-02T12:33:13.244-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (24170 records 248298410 bytes) is inconsistent with full validation results (23710 records 243572830 bytes). Updating size storer with new values. 2015-03-02T12:33:13.244-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:33:13.257-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:33:13.264-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 447ms 2015-03-02T12:33:13.275-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:33:13.388-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:33:13.422-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24710 records 253845830 bytes) are inconsistent with full validation results (24282 records 249448986 bytes). Updating counters with new values. 2015-03-02T12:33:13.422-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (24646 records 253188358 bytes) is inconsistent with full validation results (24282 records 249448986 bytes). Updating size storer with new values. 2015-03-02T12:33:13.422-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:33:13.437-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:33:13.439-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T12:33:13.453-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:33:13.578-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24282 records 249448986 bytes) are inconsistent with full validation results (25234 records 259228882 bytes). Updating counters with new values. 2015-03-02T12:33:13.578-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (24282 records 249448986 bytes) is inconsistent with full validation results (25234 records 259228882 bytes). Updating size storer with new values. 2015-03-02T12:33:13.578-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:33:13.587-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:33:13.593-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T12:33:14.951-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:33:14.961-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:33:16.215-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:33:17.686-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:33:18.079-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:33:18.697-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:33:18.699-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (38234 records 392777882 bytes) are inconsistent with full validation results (37234 records 382504882 bytes). Updating counters with new values. 2015-03-02T12:33:18.699-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (38170 records 392120410 bytes) is inconsistent with full validation results (37234 records 382504882 bytes). Updating size storer with new values. 2015-03-02T12:33:18.699-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:33:18.702-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:33:18.714-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:33:18.720-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 641ms 2015-03-02T12:33:18.811-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (37234 records 382504882 bytes) are inconsistent with full validation results (38234 records 392777882 bytes). Updating counters with new values. 2015-03-02T12:33:18.811-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (37234 records 382504882 bytes) is inconsistent with full validation results (38234 records 392777882 bytes). Updating size storer with new values. 2015-03-02T12:33:18.811-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:33:18.816-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:33:18.821-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 119ms 2015-03-02T12:33:18.828-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:33:18.987-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:33:19.023-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (39234 records 403050882 bytes) are inconsistent with full validation results (38234 records 392777882 bytes). Updating counters with new values. 2015-03-02T12:33:19.023-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (39170 records 402393410 bytes) is inconsistent with full validation results (38234 records 392777882 bytes). Updating size storer with new values. 2015-03-02T12:33:19.023-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:33:19.036-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:33:19.050-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 221ms 2015-03-02T12:33:19.848-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:33:20.781-0500 I NETWORK [conn3] end connection 10.4.127.218:61141 (2 connections now open) 2015-03-02T12:33:20.817-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61150 #7 (3 connections now open) 2015-03-02T12:33:20.850-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:33:21.218-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing record and data size counters (40234 records 413521365 bytes) are inconsistent with full validation results (41234 records 423770120 bytes). Updating counters with new values. 2015-03-02T12:33:21.218-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (40234 records 413518050 bytes) is inconsistent with full validation results (41234 records 423770120 bytes). Updating size storer with new values. 2015-03-02T12:33:21.218-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:33:21.242-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:33:21.263-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 413ms 2015-03-02T12:33:21.577-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 181ms 2015-03-02T12:33:21.977-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3070.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39918 nscannedObjects:39918 nMatched:18790 nModified:18790 keyUpdates:1 writeConflicts:41 numYields:337 locks:{} 2920ms 2015-03-02T12:33:21.977-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3070.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2921ms 2015-03-02T12:33:21.980-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:33:22.239-0500 W STORAGE [conn5] table:collection-2015-03-02T12:33:55.678-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] MongoDB starting : pid=2522 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:33:55.692-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:33:55.692-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:33:55.727-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:33:55.781-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:33:57.420-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61157 #1 (1 connection now open) 2015-03-02T12:34:00.806-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61170 #2 (2 connections now open) 2015-03-02T12:34:00.829-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:34:01.275-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39300 records 403873152 bytes) is inconsistent with full validation results (40299 records 414135879 bytes). Updating size storer with new values. 2015-03-02T12:34:01.275-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:34:01.280-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:34:01.285-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 453ms 2015-03-02T12:34:01.302-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:34:01.462-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (41299 records 424408879 bytes) are inconsistent with full validation results (40299 records 414135879 bytes). Updating counters with new values. 2015-03-02T12:34:01.462-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (40300 records 414146152 bytes) is inconsistent with full validation results (40299 records 414135879 bytes). Updating size storer with new values. 2015-03-02T12:34:01.462-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:34:01.467-0500 I INDEX [conn2] validating index te2015-03-02T12:34:57.344-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:34:57.354-0500 I CONTROL [initandlisten] MongoDB starting : pid=2495 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:34:57.354-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:34:57.354-0500 I CONTROL [initandlisten] 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:34:57.355-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:34:57.355-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:34:57.394-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:34:57.451-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:34:57.454-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61185 #1 (1 connection now open) 2015-03-02T12:34:59.641-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3985.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:48930 nscannedObjects:48930 nMatched:24465 nModified:24465 keyUpdates:1 writeConflicts:0 numYields:388 locks:{} 2174ms 2015-03-02T12:34:59.641-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3985.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2175ms 2015-03-02T12:34:59.644-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:34:59.867-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:34:59.874-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:34:59.881-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 237ms 2015-03-02T12:35:00.835-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61194 #2 (2 connections now open) 2015-03-02T12:35:01.515-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4813.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:46123 nscannedObjects:46123 nMatched:23076 nModified:23076 keyUpdates:1 writeConflicts:25 numYields:361 locks:{} 1632ms 2015-03-02T12:35:01.515-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4813.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1632ms 2015-03-02T12:35:01.519-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:35:01.655-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23581 records 242377084 bytes) are inconsistent with full validation results (26015 records 267413208 bytes). Updating counters with new values. 2015-03-02T12:35:01.655-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23845 records 245092588 bytes) is inconsistent with full validation results (26015 records 267413208 bytes). Updating size storer with new values. 2015-03-02T12:35:01.659-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:35:01.668-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:35:01.674-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 155ms 2015-03-02T12:35:02.009-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 4370.0 } } ndeleted:23091 keyUpdates:0 writeConflicts:15 numYields:186 locks:{} 1157ms 2015-03-02T12:35:02.010-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4370.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1157ms 2015-03-02T12:35:02.013-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:35:02.054-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (15268 records 156879806 bytes) are inconsistent with full validation results (12834 records 131843682 bytes). Updating counters with new values. 2015-03-02T12:35:02.054-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (15279 records 156982712 bytes) is inconsistent with full validation results (12834 records 131843682 bytes). Updating size storer with new values. 2015-03-02T12:35:02.055-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:35:02.058-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:35:02.065-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:35:02.077-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61197 #3 (3 connections now open) 2015-03-02T12:35:02.090-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (12834 records 131843682 bytes) is inconsistent with full validation results (12835 records 131843728 bytes). Updating size storer with new values. 2015-03-02T12:35:02.090-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:35:02.092-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:35:02.098-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:02.124-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:02.125-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:02.130-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:02.163-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:02.164-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:02.409-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2230.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7022 nscannedObjects:7022 nMatched:3511 nModified:3511 keyUpdates:1 writeConflicts:0 numYields:55 locks:{} 239ms 2015-03-02T12:35:02.409-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2230.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 239ms 2015-03-02T12:35:02.412-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:02.438-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12835 records 131882572 bytes) is inconsistent with full validation results (12835 records 131889358 bytes). Updating size storer with new values. 2015-03-02T12:35:02.438-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:02.440-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:02.695-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5373.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7022 nscannedObjects:7022 nMatched:3511 nModified:3511 keyUpdates:1 writeConflicts:0 numYields:55 locks:{} 250ms 2015-03-02T12:35:02.695-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5373.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 251ms 2015-03-02T12:35:02.702-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:02.765-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:02.769-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:02.910-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 2291.0 } } ndeleted:3511 keyUpdates:0 writeConflicts:0 numYields:27 locks:{} 137ms 2015-03-02T12:35:02.910-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2291.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:35:02.918-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:02.978-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (9869 records 101381082 bytes) is inconsistent with full validation results (9324 records 95785452 bytes). Updating size storer with new values. 2015-03-02T12:35:02.979-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:02.983-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:03.238-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1040.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6168 nscannedObjects:6168 nMatched:3084 nModified:3084 keyUpdates:1 writeConflicts:0 numYields:49 locks:{} 251ms 2015-03-02T12:35:03.238-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1040.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 251ms 2015-03-02T12:35:03.241-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:03.270-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (9324 records 95817367 bytes) is inconsistent with full validation results (9324 records 95825544 bytes). Updating size storer with new values. 2015-03-02T12:35:03.270-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:03.272-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:03.290-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:03.326-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:03.328-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:03.332-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:03.361-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:03.364-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:03.375-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:03.418-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:03.423-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:03.428-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:35:03.447-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:35:03.448-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:35:05.392-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:35:07.044-0500 I NETWORK [conn3] end connection 10.4.127.218:61197 (2 connections now open) 2015-03-02T12:35:07.078-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61201 #4 (3 connections now open) 2015-03-02T12:35:07.308-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4081.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6168 nscannedObjects:6168 nMatched:3084 nModified:3084 keyUpdates:1 writeConflicts:0 numYields:49 locks:{} 218ms 2015-03-02T12:35:07.308-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4081.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 218ms 2015-03-02T12:35:07.312-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:35:07.426-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:35:07.443-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:35:07.446-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 134ms 2015-03-02T12:35:07.743-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 181ms 2015-03-02T12:35:07.748-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 164ms 2015-03-02T12:35:07.761-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 6212.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6168 nscannedObjects:6168 nMatched:3084 nModified:3084 keyUpdates:1 writeConflicts:0 numYields:50 locks:{} 312ms 2015-03-02T12:35:07.761-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6212.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 312ms 2015-03-02T12:35:07.764-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:35:07.867-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17782 records 182714578 bytes) is inconsistent with full validation results (18324 records 188282544 bytes). Updating size storer with new values. 2015-03-02T12:35:07.868-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:35:07.870-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:35:07.872-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 108ms 2015-03-02T12:35:07.877-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:35:07.948-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:35:07.951-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:35:08.117-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 5174.0 } } ndeleted:3084 keyUpdates:0 writeConflicts:0 numYields:24 locks:{} 150ms 2015-03-02T12:35:08.117-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5174.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:35:08.119-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:35:08.156-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16121 records 165622486 bytes) is inconsistent with full validation results (15240 records 156560520 bytes). Updating size storer with new values. 2015-03-02T12:35:08.156-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:35:08.159-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:35:09.748-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:35:13.938-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:35:14.156-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26359 records 270786007 bytes) is inconsistent with full validation results (27240 records 279836520 bytes). Updating size storer with new values. 2015-03-02T12:35:14.156-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:35:14.161-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:35:14.164-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 225ms 2015-03-02T12:35:14.169-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:35:14.240-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:35:14.246-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:35:14.251-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:35:14.305-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:35:14.309-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:35:14.821-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4006.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13976 nscannedObjects:13976 nMatched:6988 nModified:6988 keyUpdates:1 writeConflicts:0 numYields:110 locks:{} 507ms 2015-03-02T12:35:14.821-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4006.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 507ms 2015-03-02T12:35:14.824-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:35:14.930-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (27240 records 279916067 bytes) is inconsistent with full validation results (27240 records 279927364 bytes). Updating size storer with new values. 2015-03-02T12:35:14.930-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:35:14.938-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:35:14.943-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 118ms 2015-03-02T12:35:18.099-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:35:18.116-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:35:20.805-0500 I NETWORK [conn2] end connection 10.4.127.218:61194 (2 connections now open) 2015-03-02T12:35:20.843-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61204 #5 (3 connections now open) 2015-03-02T12:35:23.894-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:35:24.369-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (45371 records 466187127 bytes) is inconsistent with full validation results (46240 records 475114364 bytes). Updating size storer with new values. 2015-03-02T12:35:24.369-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:35:24.375-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:35:24.380-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 485ms 2015-03-02T12:35:26.011-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:35:26.295-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (49371 records 507279127 bytes) is inconsistent with full validation results (50240 records 516206364 bytes). Updating size storer with new values. 2015-03-02T12:35:26.296-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:35:26.302-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:35:26.311-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 299ms 2015-03-02T12:35:27.467-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61205 #6 (4 connections now open) 2015-03-02T12:35:28.076-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 247ms 2015-03-02T12:35:28.737-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5211.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:38710 nscannedObjects:38710 nMatched:19355 nModified:19355 keyUpdates:1 writeConflicts:0 numYields:312 locks:{} 2418ms 2015-03-02T12:35:28.737-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5211.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2419ms 2015-03-02T12:35:28.746-0500 I NETWORK [conn1] end connection 10.4.127.218:61185 (3 connections now open) 2015-03-02T12:35:28.922-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:35:30.329-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 1166.0 } } ndeleted:38234 keyUpdates:0 writeConflicts:0 numYields:319 locks:{} 2842ms 2015-03-02T12:35:30.329-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1166.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2842ms 2015-03-02T12:35:30.338-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:30.617-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (16022 records 164594006 bytes) are inconsistent with full validation results (15006 records 154156638 bytes). Updating counters with new values. 2015-03-02T12:35:30.617-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15548 records 159724604 bytes) is inconsistent with full validation results (15006 records 154156638 bytes). Updating size storer with new values. 2015-03-02T12:35:30.618-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:30.646-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:30.659-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 320ms 2015-03-02T12:35:30.663-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:30.717-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:35:30.752-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (15990 records 164265270 bytes) are inconsistent with full validation results (16307 records 167521811 bytes). Updating counters with new values. 2015-03-02T12:35:30.752-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15532 records 159560236 bytes) is inconsistent with full validation results (16307 records 167521811 bytes). Updating size storer with new values. 2015-03-02T12:35:30.753-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:30.755-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:31.406-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 25.0 } } ndeleted:16681 keyUpdates:0 writeConflicts:0 numYields:131 locks:{} 640ms 2015-03-02T12:35:31.406-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 25.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 640ms 2015-03-02T12:35:31.407-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:31.438-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (0 records 0 bytes) are inconsistent with full validation results (325 records 3338725 bytes). Updating counters with new values. 2015-03-02T12:35:31.438-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (-1 records -10273 bytes) is inconsistent with full validation results (325 records 3338725 bytes). Updating size storer with new values. 2015-03-02T12:35:31.443-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:31.451-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:31.466-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:31.467-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:31.468-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:31.472-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:31.473-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (325 records 3338725 bytes) is inconsistent with full validation results (326 records 3338771 bytes). Updating size storer with new values. 2015-03-02T12:35:31.473-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:31.473-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:31.476-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:31.478-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (326 records 3338771 bytes) is inconsistent with full validation results (325 records 3338725 bytes). Updating size storer with new values. 2015-03-02T12:35:31.478-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:31.478-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:31.481-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:31.482-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:31.483-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:31.491-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:35:31.492-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:35:31.492-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:35:37.060-0500 I NETWORK [conn4] end connection 10.4.127.218:61201 (2 connections now open) 2015-03-02T12:35:37.097-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61211 #7 (3 connections now open) 2015-03-02T12:35:37.111-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:35:37.306-0500 W STORAGE [conn7] table:collection-2-2321154500689669931: Existing data in size storer (12184 records 125166232 bytes) is inconsistent with full validation results (12325 records 126614725 bytes). Updating size storer with new values. 2015-03-02T12:35:37.306-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T12:35:37.314-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T12:35:37.316-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11687 locks:{} 204ms 2015-03-02T12:35:38.107-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T12:35:38.112-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:35:38.172-0500 I COMMAND [conn6] command test.$cmd command: insert {2015-03-02T12:36:09.617-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] MongoDB starting : pid=2500 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:36:09.626-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:36:09.626-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:36:09.666-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:36:09.726-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:36:11.046-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61234 #1 (1 connection now open) 2015-03-02T12:36:11.058-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:36:11.432-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:36:11.437-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:36:11.440-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11683 locks:{} 380ms 2015-03-02T12:36:12.130-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9651.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24466 nscannedObjects:24466 nMatched:12233 nModified:12233 keyUpdates:1 writeConflicts:0 numYields:191 locks:{} 686ms 2015-03-02T12:36:12.130-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9651.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 686ms 2015-03-02T12:36:12.133-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:36:12.201-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:36:12.204-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:36:12.483-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 9934.0 } } ndeleted:12233 keyUpdates:0 writeConflicts:0 numYields:95 locks:{} 272ms 2015-03-02T12:36:12.483-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9934.0 } }, limit: 0.0 } ], ordered: true2015-03-02T12:37:10.429-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] MongoDB starting : pid=2496 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:37:10.441-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:37:10.441-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:37:10.486-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:37:10.549-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:37:12.497-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61264 #1 (1 connection now open) 2015-03-02T12:37:15.894-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61266 #2 (2 connections now open) 2015-03-02T12:37:17.127-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:61267 #3 (3 connections now open) 2015-03-02T12:37:17.273-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 4209.0 } } ndeleted:25599 keyUpdates:0 writeConflicts:0 numYields:200 locks:{} 1373ms 2015-03-02T12:37:17.274-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4209.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1373ms 2015-03-02T12:37:17.278-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:37:17.577-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19298 records 198245888 bytes) is inconsistent with full validation results (18700 records 192105100 bytes). Updating size storer with new values. 2015-03-02T12:37:17.578-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:37:17.591-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:37:17.597-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 319ms 2015-03-02T12:37:17.603-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:37:17.683-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:37:17.686-0500 I INDEX [conn2] validating index te2015-03-02T12:38:15.453-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:38:15.462-0500 I CONTROL [initandlisten] MongoDB starting : pid=3063 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:38:15.462-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:38:15.462-0500 I CONTROL [initandlisten] 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:38:15.465-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:38:15.465-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:38:15.504-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:38:15.558-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:41:04.015-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] MongoDB starting : pid=2582 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] 2015-03-02T12:41:04.028-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:41:04.030-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:41:04.030-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:41:04.030-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:41:04.030-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:41:04.030-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:41:04.068-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:41:04.133-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:41:07.164-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49407 #1 (1 connection now open) 2015-03-02T12:41:09.054-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1525.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:58770 nscannedObjects:58770 nMatched:29385 nModified:29385 keyUpdates:1 writeConflicts:0 numYields:459 locks:{} 1875ms 2015-03-02T12:41:09.054-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1525.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1875ms 2015-03-02T12:41:09.065-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:09.235-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:09.240-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:09.248-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 183ms 2015-03-02T12:41:09.258-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:09.328-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:09.332-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:09.342-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:09.412-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:09.416-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:09.426-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:09.494-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:09.498-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:09.508-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:09.577-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:09.581-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:12.299-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49408 #2 (2 connections now open) 2015-03-02T12:41:12.312-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:41:12.496-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39915 records 410418560 bytes) is inconsistent with full validation results (40299 records 414363392 bytes). Updating size storer with new values. 2015-03-02T12:41:12.497-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:41:12.504-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:41:12.511-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 199ms 2015-03-02T12:41:12.526-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:41:12.676-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:41:12.684-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:41:12.694-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T12:41:13.783-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49409 #3 (3 connections now open) 2015-03-02T12:41:14.848-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:41:17.209-0500 I NETWORK [conn2] end connection 10.4.127.218:49408 (2 connections now open) 2015-03-02T12:41:17.237-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49411 #4 (3 connections now open) 2015-03-02T12:41:17.258-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:41:17.588-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T12:41:17.943-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (52299 records 537639392 bytes) are inconsistent with full validation results (51299 records 527366392 bytes). Updating counters with new values. 2015-03-02T12:41:17.943-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (51915 records 533694560 bytes) is inconsistent with full validation results (51299 records 527366392 bytes). Updating size storer with new values. 2015-03-02T12:41:17.944-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:41:17.961-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:41:17.968-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 709ms 2015-03-02T12:41:18.369-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:18.732-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (38308 records 393761090 bytes) are inconsistent with full validation results (44601 records 458477888 bytes). Updating counters with new values. 2015-03-02T12:41:18.732-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (38683 records 397618340 bytes) is inconsistent with full validation results (44601 records 458477888 bytes). Updating size storer with new values. 2015-03-02T12:41:18.732-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:18.752-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:18.763-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 394ms 2015-03-02T12:41:18.786-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:19.114-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T12:41:19.118-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (41108 records 422535890 bytes) are inconsistent with full validation results (38568 records 396422450 bytes). Updating counters with new values. 2015-03-02T12:41:19.118-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (41312 records 424638550 bytes) is inconsistent with full validation results (38568 records 396422450 bytes). Updating size storer with new values. 2015-03-02T12:41:19.118-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:19.130-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:19.140-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 353ms 2015-03-02T12:41:19.166-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:19.401-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (35088 records 360627170 bytes) are inconsistent with full validation results (35221 records 361982208 bytes). Updating counters with new values. 2015-03-02T12:41:19.401-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (35436 records 364206698 bytes) is inconsistent with full validation results (35221 records 361982208 bytes). Updating size storer with new values. 2015-03-02T12:41:19.401-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:19.415-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:19.422-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 256ms 2015-03-02T12:41:19.440-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:41:19.644-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (32348 records 332430530 bytes) are inconsistent with full validation results (31846 records 327266958 bytes). Updating counters with new values. 2015-03-02T12:41:19.644-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32569 records 334703736 bytes) is inconsistent with full validation results (31846 records 327266958 bytes). Updating size storer with new values. 2015-03-02T12:41:19.644-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:41:19.655-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:41:19.661-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 220ms 2015-03-02T12:41:20.092-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 6452.0 } } ndeleted:31933 keyUpdates:0 writeConflicts:0 numYields:253 locks:{} 2117ms 2015-03-02T12:41:20.092-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6452.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2117ms 2015-03-02T12:41:20.097-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:41:20.223-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (24750 records 254287742 bytes) are inconsistent with full validation results (22366 records 229765918 bytes). Updating counters with new values. 2015-03-02T12:41:20.223-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25067 records 257538164 bytes) is inconsistent with full validation results (22366 records 229765918 bytes). Updating size storer with new values. 2015-03-02T12:41:20.223-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:41:20.227-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:41:20.232-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 134ms 2015-03-02T12:41:20.240-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:41:20.323-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:41:20.331-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:41:20.338-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:41:20.385-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:41:20.387-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:41:20.736-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 3370.0 } } ndeleted:6712 keyUpdates:0 writeConflicts:0 numYields:53 locks:{} 344ms 2015-03-02T12:41:20.736-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3370.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 344ms 2015-03-02T12:41:20.739-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:41:20.977-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:41:20.979-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (17654 records 181359542 bytes) are inconsistent with full validation results (16654 records 171086542 bytes). Updating counters with new values. 2015-03-02T12:41:20.979-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17625 records 181061625 bytes) is inconsistent with full validation results (16654 records 171086542 bytes). Updating size storer with new values. 2015-03-02T12:41:20.983-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:41:20.989-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:41:20.996-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 257ms 2015-03-02T12:41:23.838-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:41:23.842-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:41:24.143-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24654 records 253270542 bytes) are inconsistent with full validation results (25198 records 258859054 bytes). Updating counters with new values. 2015-03-02T12:41:24.143-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (24625 records 252972625 bytes) is inconsistent with full validation results (25198 records 258859054 bytes). Updating size storer with new values. 2015-03-02T12:41:24.143-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:41:24.152-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:41:24.157-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 314ms 2015-03-02T12:41:24.485-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3856.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:8288 nscannedObjects:8288 nMatched:4144 nModified:4144 keyUpdates:1 writeConflicts:0 numYields:66 locks:{} 325ms 2015-03-02T12:41:24.485-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3856.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 326ms 2015-03-02T12:41:24.487-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:41:24.548-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (25198 records 258912926 bytes) are inconsistent with full validation results (25654 records 263597414 bytes). Updating counters with new values. 2015-03-02T12:41:24.548-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (25198 records 258910677 bytes) is inconsistent with full validation results (25654 records 263597414 bytes). Updating size storer with new values. 2015-03-02T12:41:24.548-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:41:24.551-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:41:25.744-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:41:26.423-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:41:27.144-0500 I NETWORK [conn1] end connection 10.4.127.218:49407 (2 connections now open) 2015-03-02T12:41:27.173-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49414 #5 (3 connections now open) 2015-03-02T12:41:27.184-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:41:27.482-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (33373 records 342894701 bytes) are inconsistent with full validation results (32654 records 335508414 bytes). Updating counters with new values. 2015-03-02T12:41:27.482-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (32481 records 333731185 bytes) is inconsistent with full validation results (32654 records 335508414 bytes). Updating size storer with new values. 2015-03-02T12:41:27.482-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:41:27.494-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:41:27.505-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 321ms 2015-03-02T12:41:27.517-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:41:27.528-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:41:27.617-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:41:27.694-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (33935 records 348668127 bytes) are inconsistent with full validation results (33669 records 345935509 bytes). Updating counters with new values. 2015-03-02T12:41:27.694-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (33762 records 346890898 bytes) is inconsistent with full validation results (33669 records 345935509 bytes). Updating size storer with new values. 2015-03-02T12:41:27.694-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:41:27.704-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:41:27.720-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 203ms 2015-03-02T12:41:29.044-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:41:30.539-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:41:30.942-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:41:31.918-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:41:32.183-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:41:33.489-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:41:33.784-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49416 #6 (4 connections now open) 2015-03-02T12:41:33.813-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:41:33.817-0500 I NETWORK [conn3] end connection 10.4.127.218:49409 (3 connections now open) 2015-03-02T12:41:35.483-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:41:36.346-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 1144.0 } } ndeleted:39880 keyUpdates:0 writeConflicts:0 numYields:318 locks:{} 2544ms 2015-03-02T12:41:36.346-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1144.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2544ms 2015-03-02T12:41:36.352-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:41:36.621-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (13789 records 141654397 bytes) are inconsistent with full validation results (14774 records 151773302 bytes). Updating counters with new values. 2015-03-02T12:41:36.621-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (13842 records 142199555 bytes) is inconsistent with full validation results (14774 records 151773302 bytes). Updating size storer with new values. 2015-03-02T12:41:36.621-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:41:36.655-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:41:36.678-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 325ms 2015-03-02T12:41:36.757-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:41:36.797-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (15721 records 161501833 bytes) is inconsistent with full validation results (15774 records 162046302 bytes). Updating size storer with new values. 2015-03-02T12:41:36.797-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:41:36.801-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:41:36.808-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:41:36.907-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (16021 records 164583733 bytes) are inconsistent with full validation results (15774 records 162046302 bytes). Updating counters with new values. 2015-03-02T12:41:36.908-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:41:36.912-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:41:36.914-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 106ms 2015-03-02T12:41:36.948-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:41:37.950-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:41:38.516-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:41:38.703-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19527 records 200600871 bytes) are inconsistent with full validation results (19774 records 203138302 bytes). Updating counters with new values. 2015-03-02T12:41:38.703-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19474 records 200056402 bytes) is inconsistent with full validation results (19774 records 203138302 bytes). Updating size storer with new values. 2015-03-02T12:41:38.703-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:41:38.709-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:41:38.717-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 200ms 2015-03-02T12:42:06.288-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] MongoDB starting : pid=2500 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:42:06.300-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:42:06.300-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:42:06.338-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:42:06.395-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:42:08.275-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49428 #1 (1 connection now open) 2015-03-02T12:42:10.730-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1179.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:60786 nscannedObjects:60786 nMatched:30393 nModified:30393 keyUpdates:1 writeConflicts:0 numYields:475 locks:{} 2446ms 2015-03-02T12:42:10.730-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1179.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2447ms 2015-03-02T12:42:10.734-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:42:10.939-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:42:10.945-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:42:10.954-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 220ms 2015-03-02T12:42:12.239-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49445 #2 (2 connections now open) 2015-03-02T12:42:12.993-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:42:13.780-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49446 #3 (3 connections now open) 2015-03-02T12:42:13.821-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:42:14.329-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:42:14.343-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:42:14.349-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 lock2015-03-02T12:43:16.886-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:43:16.894-0500 I CONTROL [initandlisten] MongoDB starting : pid=2638 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:43:16.895-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:43:16.895-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:43:16.936-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:43:16.978-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:43:17.873-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49498 #1 (1 connection now open) 2015-03-02T12:43:22.820-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49500 #2 (2 connections now open) 2015-03-02T12:43:22.831-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:43:23.415-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (41300 records 424419152 bytes) is inconsistent with full validation results (42299 records 434681879 bytes). Updating size storer with new values. 2015-03-02T12:43:23.416-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:43:23.421-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:43:23.425-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 593ms 2015-03-02T12:43:24.420-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 2213.0 } } ndeleted:30796 keyUpdates:0 writeConflicts:0 numYields:240 locks:{} 989ms 2015-03-02T12:43:24.420-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2213.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 989ms 2015-03-02T12:43:24.422-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:43:24.469-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13298 records 136610449 bytes) is inconsistent with full validation results (12503 records 128443319 bytes). Updating size storer with new values. 2015-03-02T12:43:24.469-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:43:24.476-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:43:25.284-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 608.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:18494 nscannedObjects:18494 nMatched:9247 nModified:9247 keyUpdates:1 writeConflicts:0 numYields:145 locks:{} 798ms 2015-03-02T12:43:25.284-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 608.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 798ms 2015-03-02T12:43:25.287-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:43:25.343-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13503 records 138835984 bytes) is inconsistent with full validation results (13503 records 138836530 bytes). Updating size storer with new values. 2015-03-02T12:43:25.343-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:43:25.348-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:43:26.376-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49501 #3 (3 connections now open) 2015-03-02T12:43:26.791-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:43:27.418-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3809.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20494 nscannedObjects:20494 nMatched:10247 nModified:10247 keyUpdates:1 writeConflicts:0 numYields:163 locks:{} 1029ms 2015-03-02T12:43:27.418-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3809.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1029ms 2015-03-02T12:43:27.421-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:43:27.527-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:43:27.530-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:43:27.541-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 119ms 2015-03-02T12:43:27.550-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:43:27.651-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:43:27.656-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:43:27.658-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 107ms 2015-03-02T12:43:27.804-0500 I NETWORK [conn2] end connection 10.4.127.218:49500 (2 connections now open) 2015-03-02T12:43:27.818-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49502 #4 (3 connections now open) 2015-03-02T12:43:27.838-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:27.897-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17214 records 176972633 bytes) is inconsistent with full validation results (17503 records 179941530 bytes). Updating size storer with new values. 2015-03-02T12:43:27.897-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:27.900-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:27.906-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:27.945-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:27.948-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:27.956-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:28.015-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (17794 records 182930973 bytes) are inconsistent with full validation results (17503 records 179941530 bytes). Updating counters with new values. 2015-03-02T12:43:28.015-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:28.020-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:29.231-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4598.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22494 nscannedObjects:22494 nMatched:11247 nModified:11247 keyUpdates:1 writeConflicts:0 numYields:182 locks:{} 1203ms 2015-03-02T12:43:29.231-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4598.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1203ms 2015-03-02T12:43:29.234-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:29.273-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18212 records 187238087 bytes) are inconsistent with full validation results (18503 records 190227530 bytes). Updating counters with new values. 2015-03-02T12:43:29.273-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18212 records 187238087 bytes) is inconsistent with full validation results (18503 records 190227530 bytes). Updating size storer with new values. 2015-03-02T12:43:29.273-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:29.280-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:29.311-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:29.419-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19450 records 199956061 bytes) are inconsistent with full validation results (18503 records 190227530 bytes). Updating counters with new values. 2015-03-02T12:43:29.419-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18967 records 194994202 bytes) is inconsistent with full validation results (18503 records 190227530 bytes). Updating size storer with new values. 2015-03-02T12:43:29.421-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:29.426-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:29.431-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 119ms 2015-03-02T12:43:29.482-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 184ms 2015-03-02T12:43:29.486-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:29.529-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 172ms 2015-03-02T12:43:29.612-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17990 records 184957481 bytes) are inconsistent with full validation results (19596 records 201455919 bytes). Updating counters with new values. 2015-03-02T12:43:29.612-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18092 records 186005327 bytes) is inconsistent with full validation results (19596 records 201455919 bytes). Updating size storer with new values. 2015-03-02T12:43:29.613-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:29.620-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:29.622-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T12:43:30.084-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 2200.0 } } ndeleted:239 keyUpdates:0 writeConflicts:34 numYields:53 locks:{} 648ms 2015-03-02T12:43:30.084-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2200.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 648ms 2015-03-02T12:43:30.086-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.089-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 8598.0 } } ndeleted:0 keyUpdates:0 writeConflicts:54 numYields:33 locks:{} 460ms 2015-03-02T12:43:30.089-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8598.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 460ms 2015-03-02T12:43:30.092-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:30.143-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (8115 records 83365395 bytes) are inconsistent with full validation results (7456 records 76595488 bytes). Updating counters with new values. 2015-03-02T12:43:30.143-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (8698 records 89362133 bytes) is inconsistent with full validation results (7456 records 76595488 bytes). Updating size storer with new values. 2015-03-02T12:43:30.143-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.148-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:30.159-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:30.161-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.170-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.197-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (7456 records 76595488 bytes) is inconsistent with full validation results (7457 records 76595534 bytes). Updating size storer with new values. 2015-03-02T12:43:30.197-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.198-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.205-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.226-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.227-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.232-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.250-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.251-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.255-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.296-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.297-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.307-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.346-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.351-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.359-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.400-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.401-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.414-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.453-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.454-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.465-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.506-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (7457 records 76595534 bytes) is inconsistent with full validation results (7456 records 76595488 bytes). Updating size storer with new values. 2015-03-02T12:43:30.506-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.518-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.528-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.570-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.575-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.585-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.622-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.627-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.635-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.677-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.681-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.688-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.718-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.724-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.758-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:30.811-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (7745 records 79564385 bytes) are inconsistent with full validation results (7303 records 75023719 bytes). Updating counters with new values. 2015-03-02T12:43:30.811-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (7509 records 77139957 bytes) is inconsistent with full validation results (7303 records 75023719 bytes). Updating size storer with new values. 2015-03-02T12:43:30.811-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:30.814-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:30.854-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:43:33.153-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:43:33.155-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:43:33.161-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:43:34.399-0500 I NETWORK [conn3] end connection 10.4.127.218:49501 (2 connections now open) 2015-03-02T12:43:34.426-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49503 #5 (3 connections now open) 2015-03-02T12:43:34.435-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:43:34.678-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (15833 records 162652409 bytes) are inconsistent with full validation results (16275 records 167193075 bytes). Updating counters with new values. 2015-03-02T12:43:34.678-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (15067 records 154783291 bytes) is inconsistent with full validation results (16275 records 167193075 bytes). Updating size storer with new values. 2015-03-02T12:43:34.679-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:43:34.690-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:43:34.692-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 257ms 2015-03-02T12:43:34.809-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:43:35.113-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:43:35.123-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3553.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5788 nscannedObjects:5788 nMatched:2894 nModified:2894 keyUpdates:1 writeConflicts:0 numYields:48 locks:{} 424ms 2015-03-02T12:43:35.123-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3553.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 424ms 2015-03-02T12:43:35.125-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:43:35.213-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17931 records 184238677 bytes) is inconsistent with full validation results (18275 records 187776697 bytes). Updating size storer with new values. 2015-03-02T12:43:35.213-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:43:35.223-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:43:35.230-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T12:43:35.667-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:43:36.807-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:43:38.458-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:38.716-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:43:38.725-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (27275 records 280233697 bytes) are inconsistent with full validation results (26275 records 269960697 bytes). Updating counters with new values. 2015-03-02T12:43:38.725-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26615 records 273453517 bytes) is inconsistent with full validation results (26275 records 269960697 bytes). Updating size storer with new values. 2015-03-02T12:43:38.725-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:38.731-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:38.735-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 276ms 2015-03-02T12:43:39.291-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4624.0 } } ndeleted:7894 keyUpdates:0 writeConflicts:0 numYields:63 locks:{} 551ms 2015-03-02T12:43:39.291-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4624.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 552ms 2015-03-02T12:43:39.294-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:39.436-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (19381 records 199101013 bytes) are inconsistent with full validation results (20381 records 209374013 bytes). Updating counters with new values. 2015-03-02T12:43:39.436-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19935 records 204799457 bytes) is inconsistent with full validation results (20381 records 209374013 bytes). Updating size storer with new values. 2015-03-02T12:43:39.436-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:39.444-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:39.448-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 153ms 2015-03-02T12:43:39.473-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:39.580-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:39.587-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:39.592-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 118ms 2015-03-02T12:43:40.050-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2633.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:8300 nscannedObjects:8300 nMatched:4150 nModified:4150 keyUpdates:1 writeConflicts:0 numYields:68 locks:{} 452ms 2015-03-02T12:43:40.050-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2633.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 453ms 2015-03-02T12:43:40.052-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:40.121-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21381 records 219691811 bytes) is inconsistent with full validation results (21381 records 219700963 bytes). Updating size storer with new values. 2015-03-02T12:43:40.122-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:40.124-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:40.468-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8574.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:8300 nscannedObjects:8300 nMatched:4150 nModified:4150 keyUpdates:1 writeConflicts:0 numYields:65 locks:{} 338ms 2015-03-02T12:43:40.468-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8574.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 338ms 2015-03-02T12:43:40.471-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:40.529-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:40.545-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:40.834-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 5039.0 } } ndeleted:4150 keyUpdates:0 writeConflicts:0 numYields:33 locks:{} 279ms 2015-03-02T12:43:40.834-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5039.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 279ms 2015-03-02T12:43:40.836-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:40.878-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17235 records 177055207 bytes) is inconsistent with full validation results (17231 records 177014063 bytes). Updating size storer with new values. 2015-03-02T12:43:40.878-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:40.884-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:40.901-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:40.938-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17231 records 177014063 bytes) is inconsistent with full validation results (17232 records 177014109 bytes). Updating size storer with new values. 2015-03-02T12:43:40.938-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:40.941-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:40.947-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:41.021-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:41.023-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:41.027-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:41.081-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:41.090-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:41.107-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:41.186-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (18141 records 186352266 bytes) are inconsistent with full validation results (17245 records 177147658 bytes). Updating counters with new values. 2015-03-02T12:43:41.186-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17232 records 177014109 bytes) is inconsistent with full validation results (17245 records 177147658 bytes). Updating size storer with new values. 2015-03-02T12:43:41.187-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:41.191-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:41.196-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:41.273-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17336 records 178082501 bytes) are inconsistent with full validation results (18232 records 187287109 bytes). Updating counters with new values. 2015-03-02T12:43:41.273-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17331 records 178031136 bytes) is inconsistent with full validation results (18232 records 187287109 bytes). Updating size storer with new values. 2015-03-02T12:43:41.273-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:41.280-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:41.419-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:43:41.597-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2534.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5642 nscannedObjects:5642 nMatched:2821 nModified:2821 keyUpdates:1 writeConflicts:0 numYields:46 locks:{} 309ms 2015-03-02T12:43:41.597-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2534.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 309ms 2015-03-02T12:43:41.600-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:41.718-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19232 records 197586044 bytes) is inconsistent with full validation results (19232 records 197596769 bytes). Updating size storer with new values. 2015-03-02T12:43:41.718-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:41.721-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:41.723-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 123ms 2015-03-02T12:43:41.838-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4068.0 } } ndeleted:2821 keyUpdates:0 writeConflicts:0 numYields:22 locks:{} 113ms 2015-03-02T12:43:41.838-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4068.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:43:41.843-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:43:41.913-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17058 records 175235005 bytes) is inconsistent with full validation results (16411 records 168590203 bytes). Updating size storer with new values. 2015-03-02T12:43:41.914-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:43:41.919-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:43:42.919-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:43:43.878-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:43:47.131-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:43:47.846-0500 I NETWORK [conn1] end connection 10.4.127.218:49498 (2 connections now open) 2015-03-02T12:43:47.880-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:43:47.888-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49505 #6 (3 connections now open) 2015-03-02T12:43:48.193-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (31764 records 326311572 bytes) is inconsistent with full validation results (32411 records 332958203 bytes). Updating size storer with new values. 2015-03-02T12:43:48.193-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:43:48.203-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:43:48.208-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 309ms 2015-03-02T12:43:48.209-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 328ms 2015-03-02T12:43:48.215-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:43:48.220-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:43:48.366-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:43:48.368-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:43:48.373-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:43:48.375-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:43:48.380-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T12:43:48.380-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 165ms 2015-03-02T12:43:49.042-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T12:43:49.045-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:49.282-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (33411 records 343348099 bytes) are inconsistent with full validation results (33411 records 343329431 bytes). Updating counters with new values. 2015-03-02T12:43:49.282-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (33411 records 343339792 bytes) is inconsistent with full validation results (33411 records 343329431 bytes). Updating size storer with new values. 2015-03-02T12:43:49.285-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:49.296-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:49.312-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 266ms 2015-03-02T12:43:49.330-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:49.485-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 5741.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:19554 nscannedObjects:19554 nMatched:9777 nModified:9777 keyUpdates:1 writeConflicts:0 numYields:159 locks:{} 1096ms 2015-03-02T12:43:49.485-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5741.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1101ms 2015-03-02T12:43:49.489-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:43:49.500-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (33411 records 343339636 bytes) are inconsistent with full validation results (33411 records 343351219 bytes). Updating counters with new values. 2015-03-02T12:43:49.500-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (33411 records 343334124 bytes) is inconsistent with full validation results (33411 records 343351219 bytes). Updating size storer with new values. 2015-03-02T12:43:49.501-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:49.512-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:49.517-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 187ms 2015-03-02T12:43:49.526-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:49.638-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (33411 records 343351219 bytes) are inconsistent with full validation results (33411 records 343358304 bytes). Updating counters with new values. 2015-03-02T12:43:49.638-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (33411 records 343351219 bytes) is inconsistent with full validation results (33411 records 343358304 bytes). Updating size storer with new values. 2015-03-02T12:43:49.638-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:43:49.654-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:43:49.659-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 169ms 2015-03-02T12:43:49.671-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:43:49.678-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:49.693-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:49.701-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 174ms 2015-03-02T12:43:49.715-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:49.843-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:43:49.852-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:43:49.858-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 186ms 2015-03-02T12:43:49.880-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:49.894-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:49.904-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 189ms 2015-03-02T12:43:49.914-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:50.072-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:50.079-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:50.085-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 171ms 2015-03-02T12:43:50.107-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:50.276-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:50.292-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:50.301-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 193ms 2015-03-02T12:43:50.521-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 193ms 2015-03-02T12:43:51.343-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 5769.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:19554 nscannedObjects:19554 nMatched:9777 nModified:9777 keyUpdates:1 writeConflicts:0 numYields:162 locks:{} 1475ms 2015-03-02T12:43:51.343-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5769.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1476ms 2015-03-02T12:43:51.354-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:43:51.541-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (24160 records 248322781 bytes) are inconsistent with full validation results (26221 records 269495434 bytes). Updating counters with new values. 2015-03-02T12:43:51.541-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (24612 records 252966177 bytes) is inconsistent with full validation results (26221 records 269495434 bytes). Updating size storer with new values. 2015-03-02T12:43:51.541-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:43:51.566-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:43:51.574-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 220ms 2015-03-02T12:43:52.091-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 800.0 } } ndeleted:24355 keyUpdates:0 writeConflicts:0 numYields:195 locks:{} 1786ms 2015-03-02T12:43:52.091-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 800.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1786ms 2015-03-02T12:43:52.095-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.213-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (12117 records 124477941 bytes) are inconsistent with full validation results (10056 records 103305288 bytes). Updating counters with new values. 2015-03-02T12:43:52.214-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12673 records 130196957 bytes) is inconsistent with full validation results (10056 records 103305288 bytes). Updating size storer with new values. 2015-03-02T12:43:52.214-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.221-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.231-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 135ms 2015-03-02T12:43:52.237-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.259-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.261-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.264-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.291-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.293-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.304-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.347-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10056 records 103305288 bytes) is inconsistent with full validation results (10057 records 103305334 bytes). Updating size storer with new values. 2015-03-02T12:43:52.348-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.349-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.354-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.374-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10057 records 103305334 bytes) is inconsistent with full validation results (10056 records 103305288 bytes). Updating size storer with new values. 2015-03-02T12:43:52.374-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.376-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.381-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.412-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.416-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.420-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.441-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.443-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.448-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.495-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.503-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:52.514-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:43:52.587-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (10259 records 105390707 bytes) are inconsistent with full validation results (10056 records 103305288 bytes). Updating counters with new values. 2015-03-02T12:43:52.587-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:43:52.589-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:43:57.804-0500 I NETWORK [conn4] end connection 10.4.127.218:49502 (2 connections now open) 2015-03-02T12:43:57.834-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49513 #7 (3 connections now open) 2015-03-02T12:43:57.851-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T12:43:58.009-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:44:22.922-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:44:22.938-0500 I CONTROL [initandlisten] MongoDB starting : pid=1274 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:44:22.938-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:44:22.938-0500 I CONTROL [initandlisten] 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:44:22.941-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:44:22.949-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:44:23.018-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:44:23.018-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:44:23.018-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:44:23.101-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:44:27.216-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49518 #1 (1 connection now open) 2015-03-02T12:44:29.556-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49519 #2 (2 connections now open) 2015-03-02T12:44:29.577-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:44:30.795-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49520 #3 (3 connections now open) 2015-03-02T12:44:31.862-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (43299 records 444954879 bytes) are inconsistent with full validation results (42299 records 434681879 bytes). Updating counters with new values. 2015-03-02T12:44:31.862-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42300 records 434692152 bytes) is inconsistent with full validation results (42299 records 434681879 bytes). Updating size storer with new values. 2015-03-02T12:44:31.863-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:44:31.870-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:44:31.877-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a17e93d6600ad51fdcca'), x: 6000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database: { acquireCount: { w: 1 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 1218158 } }, Collection: { acquireCount: { w: 1 } } } 718ms 2015-03-02T12:44:31.878-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1074ms 2015-03-02T12:44:31.881-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2303ms 2015-03-02T12:44:31.976-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 829ms 2015-03-02T12:44:33.113-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:44:33.812-0500 I NETWORK [conn2] end connection 10.4.127.218:49519 (2 connections now open) 2015-03-02T12:44:33.835-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49522 #4 (3 connections now open) 2015-03-02T12:44:33.874-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:44:34.124-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (44299 records 455411348 bytes) are inconsistent with full validation results (45299 records 465664003 bytes). Updating counters with new values. 2015-03-02T12:44:34.124-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (44299 records 455409892 bytes) is inconsistent with full validation results (45299 records 465664003 bytes). Updating size storer with new values. 2015-03-02T12:44:34.124-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:44:34.135-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:44:34.143-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 268ms 2015-03-02T12:44:34.526-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:44:36.092-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 235ms 2015-03-02T12:44:36.096-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:36.603-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486300964 bytes) are inconsistent with full validation results (47299 records 486321309 bytes). Updating counters with new values. 2015-03-02T12:44:36.603-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486300964 bytes) is inconsistent with full validation results (47299 records 486321309 bytes). Updating size storer with new values. 2015-03-02T12:44:36.603-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:36.626-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:36.651-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 554ms 2015-03-02T12:44:37.709-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3014.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:77847 nscannedObjects:77847 nMatched:32994 nModified:32994 keyUpdates:1 writeConflicts:173 numYields:656 locks:{} 5824ms 2015-03-02T12:44:37.709-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3014.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5824ms 2015-03-02T12:44:37.713-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:38.210-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:38.231-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:38.252-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 538ms 2015-03-02T12:44:40.169-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 2563.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:83464 nscannedObjects:83464 nMatched:34175 nModified:34175 keyUpdates:1 writeConflicts:474 numYields:695 locks:{} 6016ms 2015-03-02T12:44:40.169-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2563.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6017ms 2015-03-02T12:44:40.174-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:44:40.529-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (31472 records 323547563 bytes) are inconsistent with full validation results (34432 records 353994123 bytes). Updating counters with new values. 2015-03-02T12:44:40.529-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (31472 records 323547563 bytes) is inconsistent with full validation results (34432 records 353994123 bytes). Updating size storer with new values. 2015-03-02T12:44:40.529-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:44:40.545-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:44:40.560-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 385ms 2015-03-02T12:44:40.916-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8571.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53862 nscannedObjects:53862 nMatched:26489 nModified:26489 keyUpdates:1 writeConflicts:428 numYields:453 locks:{} 4255ms 2015-03-02T12:44:40.919-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8571.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4258ms 2015-03-02T12:44:40.921-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:41.052-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (28250 records 290406071 bytes) are inconsistent with full validation results (27460 records 282280131 bytes). Updating counters with new values. 2015-03-02T12:44:41.052-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (28960 records 297709131 bytes) is inconsistent with full validation results (27460 records 282280131 bytes). Updating size storer with new values. 2015-03-02T12:44:41.054-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:41.063-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:41.074-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 153ms 2015-03-02T12:44:41.084-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:41.228-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (25067 records 257665733 bytes) are inconsistent with full validation results (24705 records 253942201 bytes). Updating counters with new values. 2015-03-02T12:44:41.228-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (25170 records 258725191 bytes) is inconsistent with full validation results (24705 records 253942201 bytes). Updating size storer with new values. 2015-03-02T12:44:41.230-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:41.241-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:41.246-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 161ms 2015-03-02T12:44:41.255-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:41.383-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22701 records 233329057 bytes) are inconsistent with full validation results (22460 records 230850131 bytes). Updating counters with new values. 2015-03-02T12:44:41.383-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22826 records 234614807 bytes) is inconsistent with full validation results (22460 records 230850131 bytes). Updating size storer with new values. 2015-03-02T12:44:41.383-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:41.395-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:41.402-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 146ms 2015-03-02T12:44:41.413-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:41.515-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (20629 records 212016465 bytes) are inconsistent with full validation results (20457 records 210247273 bytes). Updating counters with new values. 2015-03-02T12:44:41.515-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21585 records 221849881 bytes) is inconsistent with full validation results (20457 records 210247273 bytes). Updating size storer with new values. 2015-03-02T12:44:41.515-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:41.524-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:41.528-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 114ms 2015-03-02T12:44:41.999-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 4201.0 } } ndeleted:21500 keyUpdates:0 writeConflicts:129 numYields:247 locks:{} 3734ms 2015-03-02T12:44:41.999-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4201.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3734ms 2015-03-02T12:44:42.002-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.007-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5674.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2687 nscannedObjects:2687 nMatched:1 nModified:1 upsert:1 keyUpdates:0 writeConflicts:5352 numYields:26 locks:{} 475ms 2015-03-02T12:44:42.007-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5674.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:106 locks:{} 475ms 2015-03-02T12:44:42.010-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:42.085-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (13967 records 143491133 bytes) are inconsistent with full validation results (12553 records 128956969 bytes). Updating counters with new values. 2015-03-02T12:44:42.085-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (14413 records 148078689 bytes) is inconsistent with full validation results (12553 records 128956969 bytes). Updating size storer with new values. 2015-03-02T12:44:42.086-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.089-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (12553 records 128956969 bytes) are inconsistent with full validation results (12554 records 128957015 bytes). Updating counters with new values. 2015-03-02T12:44:42.090-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (12553 records 128956969 bytes) is inconsistent with full validation results (12554 records 128957015 bytes). Updating size storer with new values. 2015-03-02T12:44:42.090-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:42.096-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.098-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:42.105-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.115-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:42.163-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.165-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:42.168-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.170-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:42.178-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.217-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.221-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.227-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.260-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.264-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.535-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1839.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4345 nscannedObjects:4345 nMatched:2173 nModified:2173 keyUpdates:1 writeConflicts:0 numYields:36 locks:{} 264ms 2015-03-02T12:44:42.535-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1839.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 264ms 2015-03-02T12:44:42.537-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.598-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12554 records 128977152 bytes) is inconsistent with full validation results (12554 records 128985251 bytes). Updating size storer with new values. 2015-03-02T12:44:42.598-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.605-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.618-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.685-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.688-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.701-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.729-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.731-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.736-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:42.789-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:42.796-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:42.899-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:44:42.989-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 4159.0 } } ndeleted:2173 keyUpdates:0 writeConflicts:0 numYields:17 locks:{} 185ms 2015-03-02T12:44:42.989-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4159.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 186ms 2015-03-02T12:44:42.991-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:44:43.076-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12178 records 125104715 bytes) is inconsistent with full validation results (11381 records 116917013 bytes). Updating size storer with new values. 2015-03-02T12:44:43.077-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:44:43.079-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:44:43.939-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:44:45.081-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:44:45.161-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:44:46.903-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T12:44:47.271-0500 I NETWORK [conn3] end connection 10.4.127.218:49520 (2 connections now open) 2015-03-02T12:44:47.294-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49527 #5 (3 connections now open) 2015-03-02T12:44:47.309-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:44:47.544-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:44:47.685-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (24382 records 250466059 bytes) are inconsistent with full validation results (23382 records 240193059 bytes). Updating counters with new values. 2015-03-02T12:44:47.685-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (23584 records 242268205 bytes) is inconsistent with full validation results (23382 records 240193059 bytes). Updating size storer with new values. 2015-03-02T12:44:47.685-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:44:47.693-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:44:47.700-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 390ms 2015-03-02T12:44:48.509-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:44:49.365-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:44:49.706-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:49.871-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (28382 records 291558059 bytes) are inconsistent with full validation results (29382 records 301831059 bytes). Updating counters with new values. 2015-03-02T12:44:49.871-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (27584 records 283360205 bytes) is inconsistent with full validation results (29382 records 301831059 bytes). Updating size storer with new values. 2015-03-02T12:44:49.872-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:49.876-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:49.882-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 175ms 2015-03-02T12:44:49.888-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:49.984-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:49.988-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:49.991-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 103ms 2015-03-02T12:44:49.995-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:50.089-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:50.094-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:50.097-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 101ms 2015-03-02T12:44:50.100-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:50.188-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:50.192-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:50.202-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:50.295-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:50.302-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:50.308-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 106ms 2015-03-02T12:44:50.524-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 5894.0 } } ndeleted:5213 keyUpdates:0 writeConflicts:0 numYields:40 locks:{} 213ms 2015-03-02T12:44:50.524-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5894.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 213ms 2015-03-02T12:44:50.526-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:44:50.617-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (24669 records 253424637 bytes) are inconsistent with full validation results (24169 records 248288137 bytes). Updating counters with new values. 2015-03-02T12:44:50.617-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (24180 records 248390913 bytes) is inconsistent with full validation results (24169 records 248288137 bytes). Updating size storer with new values. 2015-03-02T12:44:50.617-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:44:50.633-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:44:50.645-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 119ms 2015-03-02T12:44:51.696-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:44:52.603-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:44:52.605-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:44:52.952-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (29669 records 304789637 bytes) are inconsistent with full validation results (30169 records 309926137 bytes). Updating counters with new values. 2015-03-02T12:44:52.952-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (29658 records 304676634 bytes) is inconsistent with full validation results (30169 records 309926137 bytes). Updating size storer with new values. 2015-03-02T12:44:52.952-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:44:52.961-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:44:52.977-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 371ms 2015-03-02T12:44:52.984-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:44:53.122-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:44:53.175-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (31169 records 320199137 bytes) are inconsistent with full validation results (30169 records 309926137 bytes). Updating counters with new values. 2015-03-02T12:44:53.175-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (31158 records 320086134 bytes) is inconsistent with full validation results (30169 records 309926137 bytes). Updating size storer with new values. 2015-03-02T12:44:53.175-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:44:53.185-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:44:53.190-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 206ms 2015-03-02T12:44:53.202-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:44:53.370-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (31169 records 320199137 bytes) are inconsistent with full validation results (31501 records 323609773 bytes). Updating counters with new values. 2015-03-02T12:44:53.370-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (31158 records 320086134 bytes) is inconsistent with full validation results (31501 records 323609773 bytes). Updating size storer with new values. 2015-03-02T12:44:53.370-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:44:53.381-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:44:53.387-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 185ms 2015-03-02T12:44:54.629-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:44:55.072-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:44:55.872-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T12:44:55.880-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:44:57.059-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T12:44:57.204-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:44:57.227-0500 I NETWORK [conn1] end connection 10.4.127.218:49518 (2 connections now open) 2015-03-02T12:44:57.254-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49539 #6 (3 connections now open) 2015-03-02T12:44:58.771-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:44:59.201-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:44:59.208-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 2779.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29786 nscannedObjects:29786 nMatched:14893 nModified:14893 keyUpdates:1 writeConflicts:0 numYields:248 locks:{} 1943ms 2015-03-02T12:44:59.208-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2779.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1943ms 2015-03-02T12:44:59.214-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:44:59.575-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (42501 records 436806382 bytes) are inconsistent with full validation results (43169 records 443668746 bytes). Updating counters with new values. 2015-03-02T12:44:59.575-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (41597 records 427519590 bytes) is inconsistent with full validation results (43169 records 443668746 bytes). Updating size storer with new values. 2015-03-02T12:44:59.575-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:44:59.584-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:44:59.604-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 389ms 2015-03-02T12:44:59.628-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:44:59.778-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:44:59.785-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:44:59.789-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 160ms 2015-03-02T12:44:59.795-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:45:00.019-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:2015-03-02T12:45:37.951-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:45:37.966-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:45:37.966-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:45:37.966-0500 I CONTROL [initandlisten] 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:45:37.967-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:45:37.974-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:45:38.043-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:45:38.043-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:45:38.043-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:45:38.132-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:45:41.903-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49583 #1 (1 connection now open) 2015-03-02T12:45:44.290-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49584 #2 (2 connections now open) 2015-03-02T12:45:44.300-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:45:45.508-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49585 #3 (3 connections now open) 2015-03-02T12:45:46.732-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (43299 records 444954879 bytes) are inconsistent with full validation results (42299 records 434681879 bytes). Updating counters with new values. 2015-03-02T12:45:46.732-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42300 records 434692152 bytes) is inconsistent with full validation results (42299 records 434681879 bytes). Updating size storer with new values. 2015-03-02T12:45:46.732-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:45:46.738-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:45:46.741-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a1c912431d42c4344ea9'), x: 6000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database: { acquireCount: { w: 1 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 249326 } }, Collection: { acquireCount: { w: 1 } } } 249ms 2015-03-02T12:45:46.743-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1227ms 2015-03-02T12:45:46.744-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2443ms 2015-03-02T12:45:46.762-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:45:46.884-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 405ms 2015-03-02T12:45:46.978-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49586 #4 (4 connections now open) 2015-03-02T12:45:47.029-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (43299 records 444974821 bytes) are inconsistent with full validation results (43312 records 445089715 bytes). Updating counters with new values. 2015-03-02T12:45:47.029-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (43299 records 444967892 bytes) is inconsistent with full validation results (43312 records 445089715 bytes). Updating size storer with new values. 2015-03-02T12:45:47.029-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:45:47.039-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:45:47.049-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 286ms 2015-03-02T12:45:47.067-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:45:47.392-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (41402 records 425474174 bytes) are inconsistent with full validation results (44125 records 453461541 bytes). Updating counters with new values. 2015-03-02T12:45:47.393-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (41890 records 430490440 bytes) is inconsistent with full validation results (44125 records 453461541 bytes). Updating size storer with new values. 2015-03-02T12:45:47.393-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:45:47.409-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:45:47.422-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 355ms 2015-03-02T12:45:47.446-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:45:47.723-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (41258 records 423994108 bytes) are inconsistent with full validation results (42057 records 432220448 bytes). Updating counters with new values. 2015-03-02T12:45:47.723-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (41497 records 426451123 bytes) is inconsistent with full validation results (42057 records 432220448 bytes). Updating size storer with new values. 2015-03-02T12:45:47.731-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:45:47.747-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:45:47.758-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 311ms 2015-03-02T12:45:48.599-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 252ms 2015-03-02T12:45:50.015-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 204ms 2015-03-02T12:45:50.320-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 264ms 2015-03-02T12:45:51.574-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 277ms 2015-03-02T12:45:51.579-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:45:51.981-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22255 records 228773104 bytes) are inconsistent with full validation results (21728 records 223348365 bytes). Updating counters with new values. 2015-03-02T12:45:51.981-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22406 records 230324353 bytes) is inconsistent with full validation results (21728 records 223348365 bytes). Updating size storer with new values. 2015-03-02T12:45:51.981-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:45:52.013-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:45:52.034-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 454ms 2015-03-02T12:45:52.060-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:45:52.239-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (21197 records 217876229 bytes) are inconsistent with full validation results (19242 records 197803512 bytes). Updating counters with new values. 2015-03-02T12:45:52.239-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21206 records 217971533 bytes) is inconsistent with full validation results (19242 records 197803512 bytes). Updating size storer with new values. 2015-03-02T12:45:52.239-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:45:52.241-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 188ms 2015-03-02T12:45:52.253-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:45:52.263-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 203ms 2015-03-02T12:45:52.283-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:45:52.434-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (18128 records 186344895 bytes) are inconsistent with full validation results (18963 records 194920718 bytes). Updating counters with new values. 2015-03-02T12:45:52.434-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18565 records 190839877 bytes) is inconsistent with full validation results (18963 records 194920718 bytes). Updating size storer with new values. 2015-03-02T12:45:52.434-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:45:52.444-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:45:52.451-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T12:45:52.470-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:45:52.594-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17794 records 182896384 bytes) are inconsistent with full validation results (17827 records 183235822 bytes). Updating counters with new values. 2015-03-02T12:45:52.594-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17812 records 183081532 bytes) is inconsistent with full validation results (17827 records 183235822 bytes). Updating size storer with new values. 2015-03-02T12:45:52.594-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:45:52.603-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:45:52.610-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 140ms 2015-03-02T12:45:52.622-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:45:52.721-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1060.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:41430 nscannedObjects:41430 nMatched:30489 nModified:30489 keyUpdates:1 writeConflicts:0 numYields:391 locks:{} 5972ms 2015-03-02T12:45:52.722-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1060.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5973ms 2015-03-02T12:45:52.727-0500 I NETWORK [conn3] end connection 10.4.127.218:49585 (3 connections now open) 2015-03-02T12:45:52.733-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16650 records 171129200 bytes) are inconsistent with full validation results (16665 records 171283490 bytes). Updating counters with new values. 2015-03-02T12:45:52.733-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16708 records 171725788 bytes) is inconsistent with full validation results (16665 records 171283490 bytes). Updating size storer with new values. 2015-03-02T12:45:52.734-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:45:52.738-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:45:52.744-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 121ms 2015-03-02T12:45:53.079-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 9100.0 } } ndeleted:39879 keyUpdates:0 writeConflicts:0 numYields:371 locks:{} 6026ms 2015-03-02T12:45:53.079-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9100.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 6026ms 2015-03-02T12:45:53.083-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:45:53.168-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (10356 records 106399356 bytes) are inconsistent with full validation results (9420 records 96771660 bytes). Updating counters with new values. 2015-03-02T12:45:53.168-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10723 records 110164078 bytes) is inconsistent with full validation results (9420 records 96771660 bytes). Updating size storer with new values. 2015-03-02T12:45:53.168-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:45:53.175-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:45:53.182-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:45:53.223-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:45:53.229-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:45:53.910-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:45:54.431-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:45:56.883-0500 I NETWORK [conn1] end connection 10.4.127.218:49583 (2 connections now open) 2015-03-02T12:45:56.923-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49593 #5 (3 connections now open) 2015-03-02T12:45:58.080-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:45:58.618-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:45:59.096-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:45:59.225-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:46:00.023-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:46:00.275-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:46:00.421-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (29420 records 302231660 bytes) are inconsistent with full validation results (27420 records 281685660 bytes). Updating counters with new values. 2015-03-02T12:46:00.421-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (29053 records 298461469 bytes) is inconsistent with full validation results (27420 records 281685660 bytes). Updating size storer with new values. 2015-03-02T12:46:00.426-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:46:00.434-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:46:00.440-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 417ms 2015-03-02T12:46:01.590-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:46:01.593-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:46:02.044-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:46:03.068-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:46:03.509-0500 I NETWORK [conn2] end connection 10.4.127.218:49584 (2 connections now open) 2015-03-02T12:46:03.527-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49597 #6 (3 connections now open) 2015-03-02T12:46:03.534-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:46:03.879-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (34420 records 353596660 bytes) are inconsistent with full validation results (36420 records 374142660 bytes). Updating counters with new values. 2015-03-02T12:46:03.879-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (34053 records 349826469 bytes) is inconsistent with full validation results (36420 records 374142660 bytes). Updating size storer with new values. 2015-03-02T12:46:03.879-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:46:03.885-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:46:03.890-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 355ms 2015-03-02T12:46:03.910-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:46:04.004-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:46:04.009-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:46:04.012-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 102ms 2015-03-02T12:46:04.091-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:46:04.287-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (36246 records 372355158 bytes) are inconsistent with full validation results (35032 records 359883736 bytes). Updating counters with new values. 2015-03-02T12:46:04.287-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (35913 records 368934249 bytes) is inconsistent with full validation results (35032 records 359883736 bytes). Updating size storer with new values. 2015-03-02T12:46:04.287-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:46:04.326-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:46:04.360-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 268ms 2015-03-02T12:46:04.363-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 183ms 2015-03-02T12:46:04.365-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:46:04.596-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (35636 records 366088628 bytes) are inconsistent with full validation results (36850 records 378560050 bytes). Updating counters with new values. 2015-03-02T12:46:04.597-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (35032 records 359883736 bytes) is inconsistent with full validation results (36850 records 378560050 bytes). Updating size storer with new values. 2015-03-02T12:46:04.597-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:46:04.601-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:46:04.604-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 239ms 2015-03-02T12:46:04.614-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:46:04.790-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:46:04.801-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:46:04.804-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 190ms 2015-03-02T12:46:06.895-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:46:06.911-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:46:06.914-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:46:07.342-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (41913 records 430572249 bytes) is inconsistent with full validation results (42850 records 440198050 bytes). Updating size storer with new values. 2015-03-02T12:46:07.343-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:46:07.357-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:46:07.363-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 449ms 2015-03-02T12:46:07.747-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:46:07.751-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:08.010-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (43850 records 450531227 bytes) are inconsistent with full validation results (43850 records 450508230 bytes). Updating counters with new values. 2015-03-02T12:46:08.010-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (43850 records 450523869 bytes) is inconsistent with full validation results (43850 records 450508230 bytes). Updating size storer with new values. 2015-03-02T12:46:08.010-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:08.028-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:08.039-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 287ms 2015-03-02T12:46:08.047-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:08.283-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (43850 records 450530759 bytes) are inconsistent with full validation results (43850 records 450534230 bytes). Updating counters with new values. 2015-03-02T12:46:08.283-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (43850 records 450526872 bytes) is inconsistent with full validation results (43850 records 450534230 bytes). Updating size storer with new values. 2015-03-02T12:46:08.283-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:08.303-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:08.314-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 266ms 2015-03-02T12:46:08.333-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:08.617-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T12:46:08.619-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (44850 records 460833919 bytes) are inconsistent with full validation results (43850 records 450557916 bytes). Updating counters with new values. 2015-03-02T12:46:08.619-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (44674 records 459023583 bytes) is inconsistent with full validation results (43850 records 450557916 bytes). Updating size storer with new values. 2015-03-02T12:46:08.621-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:08.632-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:08.652-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 319ms 2015-03-02T12:46:08.678-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:08.945-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (43850 records 450583578 bytes) are inconsistent with full validation results (44850 records 460858320 bytes). Updating counters with new values. 2015-03-02T12:46:08.945-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (43850 records 450579340 bytes) is inconsistent with full validation results (44850 records 460858320 bytes). Updating size storer with new values. 2015-03-02T12:46:08.945-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:08.957-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:08.966-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 288ms 2015-03-02T12:46:08.977-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:09.148-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (44850 records 460883033 bytes) are inconsistent with full validation results (44850 records 460883202 bytes). Updating counters with new values. 2015-03-02T12:46:09.148-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (44850 records 460880082 bytes) is inconsistent with full validation results (44850 records 460883202 bytes). Updating size storer with new values. 2015-03-02T12:46:09.148-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:09.159-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:09.168-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 191ms 2015-03-02T12:46:09.182-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:09.409-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (44850 records 460908084 bytes) are inconsistent with full validation results (44850 records 460907993 bytes). Updating counters with new values. 2015-03-02T12:46:09.409-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (44850 records 460906251 bytes) is inconsistent with full validation results (44850 records 460907993 bytes). Updating size storer with new values. 2015-03-02T12:46:09.410-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:09.424-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:09.438-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 256ms 2015-03-02T12:46:09.464-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:09.751-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (44850 records 460924880 bytes) are inconsistent with full validation results (44850 records 460932862 bytes). Updating counters with new values. 2015-03-02T12:46:09.751-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (44850 records 460919160 bytes) is inconsistent with full validation results (44850 records 460932862 bytes). Updating size storer with new values. 2015-03-02T12:46:09.751-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:09.768-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:09.783-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 319ms 2015-03-02T12:46:09.797-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4309.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31006 nscannedObjects:31006 nMatched:15503 nModified:15503 keyUpdates:1 writeConflicts:0 numYields:258 locks:{} 2429ms 2015-03-02T12:46:09.797-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4309.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2429ms 2015-03-02T12:46:09.801-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:46:09.812-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:46:10.032-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (44850 records 460932862 bytes) are inconsistent with full validation results (44850 records 460945589 bytes). Updating counters with new values. 2015-03-02T12:46:10.032-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (44850 records 460932862 bytes) is inconsistent with full validation results (44850 records 460945589 bytes). Updating size storer with new values. 2015-03-02T12:46:10.032-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:46:10.041-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:46:10.044-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:46:10.050-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:46:10.051-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 250ms 2015-03-02T12:46:10.058-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 246ms 2015-03-02T12:46:10.061-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:46:10.156-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:46:10.161-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:46:10.165-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 103ms 2015-03-02T12:46:10.173-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:46:10.383-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:46:10.393-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:46:10.397-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 223ms 2015-03-02T12:46:11.308-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:46:11.972-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T12:46:12.683-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 218ms 2015-03-02T12:46:13.496-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:46:13.969-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:46:16.321-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:46:16.323-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:46:16.830-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:46:16.953-0500 I NETWORK [conn4] end connection 10.4.127.218:49586 (2 connections now open) 2015-03-02T12:46:16.993-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49602 #7 (3 connections now open) 2015-03-02T12:46:17.142-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (60850 records 625313589 bytes) are inconsistent with full validation results (59850 records 615040589 bytes). Updating counters with new values. 2015-03-02T12:46:17.142-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (60410 records 620793469 bytes) is inconsistent with full validation results (59850 records 615040589 bytes). Updating size storer with new values. 2015-03-02T12:46:17.142-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:46:17.150-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:46:17.157-0500 I COMMAND [conn7] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 2015-03-02T12:46:42.483-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:46:42.497-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:46:42.497-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:46:42.497-0500 I CONTROL [initandlisten] 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:46:42.501-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:46:42.507-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:46:42.578-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:46:42.578-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:46:42.578-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:46:42.658-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:46:47.273-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49625 #1 (1 connection now open) 2015-03-02T12:46:47.285-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:46:48.840-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49627 #2 (2 connections now open) 2015-03-02T12:46:49.019-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:46:49.025-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:46:49.028-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 184ms 2015-03-02T12:46:49.028-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1742ms 2015-03-02T12:46:49.039-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:46:49.043-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:46:49.165-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:46:49.168-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:46:49.174-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:46:49.176-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:46:49.178-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 134ms 2015-03-02T12:46:49.179-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T12:46:49.193-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:46:49.314-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383319414 bytes) are inconsistent with full validation results (37299 records 383318439 bytes). Updating counters with new values. 2015-03-02T12:46:49.314-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383319414 bytes) is inconsistent with full validation results (37299 records 383318439 bytes). Updating size storer with new values. 2015-03-02T12:46:49.316-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:46:49.322-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:46:49.325-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 131ms 2015-03-02T12:46:51.528-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9805.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39958 nscannedObjects:39958 nMatched:18928 nModified:18928 keyUpdates:1 writeConflicts:16 numYields:323 locks:{} 2343ms 2015-03-02T12:46:51.528-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9805.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2344ms 2015-03-02T12:46:51.531-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:46:51.689-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383407476 bytes) are inconsistent with full validation results (37299 records 383408451 bytes). Updating counters with new values. 2015-03-02T12:46:51.689-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383407476 bytes) is inconsistent with full validation results (37299 records 383408451 bytes). Updating size storer with new values. 2015-03-02T12:46:51.690-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:46:51.701-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:46:51.718-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6110.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44705 nscannedObjects:44705 nMatched:18928 nModified:18928 keyUpdates:1 writeConflicts:6 numYields:360 locks:{} 2385ms 2015-03-02T12:46:51.718-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6110.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2385ms 2015-03-02T12:46:51.719-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 187ms 2015-03-02T12:46:51.722-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:46:51.739-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:46:51.883-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:46:51.898-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:46:51.904-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 182ms 2015-03-02T12:46:51.906-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:46:51.915-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:46:51.919-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 180ms 2015-03-02T12:46:51.921-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:46:52.029-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:46:52.036-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:46:52.040-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 119ms 2015-03-02T12:46:52.221-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49628 #3 (3 connections now open) 2015-03-02T12:46:55.549-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:46:56.130-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1909.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:70913 nscannedObjects:70913 nMatched:28617 nModified:28617 keyUpdates:1 writeConflicts:363 numYields:580 locks:{} 4087ms 2015-03-02T12:46:56.130-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1909.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4087ms 2015-03-02T12:46:56.134-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:46:56.258-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3645.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:57234 nscannedObjects:57234 nMatched:28617 nModified:28617 keyUpdates:1 writeConflicts:342 numYields:475 locks:{} 4023ms 2015-03-02T12:46:56.258-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3645.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4024ms 2015-03-02T12:46:56.263-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:46:56.568-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:46:56.582-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:46:56.587-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:46:56.602-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:46:56.610-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 476ms 2015-03-02T12:46:56.619-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 355ms 2015-03-02T12:46:57.182-0500 I NETWORK [conn3] end connection 10.4.127.218:49628 (2 connections now open) 2015-03-02T12:46:57.222-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49629 #4 (3 connections now open) 2015-03-02T12:46:57.253-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:46:57.427-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:46:57.440-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:46:57.447-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 194ms 2015-03-02T12:46:57.476-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:46:57.660-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:46:57.668-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:46:57.673-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 197ms 2015-03-02T12:46:58.187-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:46:59.055-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:46:59.648-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 8233.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:57234 nscannedObjects:57234 nMatched:28617 nModified:28617 keyUpdates:1 writeConflicts:0 numYields:463 locks:{} 3031ms 2015-03-02T12:46:59.648-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8233.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3031ms 2015-03-02T12:46:59.650-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:46:59.855-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:46:59.876-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:46:59.891-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 241ms 2015-03-02T12:47:01.181-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 6811.0 } } ndeleted:28617 keyUpdates:0 writeConflicts:0 numYields:225 locks:{} 1284ms 2015-03-02T12:47:01.181-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6811.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1284ms 2015-03-02T12:47:01.182-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:01.334-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (14005 records 143867324 bytes) is inconsistent with full validation results (13682 records 140555186 bytes). Updating size storer with new values. 2015-03-02T12:47:01.334-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:01.347-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:01.356-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 173ms 2015-03-02T12:47:01.359-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:01.386-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:01.388-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:01.392-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:01.439-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:01.445-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:01.452-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:01.475-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:01.477-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:01.481-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:01.524-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13682 records 140555186 bytes) is inconsistent with full validation results (13683 records 140555232 bytes). Updating size storer with new values. 2015-03-02T12:47:01.525-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:01.530-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:03.803-0500 I NETWORK [conn2] end connection 10.4.127.218:49627 (2 connections now open) 2015-03-02T12:47:03.841-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49631 #5 (3 connections now open) 2015-03-02T12:47:03.857-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:47:04.001-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18359 records 188591780 bytes) is inconsistent with full validation results (18683 records 191920232 bytes). Updating size storer with new values. 2015-03-02T12:47:04.001-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:47:04.004-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:47:04.005-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 148ms 2015-03-02T12:47:04.038-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:47:04.132-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18683 records 191920232 bytes) is inconsistent with full validation results (18309 records 188088357 bytes). Updating size storer with new values. 2015-03-02T12:47:04.132-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:47:04.135-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:47:04.141-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:47:04.222-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:47:04.224-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:47:04.934-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:47:07.295-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:47:08.476-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:47:09.469-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:09.814-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (32108 records 329845484 bytes) are inconsistent with full validation results (30309 records 311364357 bytes). Updating counters with new values. 2015-03-02T12:47:09.814-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (31611 records 324739803 bytes) is inconsistent with full validation results (30309 records 311364357 bytes). Updating size storer with new values. 2015-03-02T12:47:09.814-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:09.829-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:09.840-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 370ms 2015-03-02T12:47:09.842-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:47:10.144-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7331.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5338 nscannedObjects:5338 nMatched:2669 nModified:2669 keyUpdates:1 writeConflicts:0 numYields:42 locks:{} 297ms 2015-03-02T12:47:10.144-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7331.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 297ms 2015-03-02T12:47:10.150-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:10.323-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (30510 records 313463927 bytes) are inconsistent with full validation results (32309 records 331945054 bytes). Updating counters with new values. 2015-03-02T12:47:10.323-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (30510 records 313459156 bytes) is inconsistent with full validation results (32309 records 331945054 bytes). Updating size storer with new values. 2015-03-02T12:47:10.323-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:10.332-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:10.346-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 195ms 2015-03-02T12:47:10.352-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:10.453-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:10.462-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:10.467-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 115ms 2015-03-02T12:47:10.476-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:10.614-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:10.620-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:10.623-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 147ms 2015-03-02T12:47:10.626-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:10.793-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:47:10.810-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (33309 records 342218054 bytes) are inconsistent with full validation results (32309 records 331945054 bytes). Updating counters with new values. 2015-03-02T12:47:10.810-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32942 records 338447863 bytes) is inconsistent with full validation results (32309 records 331945054 bytes). Updating size storer with new values. 2015-03-02T12:47:10.810-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:10.817-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:10.821-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 195ms 2015-03-02T12:47:10.845-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:10.972-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (32309 records 331945054 bytes) are inconsistent with full validation results (33309 records 342218054 bytes). Updating counters with new values. 2015-03-02T12:47:10.972-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32309 records 331945054 bytes) is inconsistent with full validation results (33309 records 342218054 bytes). Updating size storer with new values. 2015-03-02T12:47:10.972-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:10.977-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:10.979-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 134ms 2015-03-02T12:47:12.239-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:47:13.051-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:47:13.055-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:47:13.344-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (39309 records 403856054 bytes) are inconsistent with full validation results (38748 records 398092901 bytes). Updating counters with new values. 2015-03-02T12:47:13.344-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (38942 records 400085863 bytes) is inconsistent with full validation results (38748 records 398092901 bytes). Updating size storer with new values. 2015-03-02T12:47:13.344-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:47:13.349-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:47:13.353-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 297ms 2015-03-02T12:47:14.342-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T12:47:15.161-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:47:16.466-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:47:16.602-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:47:16.878-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (46406 records 476763535 bytes) are inconsistent with full validation results (45309 records 465494054 bytes). Updating counters with new values. 2015-03-02T12:47:16.879-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (46381 records 476506710 bytes) is inconsistent with full validation results (45309 records 465494054 bytes). Updating size storer with new values. 2015-03-02T12:47:16.879-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:47:16.894-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:47:16.909-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 442ms 2015-03-02T12:47:16.917-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:47:17.123-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (45651 records 469007420 bytes) are inconsistent with full validation results (47309 records 486040054 bytes). Updating counters with new values. 2015-03-02T12:47:17.123-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (45309 records 465494054 bytes) is inconsistent with full validation results (47309 records 486040054 bytes). Updating size storer with new values. 2015-03-02T12:47:17.124-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:47:17.130-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:47:17.135-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 217ms 2015-03-02T12:47:17.145-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:47:17.315-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49632 #6 (4 connections now open) 2015-03-02T12:47:17.419-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:47:17.435-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:47:17.452-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 126ms 2015-03-02T12:47:17.452-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 306ms 2015-03-02T12:47:17.452-0500 I NETWORK [conn1] end connection 10.4.127.218:49625 (3 connections now open) 2015-03-02T12:47:18.329-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:47:18.590-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo2015-03-02T12:47:46.188-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:47:46.200-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:47:46.200-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:47:46.201-0500 I CONTROL [initandlisten] 2015-03-02T12:47:46.201-0500 I CONTROL [initandlisten] 2015-03-02T12:47:46.201-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:47:46.201-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:47:46.201-0500 I CONTROL [initandlisten] 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:47:46.202-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:47:46.211-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:47:46.267-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:47:46.267-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:47:46.267-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:47:46.371-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:47:47.331-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49641 #1 (1 connection now open) 2015-03-02T12:47:47.357-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:47:48.873-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49642 #2 (2 connections now open) 2015-03-02T12:47:49.162-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:47:49.171-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:47:49.174-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 296ms 2015-03-02T12:47:49.175-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1815ms 2015-03-02T12:47:49.195-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:49.350-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (34145 records 350915837 bytes) are inconsistent with full validation results (37022 records 380471258 bytes). Updating counters with new values. 2015-03-02T12:47:49.350-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (34298 records 352487606 bytes) is inconsistent with full validation results (37022 records 380471258 bytes). Updating size storer with new values. 2015-03-02T12:47:49.350-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:49.355-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:49.362-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 166ms 2015-03-02T12:47:49.374-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:49.488-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (34186 records 351337030 bytes) are inconsistent with full validation results (33684 records 346179984 bytes). Updating counters with new values. 2015-03-02T12:47:49.488-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (35175 records 361497027 bytes) is inconsistent with full validation results (33684 records 346179984 bytes). Updating size storer with new values. 2015-03-02T12:47:49.488-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:49.498-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:49.503-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 128ms 2015-03-02T12:47:50.598-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 334.0 } } ndeleted:35295 keyUpdates:0 writeConflicts:0 numYields:275 locks:{} 1415ms 2015-03-02T12:47:50.598-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 334.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1416ms 2015-03-02T12:47:50.602-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:47:50.652-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (5379 records 55258467 bytes) are inconsistent with full validation results (3004 records 30860092 bytes). Updating counters with new values. 2015-03-02T12:47:50.652-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5673 records 58272311 bytes) is inconsistent with full validation results (3004 records 30860092 bytes). Updating size storer with new values. 2015-03-02T12:47:50.652-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:47:50.663-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:47:50.676-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:47:50.684-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:47:50.684-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:47:52.272-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49643 #3 (3 connections now open) 2015-03-02T12:47:54.580-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:47:55.540-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:47:56.864-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:47:57.225-0500 I NETWORK [conn3] end connection 10.4.127.218:49643 (2 connections now open) 2015-03-02T12:47:57.271-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49645 #4 (3 connections now open) 2015-03-02T12:47:57.295-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:57.714-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (20004 records 205501092 bytes) are inconsistent with full validation results (19378 records 199070194 bytes). Updating counters with new values. 2015-03-02T12:47:57.714-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19710 records 202480830 bytes) is inconsistent with full validation results (19378 records 199070194 bytes). Updating size storer with new values. 2015-03-02T12:47:57.714-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:57.718-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:57.722-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 427ms 2015-03-02T12:47:57.732-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:57.833-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (20051 records 205983923 bytes) are inconsistent with full validation results (20004 records 205501092 bytes). Updating counters with new values. 2015-03-02T12:47:57.833-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19378 records 199070194 bytes) is inconsistent with full validation results (20004 records 205501092 bytes). Updating size storer with new values. 2015-03-02T12:47:57.833-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:57.838-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:57.842-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T12:47:57.852-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:47:57.873-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:47:57.962-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (20331 records 208860363 bytes) are inconsistent with full validation results (20885 records 214551605 bytes). Updating counters with new values. 2015-03-02T12:47:57.962-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (20037 records 205840101 bytes) is inconsistent with full validation results (20885 records 214551605 bytes). Updating size storer with new values. 2015-03-02T12:47:57.966-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:47:57.971-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:47:57.972-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 120ms 2015-03-02T12:47:57.975-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (20885 records 214551605 bytes) are inconsistent with full validation results (21004 records 215774092 bytes). Updating counters with new values. 2015-03-02T12:47:57.976-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (20885 records 214551605 bytes) is inconsistent with full validation results (21004 records 215774092 bytes). Updating size storer with new values. 2015-03-02T12:47:57.976-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:47:57.979-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:47:57.986-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T12:47:59.183-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 228ms 2015-03-02T12:48:00.271-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8899.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28264 nscannedObjects:28264 nMatched:13910 nModified:13910 keyUpdates:1 writeConflicts:0 numYields:240 locks:{} 2291ms 2015-03-02T12:48:00.271-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8899.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2291ms 2015-03-02T12:48:00.278-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:00.363-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2045.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28439 nscannedObjects:28439 nMatched:13910 nModified:13910 keyUpdates:1 writeConflicts:0 numYields:244 locks:{} 2374ms 2015-03-02T12:48:00.363-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2045.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2374ms 2015-03-02T12:48:00.370-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:48:00.428-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:00.435-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:00.459-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 181ms 2015-03-02T12:48:00.473-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:00.497-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:48:00.507-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:48:00.513-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 143ms 2015-03-02T12:48:00.582-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:00.587-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:00.589-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T12:48:00.601-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:00.682-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:00.690-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:00.706-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:00.789-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:00.794-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:00.809-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:00.934-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:00.942-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:00.949-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T12:48:00.963-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:01.052-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:01.059-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:01.064-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T12:48:01.322-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:48:02.241-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7444.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32974 nscannedObjects:32974 nMatched:13910 nModified:13910 keyUpdates:1 writeConflicts:164 numYields:267 locks:{} 1721ms 2015-03-02T12:48:02.241-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7444.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1721ms 2015-03-02T12:48:02.246-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:48:02.349-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:48:02.356-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:48:02.386-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T12:48:02.897-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7173.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29158 nscannedObjects:29158 nMatched:13910 nModified:13910 keyUpdates:1 writeConflicts:318 numYields:240 locks:{} 1826ms 2015-03-02T12:48:02.897-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7173.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1826ms 2015-03-02T12:48:02.903-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:03.041-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:03.052-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:03.063-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T12:48:03.487-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:48:03.490-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:48:03.623-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:48:03.633-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:48:03.643-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T12:48:03.879-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49646 #5 (4 connections now open) 2015-03-02T12:48:05.032-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 5597.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39340 nscannedObjects:39340 nMatched:14910 nModified:14910 keyUpdates:1 writeConflicts:476 numYields:331 locks:{} 2640ms 2015-03-02T12:48:05.032-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5597.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2640ms 2015-03-02T12:48:05.044-0500 I NETWORK [conn2] end connection 10.4.127.218:49642 (3 connections now open) 2015-03-02T12:48:05.709-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 9071.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:34129 nscannedObjects:34129 nMatched:14910 nModified:14910 keyUpdates:1 writeConflicts:974 numYields:292 locks:{} 2641ms 2015-03-02T12:48:05.709-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9071.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2641ms 2015-03-02T12:48:05.713-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:05.860-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:05.866-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:05.898-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 185ms 2015-03-02T12:48:05.911-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:06.035-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:06.043-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:06.049-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 137ms 2015-03-02T12:48:06.279-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4148.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32686 nscannedObjects:32686 nMatched:15910 nModified:15910 keyUpdates:1 writeConflicts:402 numYields:282 locks:{} 2628ms 2015-03-02T12:48:06.279-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4148.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2628ms 2015-03-02T12:48:06.283-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:48:06.375-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:48:06.379-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:48:06.384-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 101ms 2015-03-02T12:48:06.396-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:48:06.500-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:48:06.515-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:48:06.519-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 123ms 2015-03-02T12:48:07.031-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T12:48:07.649-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7793.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31820 nscannedObjects:31820 nMatched:15910 nModified:15910 keyUpdates:1 writeConflicts:0 numYields:255 locks:{} 1595ms 2015-03-02T12:48:07.654-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7793.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1600ms 2015-03-02T12:48:07.655-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:07.810-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25524 records 262414882 bytes) are inconsistent with full validation results (25004 records 257072922 bytes). Updating counters with new values. 2015-03-02T12:48:07.810-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25430 records 261449220 bytes) is inconsistent with full validation results (25004 records 257072922 bytes). Updating size storer with new values. 2015-03-02T12:48:07.810-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:07.816-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:07.831-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 175ms 2015-03-02T12:48:07.852-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:07.978-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25484 records 262003962 bytes) are inconsistent with full validation results (26004 records 267345922 bytes). Updating counters with new values. 2015-03-02T12:48:07.978-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25004 records 257072922 bytes) is inconsistent with full validation results (26004 records 267345922 bytes). Updating size storer with new values. 2015-03-02T12:48:07.978-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:07.981-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:07.983-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 131ms 2015-03-02T12:48:08.885-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 4801.0 } } ndeleted:15910 keyUpdates:0 writeConflicts:0 numYields:125 locks:{} 899ms 2015-03-02T12:48:08.885-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4801.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 900ms 2015-03-02T12:48:08.888-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:08.921-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T12:48:09.064-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:48:09.100-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (12094 records 124241662 bytes) are inconsistent with full validation results (10781 records 110753213 bytes). Updating counters with new values. 2015-03-02T12:48:09.100-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (11610 records 119269530 bytes) is inconsistent with full validation results (10781 records 110753213 bytes). Updating size storer with new values. 2015-03-02T12:48:09.100-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:09.128-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:09.139-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 251ms 2015-03-02T12:48:09.144-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:09.248-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (10781 records 110753213 bytes) are inconsistent with full validation results (12094 records 124241662 bytes). Updating counters with new values. 2015-03-02T12:48:09.248-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10781 records 110753213 bytes) is inconsistent with full validation results (12094 records 124241662 bytes). Updating size storer with new values. 2015-03-02T12:48:09.248-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:09.250-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:09.252-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 107ms 2015-03-02T12:48:09.256-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:09.283-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:09.285-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:09.296-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:09.339-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12094 records 124241662 bytes) is inconsistent with full validation results (12095 records 124241708 bytes). Updating size storer with new values. 2015-03-02T12:48:09.340-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:09.341-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:10.480-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:48:12.017-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:48:12.831-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:48:13.253-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:48:13.562-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T12:48:14.331-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:48:15.134-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:48:15.631-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:48:17.132-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:17.335-0500 I NETWORK [conn1] end connection 10.4.127.218:49641 (2 connections now open) 2015-03-02T12:48:17.357-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49650 #6 (3 connections now open) 2015-03-02T12:48:17.585-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (33095 records 339974708 bytes) are inconsistent with full validation results (32893 records 337899562 bytes). Updating counters with new values. 2015-03-02T12:48:17.585-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32610 records 334992303 bytes) is inconsistent with full validation results (32893 records 337899562 bytes). Updating size storer with new values. 2015-03-02T12:48:17.585-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:17.589-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:17.592-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 225ms 2015-03-02T12:48:17.592-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 459ms 2015-03-02T12:48:17.599-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:48:17.603-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:48:17.761-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (32893 records 337899562 bytes) are inconsistent with full validation results (33095 records 339974708 bytes). Updating counters with new values. 2015-03-02T12:48:17.762-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32893 records 337899562 bytes) is inconsistent with full validation results (33095 records 339974708 bytes). Updating size storer with new values. 2015-03-02T12:48:17.762-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:48:17.765-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:48:17.774-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:48:17.777-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:48:17.782-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 182ms 2015-03-02T12:48:17.783-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 179ms 2015-03-02T12:48:19.676-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 244ms 2015-03-02T12:48:19.985-0500 I WRITE [2015-03-02T12:48:48.313-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:48:48.332-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:48:48.332-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:48:48.332-0500 I CONTROL [initandlisten] 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:48:48.333-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:48:48.343-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:48:48.403-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:48:48.403-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:48:48.403-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:48:48.489-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:48:48.931-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49694 #1 (1 connection now open) 2015-03-02T12:48:48.943-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:48:50.610-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:48:50.616-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:48:50.619-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1675ms 2015-03-02T12:48:55.314-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:48:55.509-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (46300 records 475784152 bytes) is inconsistent with full validation results (47299 records 486046879 bytes). Updating size storer with new values. 2015-03-02T12:48:55.509-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:48:55.514-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:48:55.517-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 203ms 2015-03-02T12:48:55.524-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:48:55.608-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:48:55.613-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:48:55.626-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:48:55.711-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:48:55.716-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:48:57.301-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49695 #2 (2 connections now open) 2015-03-02T12:48:57.386-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49696 #3 (3 connections now open) 2015-03-02T12:48:57.409-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:48:57.429-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:48:57.776-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (50299 records 516910079 bytes) are inconsistent with full validation results (50171 records 515565417 bytes). Updating counters with new values. 2015-03-02T12:48:57.776-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (50299 records 516904892 bytes) is inconsistent with full validation results (50171 records 515565417 bytes). Updating size storer with new values. 2015-03-02T12:48:57.776-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:48:57.793-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:48:57.803-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 393ms 2015-03-02T12:48:57.826-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:48:58.106-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (50171 records 515588037 bytes) are inconsistent with full validation results (50299 records 516914096 bytes). Updating counters with new values. 2015-03-02T12:48:58.106-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (50171 records 515586230 bytes) is inconsistent with full validation results (50299 records 516914096 bytes). Updating size storer with new values. 2015-03-02T12:48:58.106-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:48:58.128-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:48:58.132-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 305ms 2015-03-02T12:48:58.160-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:48:58.406-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (50299 records 516936378 bytes) are inconsistent with full validation results (50299 records 516936586 bytes). Updating counters with new values. 2015-03-02T12:48:58.406-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (50299 records 516925289 bytes) is inconsistent with full validation results (50299 records 516936586 bytes). Updating size storer with new values. 2015-03-02T12:48:58.406-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:48:58.421-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:48:58.434-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 273ms 2015-03-02T12:48:58.455-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:48:58.718-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 159ms 2015-03-02T12:48:58.744-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (51299 records 527234741 bytes) are inconsistent with full validation results (50299 records 516958751 bytes). Updating counters with new values. 2015-03-02T12:48:58.744-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (50990 records 524054157 bytes) is inconsistent with full validation results (50299 records 516958751 bytes). Updating size storer with new values. 2015-03-02T12:48:58.744-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:48:58.761-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:48:58.773-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 317ms 2015-03-02T12:48:58.792-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:48:59.057-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (50299 records 516982801 bytes) are inconsistent with full validation results (51299 records 527257192 bytes). Updating counters with new values. 2015-03-02T12:48:59.057-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (50299 records 516974507 bytes) is inconsistent with full validation results (51299 records 527257192 bytes). Updating size storer with new values. 2015-03-02T12:48:59.057-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:48:59.067-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:48:59.076-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 284ms 2015-03-02T12:48:59.891-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T12:49:01.000-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 185ms 2015-03-02T12:49:01.569-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6188.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50050 nscannedObjects:50050 nMatched:22584 nModified:22584 keyUpdates:1 writeConflicts:4027 numYields:439 locks:{} 4261ms 2015-03-02T12:49:01.569-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6188.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4261ms 2015-03-02T12:49:01.577-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:49:02.105-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (53299 records 547803985 bytes) are inconsistent with full validation results (53299 records 547823979 bytes). Updating counters with new values. 2015-03-02T12:49:02.105-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (53299 records 547803985 bytes) is inconsistent with full validation results (53299 records 547823979 bytes). Updating size storer with new values. 2015-03-02T12:49:02.105-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:49:02.128-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:49:02.151-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 574ms 2015-03-02T12:49:02.325-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:49:02.746-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9556.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:45168 nscannedObjects:45168 nMatched:22584 nModified:22584 keyUpdates:1 writeConflicts:325 numYields:383 locks:{} 3665ms 2015-03-02T12:49:02.746-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9556.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3665ms 2015-03-02T12:49:02.753-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:49:03.136-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:49:03.149-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:49:03.160-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 407ms 2015-03-02T12:49:03.199-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:49:03.325-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 159ms 2015-03-02T12:49:03.593-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (55299 records 568369979 bytes) are inconsistent with full validation results (54367 records 558795543 bytes). Updating counters with new values. 2015-03-02T12:49:03.594-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (55132 records 566654388 bytes) is inconsistent with full validation results (54367 records 558795543 bytes). Updating size storer with new values. 2015-03-02T12:49:03.594-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:49:03.601-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:49:03.605-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 405ms 2015-03-02T12:49:03.612-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:49:03.831-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (54367 records 558795543 bytes) are inconsistent with full validation results (55299 records 568369979 bytes). Updating counters with new values. 2015-03-02T12:49:03.831-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (54367 records 558795543 bytes) is inconsistent with full validation results (55299 records 568369979 bytes). Updating size storer with new values. 2015-03-02T12:49:03.831-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:49:03.847-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:49:03.855-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 242ms 2015-03-02T12:49:03.908-0500 I NETWORK [conn1] end connection 10.4.127.218:49694 (2 connections now open) 2015-03-02T12:49:03.920-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49697 #4 (3 connections now open) 2015-03-02T12:49:03.951-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:49:04.249-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (55299 records 568402375 bytes) are inconsistent with full validation results (55299 records 568375322 bytes). Updating counters with new values. 2015-03-02T12:49:04.249-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (55299 records 568393808 bytes) is inconsistent with full validation results (55299 records 568375322 bytes). Updating size storer with new values. 2015-03-02T12:49:04.249-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:49:04.268-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:49:04.279-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 328ms 2015-03-02T12:49:04.296-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:49:04.624-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (55299 records 568409928 bytes) are inconsistent with full validation results (55299 records 568407562 bytes). Updating counters with new values. 2015-03-02T12:49:04.625-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (55299 records 568405755 bytes) is inconsistent with full validation results (55299 records 568407562 bytes). Updating size storer with new values. 2015-03-02T12:49:04.625-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:49:04.642-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:49:04.652-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 356ms 2015-03-02T12:49:04.839-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T12:49:06.612-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T12:49:06.795-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:49:08.224-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T12:49:08.396-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:49:09.661-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 657.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:100086 nscannedObjects:100086 nMatched:50043 nModified:50043 keyUpdates:1 writeConflicts:0 numYields:816 locks:{} 5793ms 2015-03-02T12:49:09.661-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 657.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5794ms 2015-03-02T12:49:09.664-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:49:09.717-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:49:10.449-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 219ms 2015-03-02T12:49:10.567-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (62299 records 640608527 bytes) are inconsistent with full validation results (60591 records 623091662 bytes). Updating counters with new values. 2015-03-02T12:49:10.567-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (62089 records 638451197 bytes) is inconsistent with full validation results (60591 records 623091662 bytes). Updating size storer with new values. 2015-03-02T12:49:10.567-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:49:10.575-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:49:10.580-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 916ms 2015-03-02T12:49:11.652-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:49:11.662-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:49:12.400-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:49:12.834-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T12:49:14.922-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T12:49:14.976-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:49:14.999-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:49:16.065-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:49:17.036-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:49:17.348-0500 I NETWORK [conn3] end connection 10.4.127.218:49696 (2 connections now open) 2015-03-02T12:49:17.404-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49699 #5 (3 connections now open) 2015-03-02T12:49:18.015-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:49:18.462-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 191ms 2015-03-02T12:49:19.055-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T12:49:19.060-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:49:19.425-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (80591 records 828551662 bytes) are inconsistent with full validation results (80299 records 825551946 bytes). Updating counters with new values. 2015-03-02T12:49:19.427-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (80381 records 826394332 bytes) is inconsistent with full validation results (80299 records 825551946 bytes). Updating size storer with new values. 2015-03-02T12:49:19.427-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:49:19.476-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:49:19.498-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 1483ms 2015-03-02T12:49:20.409-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (80299 records 825551946 bytes) are inconsistent with full validation results (82299 records 846097946 bytes). Updating counters with new values. 2015-03-02T12:49:20.409-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (80299 records 825551946 bytes) is inconsistent with full validation results (82299 records 846097946 bytes). Updating size storer with new values. 2015-03-02T12:49:20.410-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:49:20.427-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:49:20.437-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 1376ms 2015-03-02T12:49:21.451-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeCo2015-03-02T12:49:49.648-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:49:49.661-0500 I CONTROL [initandlisten] MongoDB starting : pid=1274 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:49:49.661-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:49:49.661-0500 I CONTROL [initandlisten] 2015-03-02T12:49:49.662-0500 I CONTROL [initandlisten] 2015-03-02T12:49:49.662-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:49:49.662-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:49:49.662-0500 I CONTROL [initandlisten] 2015-03-02T12:49:49.662-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:49:49.662-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:49:49.662-0500 I CONTROL [initandlisten] 2015-03-02T12:49:49.663-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:49:49.663-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:49:49.663-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:49:49.663-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:49:49.663-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:49:49.675-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:49:49.785-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:49:49.785-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:49:49.785-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:49:49.908-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:49:57.440-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49707 #1 (1 connection now open) 2015-03-02T12:49:57.520-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49708 #2 (2 connections now open) 2015-03-02T12:49:59.047-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49709 #3 (3 connections now open) 2015-03-02T12:49:59.085-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:50:00.682-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383572043 bytes) are inconsistent with full validation results (37299 records 383473100 bytes). Updating counters with new values. 2015-03-02T12:50:00.682-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383563892 bytes) is inconsistent with full validation results (37299 records 383473100 bytes). Updating size storer with new values. 2015-03-02T12:50:00.682-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:50:00.696-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:50:00.706-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1621ms 2015-03-02T12:50:00.733-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:50:00.998-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (38142 records 392154039 bytes) are inconsistent with full validation results (37299 records 383576268 bytes). Updating counters with new values. 2015-03-02T12:50:00.998-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (38091 records 391629869 bytes) is inconsistent with full validation results (37299 records 383576268 bytes). Updating size storer with new values. 2015-03-02T12:50:01.003-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:50:01.020-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:50:01.027-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 293ms 2015-03-02T12:50:01.027-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 198ms 2015-03-02T12:50:01.050-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:50:01.207-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (37456 records 385193562 bytes) are inconsistent with full validation results (38299 records 393869795 bytes). Updating counters with new values. 2015-03-02T12:50:01.207-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37456 records 385193562 bytes) is inconsistent with full validation results (38299 records 393869795 bytes). Updating size storer with new values. 2015-03-02T12:50:01.207-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:50:01.215-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:50:01.220-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 170ms 2015-03-02T12:50:01.239-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:50:01.389-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (38299 records 393869795 bytes) are inconsistent with full validation results (38299 records 393870276 bytes). Updating counters with new values. 2015-03-02T12:50:01.389-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (38299 records 393869795 bytes) is inconsistent with full validation results (38299 records 393870276 bytes). Updating size storer with new values. 2015-03-02T12:50:01.389-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:50:01.396-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:50:01.404-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 165ms 2015-03-02T12:50:02.971-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 641.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:73756 nscannedObjects:73756 nMatched:33453 nModified:33453 keyUpdates:1 writeConflicts:0 numYields:625 locks:{} 5524ms 2015-03-02T12:50:02.971-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 641.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5524ms 2015-03-02T12:50:02.979-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:03.243-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:03.253-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:03.278-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 298ms 2015-03-02T12:50:03.297-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:03.516-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:03.526-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:03.531-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 233ms 2015-03-02T12:50:03.553-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:03.784-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:03.792-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:03.801-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 248ms 2015-03-02T12:50:03.832-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:04.062-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49714 #4 (4 connections now open) 2015-03-02T12:50:04.094-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:04.099-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:04.106-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 274ms 2015-03-02T12:50:04.131-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:04.445-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:04.456-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:04.461-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 329ms 2015-03-02T12:50:04.485-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:04.700-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:04.720-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:04.728-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 242ms 2015-03-02T12:50:04.761-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:05.058-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (38928 records 400331993 bytes) are inconsistent with full validation results (38299 records 393870276 bytes). Updating counters with new values. 2015-03-02T12:50:05.058-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (38379 records 394692116 bytes) is inconsistent with full validation results (38299 records 393870276 bytes). Updating size storer with new values. 2015-03-02T12:50:05.058-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:05.078-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:05.088-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 327ms 2015-03-02T12:50:05.107-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 182ms 2015-03-02T12:50:05.116-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:05.464-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (38670 records 397681559 bytes) are inconsistent with full validation results (39299 records 404143276 bytes). Updating counters with new values. 2015-03-02T12:50:05.464-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (38670 records 397681559 bytes) is inconsistent with full validation results (39299 records 404143276 bytes). Updating size storer with new values. 2015-03-02T12:50:05.464-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:05.497-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:05.509-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 392ms 2015-03-02T12:50:05.770-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 188ms 2015-03-02T12:50:06.533-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3077.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:66906 nscannedObjects:66906 nMatched:33453 nModified:33453 keyUpdates:1 writeConflicts:0 numYields:561 locks:{} 5121ms 2015-03-02T12:50:06.533-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3077.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5121ms 2015-03-02T12:50:06.535-0500 I NETWORK [conn3] end connection 10.4.127.218:49709 (3 connections now open) 2015-03-02T12:50:07.604-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:50:07.797-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4629.0 } } ndeleted:33453 keyUpdates:0 writeConflicts:0 numYields:272 locks:{} 2281ms 2015-03-02T12:50:07.797-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4629.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2281ms 2015-03-02T12:50:07.799-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:07.936-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9204 records 94547106 bytes) is inconsistent with full validation results (8846 records 90874958 bytes). Updating size storer with new values. 2015-03-02T12:50:07.936-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:07.944-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:07.951-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T12:50:09.387-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:50:09.422-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:50:11.114-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:50:11.239-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:50:13.118-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:50:13.363-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:50:13.516-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (28846 records 296334958 bytes) are inconsistent with full validation results (27846 records 286061958 bytes). Updating counters with new values. 2015-03-02T12:50:13.516-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (28488 records 292657224 bytes) is inconsistent with full validation results (27846 records 286061958 bytes). Updating size storer with new values. 2015-03-02T12:50:13.516-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:50:13.531-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:50:13.534-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 415ms 2015-03-02T12:50:14.628-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T12:50:14.631-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:14.875-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (31488 records 323476224 bytes) is inconsistent with full validation results (31846 records 327153958 bytes). Updating size storer with new values. 2015-03-02T12:50:14.875-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:14.884-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:14.895-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 264ms 2015-03-02T12:50:16.191-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 758.0 } } ndeleted:26968 keyUpdates:0 writeConflicts:0 numYields:213 locks:{} 1291ms 2015-03-02T12:50:16.191-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 758.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1291ms 2015-03-02T12:50:16.193-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:16.267-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (6878 records 70657694 bytes) are inconsistent with full validation results (7878 records 80930694 bytes). Updating counters with new values. 2015-03-02T12:50:16.267-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (7204 records 74006692 bytes) is inconsistent with full validation results (7878 records 80930694 bytes). Updating size storer with new values. 2015-03-02T12:50:16.267-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:16.276-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:16.303-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T12:50:17.497-0500 I NETWORK [conn2] end connection 10.4.127.218:49708 (2 connections now open) 2015-03-02T12:50:17.529-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49715 #5 (3 connections now open) 2015-03-02T12:50:19.432-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:50:19.940-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:50:20.141-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:50:20.569-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:50:21.081-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:50:21.297-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:50:21.919-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:50:21.921-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: fals2015-03-02T12:50:48.624-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:50:48.642-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:50:48.644-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:50:48.644-0500 I CONTROL [initandlisten] 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:50:48.646-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:50:48.655-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:50:48.724-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:50:48.724-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:50:48.724-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:50:48.823-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:50:49.044-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49729 #1 (1 connection now open) 2015-03-02T12:50:49.054-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:50.505-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:50.511-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:50.514-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1459ms 2015-03-02T12:50:50.520-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:50.585-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:50.590-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:55.782-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:55.994-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49732 #2 (2 connections now open) 2015-03-02T12:50:56.008-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (46300 records 475784152 bytes) is inconsistent with full validation results (47299 records 486046879 bytes). Updating size storer with new values. 2015-03-02T12:50:56.008-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:56.016-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:56.020-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 238ms 2015-03-02T12:50:56.027-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:50:56.034-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:56.210-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:50:56.217-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:56.219-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:50:56.225-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:56.226-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 198ms 2015-03-02T12:50:56.233-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 198ms 2015-03-02T12:50:56.243-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:50:56.247-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:50:56.453-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:50:56.455-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:50:56.466-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:50:56.469-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:50:56.472-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 224ms 2015-03-02T12:50:56.473-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 229ms 2015-03-02T12:50:56.485-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:50:56.648-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486050077 bytes) are inconsistent with full validation results (47299 records 486048725 bytes). Updating counters with new values. 2015-03-02T12:50:56.648-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486050077 bytes) is inconsistent with full validation results (47299 records 486048725 bytes). Updating size storer with new values. 2015-03-02T12:50:56.648-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:50:56.661-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:50:56.664-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 179ms 2015-03-02T12:50:56.695-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:50:56.886-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486048725 bytes) are inconsistent with full validation results (47299 records 486050077 bytes). Updating counters with new values. 2015-03-02T12:50:56.886-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486048725 bytes) is inconsistent with full validation results (47299 records 486050077 bytes). Updating size storer with new values. 2015-03-02T12:50:56.886-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:50:56.899-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:50:56.902-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 206ms 2015-03-02T12:50:56.923-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:50:57.131-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:50:57.141-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:50:57.145-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 221ms 2015-03-02T12:50:57.448-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49733 #3 (3 connections now open) 2015-03-02T12:50:57.476-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:50:57.515-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49734 #4 (4 connections now open) 2015-03-02T12:50:57.713-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486097774 bytes) are inconsistent with full validation results (47299 records 486082642 bytes). Updating counters with new values. 2015-03-02T12:50:57.713-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486092171 bytes) is inconsistent with full validation results (47299 records 486082642 bytes). Updating size storer with new values. 2015-03-02T12:50:57.714-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:50:57.722-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:50:57.737-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 261ms 2015-03-02T12:50:57.748-0500 I COMMAND [conn4] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 227ms 2015-03-02T12:50:57.767-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:50:58.137-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486122071 bytes) are inconsistent with full validation results (47299 records 486102363 bytes). Updating counters with new values. 2015-03-02T12:50:58.137-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486117027 bytes) is inconsistent with full validation results (47299 records 486102363 bytes). Updating size storer with new values. 2015-03-02T12:50:58.137-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:50:58.154-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:50:58.168-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 400ms 2015-03-02T12:51:01.067-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9877.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50182 nscannedObjects:50182 nMatched:21813 nModified:21813 keyUpdates:1 writeConflicts:566 numYields:446 locks:{} 4590ms 2015-03-02T12:51:01.071-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9877.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4593ms 2015-03-02T12:51:01.073-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:51:01.609-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31157 records 320284762 bytes) are inconsistent with full validation results (32708 records 336273188 bytes). Updating counters with new values. 2015-03-02T12:51:01.609-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (31336 records 322125956 bytes) is inconsistent with full validation results (32708 records 336273188 bytes). Updating size storer with new values. 2015-03-02T12:51:01.609-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:51:01.629-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:51:01.654-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 580ms 2015-03-02T12:51:02.308-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6445.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:48434 nscannedObjects:48434 nMatched:21813 nModified:21813 keyUpdates:1 writeConflicts:2606 numYields:458 locks:{} 5152ms 2015-03-02T12:51:02.309-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6445.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5153ms 2015-03-02T12:51:02.313-0500 I NETWORK [conn2] end connection 10.4.127.218:49732 (3 connections now open) 2015-03-02T12:51:02.732-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8443.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39218 nscannedObjects:39218 nMatched:18323 nModified:18323 keyUpdates:1 writeConflicts:6302 numYields:406 locks:{} 4988ms 2015-03-02T12:51:02.732-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8443.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4988ms 2015-03-02T12:51:02.736-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:02.890-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24306 records 249850216 bytes) are inconsistent with full validation results (24606 records 252936016 bytes). Updating counters with new values. 2015-03-02T12:51:02.890-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (24810 records 255034360 bytes) is inconsistent with full validation results (24606 records 252936016 bytes). Updating size storer with new values. 2015-03-02T12:51:02.890-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:02.905-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:02.919-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 182ms 2015-03-02T12:51:03.675-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 2252.0 } } ndeleted:18558 keyUpdates:0 writeConflicts:124 numYields:316 locks:{} 5495ms 2015-03-02T12:51:03.675-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2252.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 5495ms 2015-03-02T12:51:03.679-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:03.827-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14612 records 150133139 bytes) are inconsistent with full validation results (12620 records 129645260 bytes). Updating counters with new values. 2015-03-02T12:51:03.827-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15110 records 155247160 bytes) is inconsistent with full validation results (12620 records 129645260 bytes). Updating size storer with new values. 2015-03-02T12:51:03.827-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:03.835-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:03.841-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 162ms 2015-03-02T12:51:03.850-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:03.900-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13479 records 138469767 bytes) are inconsistent with full validation results (13212 records 135726876 bytes). Updating counters with new values. 2015-03-02T12:51:03.900-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (12840 records 131905320 bytes) is inconsistent with full validation results (13212 records 135726876 bytes). Updating size storer with new values. 2015-03-02T12:51:03.900-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:03.903-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:03.914-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:03.968-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13212 records 135726876 bytes) are inconsistent with full validation results (13620 records 139918260 bytes). Updating counters with new values. 2015-03-02T12:51:03.970-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13212 records 135726876 bytes) is inconsistent with full validation results (13620 records 139918260 bytes). Updating size storer with new values. 2015-03-02T12:51:03.971-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:03.973-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:03.992-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:04.005-0500 I NETWORK [conn1] end connection 10.4.127.218:49729 (2 connections now open) 2015-03-02T12:51:04.053-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:04.056-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:04.057-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49735 #5 (3 connections now open) 2015-03-02T12:51:04.065-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:51:04.102-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:51:04.106-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:51:04.849-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:51:05.088-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:51:05.508-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:51:06.329-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:51:09.139-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:51:09.247-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:09.635-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (34620 records 355651260 bytes) are inconsistent with full validation results (33620 records 345378260 bytes). Updating counters with new values. 2015-03-02T12:51:09.635-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (33981 records 349086813 bytes) is inconsistent with full validation results (33620 records 345378260 bytes). Updating size storer with new values. 2015-03-02T12:51:09.636-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:09.642-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:09.646-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 399ms 2015-03-02T12:51:09.654-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:09.795-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (33620 records 345378260 bytes) are inconsistent with full validation results (34620 records 355651260 bytes). Updating counters with new values. 2015-03-02T12:51:09.795-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (33620 records 345378260 bytes) is inconsistent with full validation results (34620 records 355651260 bytes). Updating size storer with new values. 2015-03-02T12:51:09.800-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:09.811-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:09.820-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 166ms 2015-03-02T12:51:09.832-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:10.020-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:10.038-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:10.053-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 221ms 2015-03-02T12:51:10.074-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:10.202-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T12:51:10.270-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (35920 records 369006160 bytes) are inconsistent with full validation results (34620 records 355651260 bytes). Updating counters with new values. 2015-03-02T12:51:10.270-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (34981 records 359359813 bytes) is inconsistent with full validation results (34620 records 355651260 bytes). Updating size storer with new values. 2015-03-02T12:51:10.270-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:10.281-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:10.287-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 212ms 2015-03-02T12:51:10.300-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:10.454-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (35320 records 362842360 bytes) are inconsistent with full validation results (36343 records 373351639 bytes). Updating counters with new values. 2015-03-02T12:51:10.454-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (34681 records 356277913 bytes) is inconsistent with full validation results (36343 records 373351639 bytes). Updating size storer with new values. 2015-03-02T12:51:10.454-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:10.465-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:10.478-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 177ms 2015-03-02T12:51:11.151-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:51:11.882-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:51:11.888-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:12.118-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 186ms 2015-03-02T12:51:12.140-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:51:12.237-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42343 records 434989639 bytes) are inconsistent with full validation results (40620 records 417289260 bytes). Updating counters with new values. 2015-03-02T12:51:12.237-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (41704 records 428425192 bytes) is inconsistent with full validation results (40620 records 417289260 bytes). Updating size storer with new values. 2015-03-02T12:51:12.237-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:12.242-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:12.248-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 359ms 2015-03-02T12:51:12.316-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:12.480-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (40620 records 417292146 bytes) are inconsistent with full validation results (42620 records 437838146 bytes). Updating counters with new values. 2015-03-02T12:51:12.480-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (40620 records 417289260 bytes) is inconsistent with full validation results (42620 records 437838146 bytes). Updating size storer with new values. 2015-03-02T12:51:12.480-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:12.492-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:12.499-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 183ms 2015-03-02T12:51:12.513-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:12.772-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:12.787-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:12.798-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 284ms 2015-03-02T12:51:12.821-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:13.061-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 243ms 2015-03-02T12:51:13.148-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T12:51:13.152-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (44620 records 458384146 bytes) are inconsistent with full validation results (42620 records 437838146 bytes). Updating counters with new values. 2015-03-02T12:51:13.152-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (43759 records 449539093 bytes) is inconsistent with full validation results (42620 records 437838146 bytes). Updating size storer with new values. 2015-03-02T12:51:13.152-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:13.159-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:13.164-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 343ms 2015-03-02T12:51:13.185-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:51:13.395-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42620 records 437838146 bytes) are inconsistent with full validation results (44620 records 458384146 bytes). Updating counters with new values. 2015-03-02T12:51:13.395-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42620 records 437838146 bytes) is inconsistent with full validation results (44620 records 458384146 bytes). Updating size storer with new values. 2015-03-02T12:51:13.395-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:51:13.401-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:51:13.407-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 221ms 2015-03-02T12:51:13.808-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:51:14.092-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (45759 records 470085093 bytes) is inconsistent with full validation results (46620 records 478930146 bytes). Updating size storer with new values. 2015-03-02T12:51:14.092-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:51:14.098-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:51:14.102-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 294ms 2015-03-02T12:51:14.111-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:51:14.351-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:51:14.358-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:51:14.369-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 257ms 2015-03-02T12:51:14.670-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:51:14.850-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:51:15.464-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6403.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21582 nscannedObjects:21582 nMatched:10791 nModified:10791 keyUpdates:1 writeConflicts:0 numYields:174 locks:{} 1093ms 2015-03-02T12:51:15.464-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6403.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1093ms 2015-03-02T12:51:15.468-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:51:15.681-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (48620 records 499607953 bytes) is inconsistent with full validation results (48620 records 499613543 bytes). Updating size storer with new values. 2015-03-02T12:51:15.681-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:51:15.688-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:51:15.710-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 242ms 2015-03-02T12:51:15.716-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:51:15.817-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:51:15.826-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:51:15.831-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 114ms 2015-03-02T12:51:16.931-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:51:16.976-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:51:17.487-0500 I NETWORK [conn4] end connection 10.4.127.218:49734 (2 connections now open) 2015-03-02T12:51:17.525-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49750 #6 (3 connections now open) 2015-03-02T12:51:17.534-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:51:17.896-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (55620 records 571524543 bytes) are inconsistent with full validation results (54620 records 561251543 bytes). Updating counters with new values. 2015-03-02T12:51:17.897-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (54968 records 564826547 bytes) is inconsistent with full validation results (54620 records 561251543 bytes). Updating size storer with new values. 2015-03-02T12:51:17.897-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:51:17.905-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:51:17.923-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 388ms 2015-03-02T12:51:18.161-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 228ms 2015-03-02T12:51:18.998-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 9945.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21582 nscannedObjects:21582 nMatched:10791 nModified:10791 keyUpdates:1 writeConflicts:0 numYields:176 locks:{} 1068ms 2015-03-02T12:51:18.998-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9945.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1068ms 2015-03-02T12:51:19.008-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:51:19.158-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:51:19.342-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T12:51:19.402-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (57620 records 592070543 bytes) are inconsistent with full validation results (56620 records 581797543 bytes). Updating counters with new values. 2015-03-02T12:51:19.402-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (57177 records 587519604 bytes) is inconsistent with full validation results (56620 records 581797543 bytes). Updating size storer with new values. 2015-03-02T12:51:19.402-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:51:19.409-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:51:19.414-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 406ms 2015-03-02T12:51:20.003-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:51:20.008-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:20.313-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 205ms 2015-03-02T12:51:20.736-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 223ms 2015-03-02T12:51:20.821-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (59177 records 608065604 bytes) is inconsistent with full validation results (59620 records 612616543 bytes). Updating size storer with new values. 2015-03-02T12:51:20.821-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:20.843-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:20.860-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 851ms 2015-03-02T12:51:20.870-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:21.195-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (59620 records 612616543 bytes) are inconsistent with full validation results (61620 records 633162543 bytes). Updating counters with new values. 2015-03-02T12:51:21.195-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (59620 records 612616543 bytes) is inconsistent with full validation results (61620 records 633162543 bytes). Updating size storer with new values. 2015-03-02T12:51:21.195-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:21.212-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:21.221-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 351ms 2015-03-02T12:51:21.446-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:51:22.062-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 254ms 2015-03-02T12:51:22.445-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:51:22.601-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 7484.0 } } ndeleted:13307 keyUpdates:0 writeConflicts:0 numYields:112 locks:{} 1368ms 2015-03-02T12:51:22.601-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7484.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1368ms 2015-03-02T12:51:22.607-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:23.007-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (51371 records 527734283 bytes) are inconsistent with full validation results (51313 records 527138449 bytes). Updating counters with new values. 2015-03-02T12:51:23.011-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (52063 records 534852949 bytes) is inconsistent with full validation results (51313 records 527138449 bytes). Updating size storer with new values. 2015-03-02T12:51:23.011-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:23.041-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:23.051-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 444ms 2015-03-02T12:51:23.055-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:23.102-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:51:23.614-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:51:23.763-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (53237 records 546903701 bytes) are inconsistent with full validation results (51692 records 531031916 bytes). Updating counters with new values. 2015-03-02T12:51:23.763-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (52487 records 539198951 bytes) is inconsistent with full validation results (51692 records 531031916 bytes). Updating size storer with new values. 2015-03-02T12015-03-02T12:51:48.587-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:51:48.605-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:51:48.606-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:51:48.606-0500 I CONTROL [initandlisten] 2015-03-02T12:51:48.606-0500 I CONTROL [initandlisten] 2015-03-02T12:51:48.606-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:51:48.606-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:51:48.607-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:51:48.610-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:51:48.679-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:51:48.679-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:51:48.679-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:51:48.754-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:51:49.098-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49758 #1 (1 connection now open) 2015-03-02T12:51:49.108-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:51:50.781-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:51:50.787-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:51:50.790-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1681ms 2015-03-02T12:51:50.797-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:51:50.858-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:51:50.862-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:51:55.394-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:51:55.588-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (46300 records 475784152 bytes) is inconsistent with full validation results (47299 records 486046879 bytes). Updating size storer with new values. 2015-03-02T12:51:55.588-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:51:55.593-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:51:55.596-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 201ms 2015-03-02T12:51:56.948-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5852.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:47184 nscannedObjects:47184 nMatched:23592 nModified:23592 keyUpdates:1 writeConflicts:0 numYields:368 locks:{} 1350ms 2015-03-02T12:51:56.948-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5852.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1350ms 2015-03-02T12:51:56.950-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:51:57.044-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:51:57.049-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:51:57.056-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 106ms 2015-03-02T12:51:57.064-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:51:57.150-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:51:57.155-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:51:57.498-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49760 #2 (2 connections now open) 2015-03-02T12:51:57.573-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49761 #3 (3 connections now open) 2015-03-02T12:51:57.620-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:51:57.983-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486238863 bytes) are inconsistent with full validation results (47299 records 486215788 bytes). Updating counters with new values. 2015-03-02T12:51:57.983-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486238369 bytes) is inconsistent with full validation results (47299 records 486215788 bytes). Updating size storer with new values. 2015-03-02T12:51:57.987-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:51:58.002-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:51:58.015-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 395ms 2015-03-02T12:52:00.500-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5601.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:50910 nscannedObjects:50910 nMatched:22693 nModified:22693 keyUpdates:1 writeConflicts:320 numYields:421 locks:{} 3340ms 2015-03-02T12:52:00.501-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5601.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3341ms 2015-03-02T12:52:00.503-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:52:00.800-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23168 records 238102212 bytes) are inconsistent with full validation results (25676 records 263922575 bytes). Updating counters with new values. 2015-03-02T12:52:00.800-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23564 records 242175468 bytes) is inconsistent with full validation results (25676 records 263922575 bytes). Updating size storer with new values. 2015-03-02T12:52:00.800-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:52:00.814-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:52:00.826-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 322ms 2015-03-02T12:52:00.880-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4649.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:37949 nscannedObjects:37949 nMatched:18035 nModified:18035 keyUpdates:1 writeConflicts:4256 numYields:332 locks:{} 3362ms 2015-03-02T12:52:00.881-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4649.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3362ms 2015-03-02T12:52:00.885-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:52:01.001-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23207 records 238526441 bytes) are inconsistent with full validation results (22193 records 228096437 bytes). Updating counters with new values. 2015-03-02T12:52:01.007-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (24168 records 248411287 bytes) is inconsistent with full validation results (22178 records 227942147 bytes). Updating size storer with new values. 2015-03-02T12:52:01.007-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:52:01.020-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:52:01.028-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 143ms 2015-03-02T12:52:01.415-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 2751.0 } } ndeleted:13788 keyUpdates:0 writeConflicts:91 numYields:260 locks:{} 3390ms 2015-03-02T12:52:01.415-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2751.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3390ms 2015-03-02T12:52:01.418-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.476-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (14611 records 150118225 bytes) are inconsistent with full validation results (13117 records 134750941 bytes). Updating counters with new values. 2015-03-02T12:52:01.476-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (15154 records 155693283 bytes) is inconsistent with full validation results (13117 records 134750941 bytes). Updating size storer with new values. 2015-03-02T12:52:01.476-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.482-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.489-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.512-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13117 records 134750941 bytes) is inconsistent with full validation results (13118 records 134750987 bytes). Updating size storer with new values. 2015-03-02T12:52:01.512-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.513-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.517-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.541-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.544-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.548-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.574-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13118 records 134750987 bytes) is inconsistent with full validation results (13117 records 134750941 bytes). Updating size storer with new values. 2015-03-02T12:52:01.574-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.576-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.585-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.633-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.635-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.641-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.709-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.715-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.725-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.793-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13117 records 134750941 bytes) is inconsistent with full validation results (13118 records 134750987 bytes). Updating size storer with new values. 2015-03-02T12:52:01.794-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.799-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.810-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.857-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.860-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.869-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:01.940-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:01.948-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:01.956-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:02.043-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:02.049-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:02.057-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:02.126-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:02.134-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:02.145-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:52:02.224-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13118 records 134750987 bytes) is inconsistent with full validation results (13117 records 134750941 bytes). Updating size storer with new values. 2015-03-02T12:52:02.225-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:52:02.231-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:52:02.393-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:52:03.023-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:52:03.535-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T12:52:04.136-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49762 #4 (4 connections now open) 2015-03-02T12:52:04.149-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:04.288-0500 I NETWORK [conn1] end connection 10.4.127.218:49758 (3 connections now open) 2015-03-02T12:52:04.370-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17568 records 180476064 bytes) is inconsistent with full validation results (18117 records 186115941 bytes). Updating size storer with new values. 2015-03-02T12:52:04.370-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:04.376-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:04.379-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 229ms 2015-03-02T12:52:04.385-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:04.466-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:04.473-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:04.483-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:04.599-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18966 records 194837718 bytes) are inconsistent with full validation results (18117 records 186115941 bytes). Updating counters with new values. 2015-03-02T12:52:04.599-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18568 records 190749064 bytes) is inconsistent with full validation results (18117 records 186115941 bytes). Updating size storer with new values. 2015-03-02T12:52:04.599-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:04.606-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:04.611-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:52:04.612-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 129ms 2015-03-02T12:52:04.622-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:04.723-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18465 records 189680718 bytes) are inconsistent with full validation results (19118 records 196388987 bytes). Updating counters with new values. 2015-03-02T12:52:04.723-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18117 records 186115941 bytes) is inconsistent with full validation results (19118 records 196388987 bytes). Updating size storer with new values. 2015-03-02T12:52:04.723-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:04.729-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:04.733-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 111ms 2015-03-02T12:52:04.741-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:04.804-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:52:04.836-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19922 records 204648479 bytes) are inconsistent with full validation results (19544 records 200765285 bytes). Updating counters with new values. 2015-03-02T12:52:04.836-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19372 records 198998329 bytes) is inconsistent with full validation results (19544 records 200765285 bytes). Updating size storer with new values. 2015-03-02T12:52:04.836-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:04.844-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:04.846-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T12:52:04.851-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:04.889-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19544 records 200765285 bytes) are inconsistent with full validation results (20118 records 206661987 bytes). Updating counters with new values. 2015-03-02T12:52:04.889-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19544 records 200765285 bytes) is inconsistent with full validation results (20118 records 206661987 bytes). Updating size storer with new values. 2015-03-02T12:52:04.889-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:04.892-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:04.896-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:04.977-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:04.983-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:05.636-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T12:52:06.323-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1198.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:19084 nscannedObjects:19084 nMatched:9542 nModified:9542 keyUpdates:1 writeConflicts:0 numYields:159 locks:{} 1333ms 2015-03-02T12:52:06.323-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1198.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1333ms 2015-03-02T12:52:06.325-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:06.451-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (21129 records 217172023 bytes) are inconsistent with full validation results (21118 records 217059020 bytes). Updating counters with new values. 2015-03-02T12:52:06.451-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21118 records 217057837 bytes) is inconsistent with full validation results (21118 records 217059020 bytes). Updating size storer with new values. 2015-03-02T12:52:06.451-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:06.457-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:06.466-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 140ms 2015-03-02T12:52:06.474-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:06.563-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (22107 records 227219017 bytes) are inconsistent with full validation results (21491 records 220890849 bytes). Updating counters with new values. 2015-03-02T12:52:06.563-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (22015 records 226273901 bytes) is inconsistent with full validation results (21491 records 220890849 bytes). Updating size storer with new values. 2015-03-02T12:52:06.563-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:06.567-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:06.592-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:06.744-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T12:52:06.757-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (22491 records 231163849 bytes) are inconsistent with full validation results (22130 records 227455296 bytes). Updating counters with new values. 2015-03-02T12:52:06.757-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (22399 records 230218733 bytes) is inconsistent with full validation results (22130 records 227455296 bytes). Updating size storer with new values. 2015-03-02T12:52:06.757-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:06.760-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:06.762-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 169ms 2015-03-02T12:52:06.771-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:06.908-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (22130 records 227455296 bytes) are inconsistent with full validation results (23118 records 237605020 bytes). Updating counters with new values. 2015-03-02T12:52:06.908-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (22130 records 227455296 bytes) is inconsistent with full validation results (23118 records 237605020 bytes). Updating size storer with new values. 2015-03-02T12:52:06.908-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:06.915-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:06.921-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 150ms 2015-03-02T12:52:07.647-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 2030.0 } } ndeleted:10542 keyUpdates:0 writeConflicts:0 numYields:83 locks:{} 723ms 2015-03-02T12:52:07.647-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2030.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 723ms 2015-03-02T12:52:07.648-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:07.768-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14210 records 145977332 bytes) is inconsistent with full validation results (13576 records 139466248 bytes). Updating size storer with new values. 2015-03-02T12:52:07.777-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:07.795-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:07.800-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 151ms 2015-03-02T12:52:07.807-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:07.857-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:07.859-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:07.873-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:07.939-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:07.944-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:07.949-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:08.011-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:08.017-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:08.026-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:08.088-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:08.090-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:08.101-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:08.168-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:08.170-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:08.567-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:52:09.352-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:52:09.780-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:52:09.883-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (17942 records 184318166 bytes) is inconsistent with full validation results (18576 records 190831248 bytes). Updating size storer with new values. 2015-03-02T12:52:09.883-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:52:09.888-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:52:09.897-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 117ms 2015-03-02T12:52:09.907-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:52:09.997-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:52:10.006-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:52:10.276-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:52:12.214-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T12:52:12.230-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T12:52:13.885-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T12:52:14.221-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:52:15.274-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:52:15.469-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:52:16.402-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T12:52:16.974-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:52:17.096-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T12:52:17.544-0500 I NETWORK [conn3] end connection 10.4.127.218:49761 (2 connections now open) 2015-03-02T12:52:17.583-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49764 #5 (3 connections now open) 2015-03-02T12:52:17.596-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:52:17.744-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T12:52:17.893-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T12:52:18.370-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (40576 records 416837248 bytes) are inconsistent with full validation results (38576 records 396291248 bytes). Updating counters with new values. 2015-03-02T12:52:18.370-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (39942 records 410324166 bytes) is inconsistent with full validation results (38576 records 396291248 bytes). Updating size storer with new values. 2015-03-02T12:52:18.370-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:52:18.378-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:52:18.382-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 785ms 2015-03-02T12:52:18.387-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:52:18.466-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (38576 records 396291248 bytes) are inconsistent with full validation results (40576 records 416837248 bytes). Updating counters with new values. 2015-03-02T12:52:18.466-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (38576 records 396291248 bytes) is inconsistent with full validation results (40576 records 416837248 bytes). Updating size storer with new values. 2015-03-02T12:52:18.466-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:52:18.473-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:52:18.969-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T12:52:18.972-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:52:19.326-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (41961 records 431138647 bytes) are inconsistent with full validation results (41576 records 427156164 bytes). Updating counters with new values. 2015-03-02T12:52:19.326-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (41631 records 427744306 bytes) is inconsistent with full validation results (41576 records 427156164 bytes). Updating size storer with new values. 2015-03-02T12:52:19.326-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:52:19.354-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:52:19.394-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 422ms 2015-03-02T12:52:19.422-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:52:19.451-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 218ms 2015-03-02T12:52:19.455-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:19.692-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42191 records 433498278 bytes) are inconsistent with full validation results (42428 records 435942170 bytes). Updating counters with new values. 2015-03-02T12:52:19.692-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42191 records 433496523 bytes) is inconsistent with full validation results (42428 records 435942170 bytes). Updating size storer with new values. 2015-03-02T12:52:19.692-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:52:19.706-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42428 records 435943132 bytes) are inconsistent with full validation results (42576 records 437464511 bytes). Updating counters with new values. 2015-03-02T12:52:19.706-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42428 records 435942170 bytes) is inconsistent with full validation results (42576 records 437464511 bytes). Updating size storer with new values. 2015-03-02T12:52:19.707-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:19.711-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:52:19.722-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 300ms 2015-03-02T12:52:19.725-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:19.735-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 280ms 2015-03-02T12:52:19.752-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:52:20.003-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42576 records 437512819 bytes) are inconsistent with full validation results (42576 records 437488223 bytes). Updating counters with new values. 2015-03-02T12:52:20.003-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42576 records 437500794 bytes) is inconsistent with full validation results (42576 records 437488223 bytes). Updating size storer with new values. 2015-03-02T12:52:20.003-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:52:20.022-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:52:20.034-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 282ms 2015-03-02T12:53:01.893-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:53:01.911-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:53:01.911-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:53:01.911-0500 I CONTROL [initandlisten] 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:53:01.915-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:53:01.926-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:53:01.993-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:53:01.993-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:53:01.993-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:53:02.115-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:53:02.390-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49781 #1 (1 connection now open) 2015-03-02T12:53:03.926-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49782 #2 (2 connections now open) 2015-03-02T12:53:06.272-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4270.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:52084 nscannedObjects:52084 nMatched:23625 nModified:23625 keyUpdates:1 writeConflicts:461 numYields:446 locks:{} 3875ms 2015-03-02T12:53:06.272-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4270.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3876ms 2015-03-02T12:53:06.275-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:53:07.731-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7535.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:47250 nscannedObjects:47250 nMatched:23625 nModified:23625 keyUpdates:1 writeConflicts:424 numYields:408 locks:{} 3784ms 2015-03-02T12:53:07.732-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7535.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3785ms 2015-03-02T12:53:07.736-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:07.899-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:53:07.919-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:53:07.946-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1670ms 2015-03-02T12:53:07.968-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:53:08.040-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:08.050-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:08.056-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 320ms 2015-03-02T12:53:08.167-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383480354 bytes) are inconsistent with full validation results (37299 records 383469512 bytes). Updating counters with new values. 2015-03-02T12:53:08.167-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383479275 bytes) is inconsistent with full validation results (37299 records 383469512 bytes). Updating size storer with new values. 2015-03-02T12:53:08.167-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:53:08.174-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:53:08.181-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 213ms 2015-03-02T12:53:08.193-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:53:08.354-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383476220 bytes) are inconsistent with full validation results (37299 records 383483929 bytes). Updating counters with new values. 2015-03-02T12:53:08.354-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383476220 bytes) is inconsistent with full validation results (37299 records 383483929 bytes). Updating size storer with new values. 2015-03-02T12:53:08.354-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:53:08.364-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:53:08.368-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 175ms 2015-03-02T12:53:08.414-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49783 #3 (3 connections now open) 2015-03-02T12:53:10.860-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T12:53:11.447-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3730.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:51790 nscannedObjects:51790 nMatched:24975 nModified:24975 keyUpdates:1 writeConflicts:0 numYields:422 locks:{} 3384ms 2015-03-02T12:53:11.447-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3730.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3384ms 2015-03-02T12:53:11.450-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:11.910-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (38299 records 393756929 bytes) are inconsistent with full validation results (38299 records 393760062 bytes). Updating counters with new values. 2015-03-02T12:53:11.910-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (38299 records 393756929 bytes) is inconsistent with full validation results (38299 records 393760062 bytes). Updating size storer with new values. 2015-03-02T12:53:11.910-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:11.924-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:11.945-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 495ms 2015-03-02T12:53:11.963-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:12.186-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:12.195-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:12.200-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 236ms 2015-03-02T12:53:12.622-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T12:53:13.203-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5480.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:49950 nscannedObjects:49950 nMatched:24975 nModified:24975 keyUpdates:1 writeConflicts:12508 numYields:455 locks:{} 4778ms 2015-03-02T12:53:13.203-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5480.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4778ms 2015-03-02T12:53:13.209-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:53:13.455-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27965 records 287598880 bytes) are inconsistent with full validation results (30806 records 316784473 bytes). Updating counters with new values. 2015-03-02T12:53:13.455-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (28498 records 293074389 bytes) is inconsistent with full validation results (30806 records 316784473 bytes). Updating size storer with new values. 2015-03-02T12:53:13.455-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:53:13.470-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:53:13.484-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 274ms 2015-03-02T12:53:13.972-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 185ms 2015-03-02T12:53:15.325-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:53:16.219-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9206.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22039 nscannedObjects:22039 nMatched:7258 nModified:7258 keyUpdates:1 writeConflicts:15024 numYields:203 locks:{} 2729ms 2015-03-02T12:53:16.219-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9206.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2729ms 2015-03-02T12:53:16.224-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:53:16.369-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (5717 records 58727222 bytes) are inconsistent with full validation results (4506 records 46307809 bytes). Updating counters with new values. 2015-03-02T12:53:16.369-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6603 records 67840618 bytes) is inconsistent with full validation results (4506 records 46307809 bytes). Updating size storer with new values. 2015-03-02T12:53:16.369-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:53:16.392-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:53:16.396-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 172ms 2015-03-02T12:53:16.409-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:53:16.416-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 337.0 } } ndeleted:6578 keyUpdates:0 writeConflicts:22 numYields:317 locks:{} 4212ms 2015-03-02T12:53:16.416-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 337.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 4212ms 2015-03-02T12:53:16.419-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.432-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (3989 records 41000187 bytes) are inconsistent with full validation results (2435 records 25005503 bytes). Updating counters with new values. 2015-03-02T12:53:16.432-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4392 records 45135205 bytes) is inconsistent with full validation results (2435 records 25005503 bytes). Updating size storer with new values. 2015-03-02T12:53:16.433-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:53:16.434-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (2435 records 25005503 bytes) are inconsistent with full validation results (2359 records 24234007 bytes). Updating counters with new values. 2015-03-02T12:53:16.434-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (2435 records 25005503 bytes) is inconsistent with full validation results (2359 records 24234007 bytes). Updating size storer with new values. 2015-03-02T12:53:16.434-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.436-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:53:16.437-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:16.441-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.449-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:53:16.455-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.456-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:16.457-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:53:16.457-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:53:16.464-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.470-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.471-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:16.557-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.568-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (2474 records 25415402 bytes) is inconsistent with full validation results (2359 records 24234007 bytes). Updating size storer with new values. 2015-03-02T12:53:16.568-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.569-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:16.575-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.584-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.585-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:16.594-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.607-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.608-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:16.617-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.623-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.624-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:16.628-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:16.632-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (2359 records 24234007 bytes) is inconsistent with full validation results (2360 records 24234053 bytes). Updating size storer with new values. 2015-03-02T12:53:16.632-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:16.633-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:17.271-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:53:17.406-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49784 #4 (4 connections now open) 2015-03-02T12:53:17.594-0500 I NETWORK [conn1] end connection 10.4.127.218:49781 (3 connections now open) 2015-03-02T12:53:19.608-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T12:53:20.964-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T12:53:21.034-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T12:53:23.862-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:53:24.154-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:53:24.317-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (19956 records 204997761 bytes) is inconsistent with full validation results (20360 records 209148053 bytes). Updating size storer with new values. 2015-03-02T12:53:24.317-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:53:24.320-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:53:24.322-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 167ms 2015-03-02T12:53:24.325-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:53:24.389-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:53:24.393-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:53:24.498-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:53:24.598-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20360 records 209155801 bytes) is inconsistent with full validation results (20360 records 209160117 bytes). Updating size storer with new values. 2015-03-02T12:53:24.598-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:53:24.602-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:53:24.605-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 107ms 2015-03-02T12:53:27.293-0500 I NETWORK [conn3] end connection 10.4.127.218:49783 (2 connections now open) 2015-03-02T12:53:27.324-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49786 #5 (3 connections now open) 2015-03-02T12:53:27.351-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:53:27.517-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26027 records 267377208 bytes) is inconsistent with full validation results (26360 records 270798117 bytes). Updating size storer with new values. 2015-03-02T12:53:27.517-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:53:27.522-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:53:27.526-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 174ms 2015-03-02T12:53:27.555-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:53:27.675-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:53:27.701-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (27360 records 281071117 bytes) are inconsistent with full validation results (26360 records 270798117 bytes). Updating counters with new values. 2015-03-02T12:53:27.701-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (27027 records 277650208 bytes) is inconsistent with full validation results (26360 records 270798117 bytes). Updating size storer with new values. 2015-03-02T12:53:27.702-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:53:27.709-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:53:27.717-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 162ms 2015-03-02T12:53:31.138-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T12:53:31.152-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:53:31.155-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:53:31.373-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (33360 records 342709117 bytes) are inconsistent with full validation results (34360 records 352982117 bytes). Updating counters with new values. 2015-03-02T12:53:31.373-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (33027 records 339288208 bytes) is inconsistent with full validation results (34360 records 352982117 bytes). Updating size storer with new values. 2015-03-02T12:53:31.373-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:53:31.378-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:53:31.381-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 225ms 2015-03-02T12:53:33.501-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:53:33.651-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T12:53:33.806-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:53:33.858-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (39360 records 404347117 bytes) are inconsistent with full validation results (37360 records 383801117 bytes). Updating counters with new values. 2015-03-02T12:53:33.858-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (39027 records 400926208 bytes) is inconsistent with full validation results (37360 records 383801117 bytes). Updating size storer with new values. 2015-03-02T12:53:33.859-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:53:33.867-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:53:33.872-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 370ms 2015-03-02T12:53:33.876-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:53:33.933-0500 I NETWORK [conn2] end connection 10.4.127.218:49782 (2 connections now open) 2015-03-02T12:53:33.942-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49787 #6 (3 connections now open) 2015-03-02T12:53:33.989-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (37360 records 383801117 bytes) are inconsistent with full validation results (39360 records 404347117 bytes). Updating counters with new values. 2015-03-02T12:53:33.989-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (37360 records 383801117 bytes) is inconsistent with full validation results (39360 records 404347117 bytes). Updating size storer with new values. 2015-03-02T12:53:33.989-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:53:33.996-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:53:34.002-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 125ms 2015-03-02T12:53:34.019-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:53:34.151-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:53:34.164-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:53:34.172-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 152ms 2015-03-02T12:53:34.836-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8402.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9590 nscannedObjects:9590 nMatched:4795 nModified:4795 keyUpdates:1 writeConflicts:0 numYields:80 locks:{} 658ms 2015-03-02T12:53:34.836-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8402.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 658ms 2015-03-02T12:53:34.839-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:53:35.113-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:53:35.129-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:53:35.143-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 304ms 2015-03-02T12:53:36.015-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:53:36.837-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 238ms 2015-03-02T12:53:36.862-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 215ms 2015-03-02T12:53:38.080-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T12:53:38.102-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:54:03.141-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:54:03.153-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:54:03.153-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:54:03.154-0500 I CONTROL [initandlisten] 2015-03-02T12:54:03.154-0500 I CONTROL [initandlisten] 2015-03-02T12:54:03.154-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:54:03.154-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:54:03.154-0500 I CONTROL [initandlisten] 2015-03-02T12:54:03.154-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:54:03.155-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:54:03.155-0500 I CONTROL [initandlisten] 2015-03-02T12:54:03.155-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:54:03.155-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:54:03.155-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:54:03.155-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:54:03.155-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:54:03.164-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:54:03.222-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:54:03.222-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:54:03.222-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:54:03.299-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:54:03.953-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49796 #1 (1 connection now open) 2015-03-02T12:54:09.462-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:10.856-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49799 #2 (2 connections now open) 2015-03-02T12:54:11.402-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (46300 records 475784152 bytes) is inconsistent with full validation results (47299 records 486046879 bytes). Updating size storer with new values. 2015-03-02T12:54:11.402-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:11.407-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:11.411-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 550ms 2015-03-02T12:54:11.412-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1949ms 2015-03-02T12:54:11.423-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:11.646-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486068966 bytes) are inconsistent with full validation results (47299 records 486048491 bytes). Updating counters with new values. 2015-03-02T12:54:11.647-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486059892 bytes) is inconsistent with full validation results (47299 records 486048491 bytes). Updating size storer with new values. 2015-03-02T12:54:11.647-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:11.655-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:11.661-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 237ms 2015-03-02T12:54:12.429-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49800 #3 (3 connections now open) 2015-03-02T12:54:12.467-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:54:12.720-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486160551 bytes) are inconsistent with full validation results (47299 records 486181026 bytes). Updating counters with new values. 2015-03-02T12:54:12.720-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486160551 bytes) is inconsistent with full validation results (47299 records 486181026 bytes). Updating size storer with new values. 2015-03-02T12:54:12.720-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:54:12.737-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:54:12.740-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 273ms 2015-03-02T12:54:13.718-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6315.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44406 nscannedObjects:44406 nMatched:22203 nModified:22203 keyUpdates:1 writeConflicts:0 numYields:359 locks:{} 2302ms 2015-03-02T12:54:13.718-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6315.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2302ms 2015-03-02T12:54:13.722-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:54:13.944-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (48145 records 494871984 bytes) are inconsistent with full validation results (47299 records 486181026 bytes). Updating counters with new values. 2015-03-02T12:54:13.944-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (48097 records 494378880 bytes) is inconsistent with full validation results (47299 records 486181026 bytes). Updating size storer with new values. 2015-03-02T12:54:13.944-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:54:13.957-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:54:13.964-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T12:54:13.975-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 253ms 2015-03-02T12:54:14.463-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T12:54:15.324-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:54:16.026-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:54:16.672-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:54:17.216-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6690.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44406 nscannedObjects:44406 nMatched:22203 nModified:22203 keyUpdates:1 writeConflicts:0 numYields:374 locks:{} 3236ms 2015-03-02T12:54:17.217-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6690.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3236ms 2015-03-02T12:54:17.220-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:54:17.434-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49804 #4 (4 connections now open) 2015-03-02T12:54:17.618-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (51491 records 529245442 bytes) are inconsistent with full validation results (52299 records 537546026 bytes). Updating counters with new values. 2015-03-02T12:54:17.618-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (51453 records 528855068 bytes) is inconsistent with full validation results (52299 records 537546026 bytes). Updating size storer with new values. 2015-03-02T12:54:17.618-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:54:17.625-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:54:17.633-0500 I COMMAND [conn4] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 187ms 2015-03-02T12:54:17.633-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f4a3c89b6b1e9b442a6293'), x: 2038.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 2 } }, Database: { acquireCount: { w: 2 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 180635 } }, Collection: { acquireCount: { w: 2 } } } 180ms 2015-03-02T12:54:17.648-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 427ms 2015-03-02T12:54:17.670-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:17.675-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:54:17.787-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 379ms 2015-03-02T12:54:17.792-0500 I NETWORK [conn3] end connection 10.4.127.218:49800 (3 connections now open) 2015-03-02T12:54:18.091-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (53261 records 547428652 bytes) are inconsistent with full validation results (52525 records 539867724 bytes). Updating counters with new values. 2015-03-02T12:54:18.091-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (52856 records 543268087 bytes) is inconsistent with full validation results (52525 records 539867724 bytes). Updating size storer with new values. 2015-03-02T12:54:18.091-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:18.097-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (52525 records 539867724 bytes) are inconsistent with full validation results (52563 records 540258098 bytes). Updating counters with new values. 2015-03-02T12:54:18.097-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (52525 records 539867724 bytes) is inconsistent with full validation results (52563 records 540258098 bytes). Updating size storer with new values. 2015-03-02T12:54:18.097-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:54:18.112-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:54:18.115-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:18.126-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 451ms 2015-03-02T12:54:18.128-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 458ms 2015-03-02T12:54:18.148-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:54:18.309-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T12:54:18.518-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (53563 records 550563429 bytes) are inconsistent with full validation results (53299 records 547820729 bytes). Updating counters with new values. 2015-03-02T12:54:18.518-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (53563 records 550551833 bytes) is inconsistent with full validation results (53299 records 547820729 bytes). Updating size storer with new values. 2015-03-02T12:54:18.518-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:54:18.536-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:54:18.550-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 401ms 2015-03-02T12:54:20.373-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:54:22.334-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T12:54:22.484-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1784.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:44204 nscannedObjects:44204 nMatched:22735 nModified:22735 keyUpdates:1 writeConflicts:11552 numYields:382 locks:{} 4351ms 2015-03-02T12:54:22.484-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1784.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4351ms 2015-03-02T12:54:22.489-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:22.936-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 4864.0 } } ndeleted:22203 keyUpdates:0 writeConflicts:5 numYields:337 locks:{} 4377ms 2015-03-02T12:54:22.936-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4864.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 4377ms 2015-03-02T12:54:22.939-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:54:22.987-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14648 records 150448276 bytes) are inconsistent with full validation results (20389 records 209507590 bytes). Updating counters with new values. 2015-03-02T12:54:22.987-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15439 records 158574262 bytes) is inconsistent with full validation results (20389 records 209507590 bytes). Updating size storer with new values. 2015-03-02T12:54:22.987-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:23.018-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:23.035-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 546ms 2015-03-02T12:54:23.090-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (20389 records 209510866 bytes) are inconsistent with full validation results (15648 records 160751904 bytes). Updating counters with new values. 2015-03-02T12:54:23.090-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (20389 records 209510307 bytes) is inconsistent with full validation results (15648 records 160751904 bytes). Updating size storer with new values. 2015-03-02T12:54:23.090-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:54:23.104-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:54:23.108-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 168ms 2015-03-02T12:54:23.789-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1130.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11096 nscannedObjects:11096 nMatched:5548 nModified:5548 keyUpdates:1 writeConflicts:0 numYields:92 locks:{} 748ms 2015-03-02T12:54:23.789-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1130.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 748ms 2015-03-02T12:54:23.796-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:23.928-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16488 records 169450072 bytes) are inconsistent with full validation results (15648 records 160824028 bytes). Updating counters with new values. 2015-03-02T12:54:23.928-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16309 records 167611205 bytes) is inconsistent with full validation results (15648 records 160824028 bytes). Updating size storer with new values. 2015-03-02T12:54:23.928-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:23.933-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:23.939-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 143ms 2015-03-02T12:54:23.945-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:54:23.950-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:24.027-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (15808 records 162467708 bytes) are inconsistent with full validation results (16648 records 171097028 bytes). Updating counters with new values. 2015-03-02T12:54:24.027-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15648 records 160824028 bytes) is inconsistent with full validation results (16648 records 171097028 bytes). Updating size storer with new values. 2015-03-02T12:54:24.028-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:24.034-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:24.555-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:54:24.911-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7536.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11096 nscannedObjects:11096 nMatched:5548 nModified:5548 keyUpdates:1 writeConflicts:0 numYields:94 locks:{} 867ms 2015-03-02T12:54:24.912-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7536.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 867ms 2015-03-02T12:54:24.917-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:25.044-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:25.047-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:25.057-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 139ms 2015-03-02T12:54:25.062-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:25.160-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:25.167-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:25.168-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 106ms 2015-03-02T12:54:25.175-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:25.219-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:25.222-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:25.467-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:54:25.876-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8727.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11096 nscannedObjects:11096 nMatched:5548 nModified:5548 keyUpdates:1 writeConflicts:0 numYields:90 locks:{} 650ms 2015-03-02T12:54:25.876-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8727.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 651ms 2015-03-02T12:54:25.878-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:25.932-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:25.934-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:25.949-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:26.000-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:26.003-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:26.008-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:54:26.055-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:54:26.062-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:54:26.171-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:54:27.327-0500 I NETWORK [conn2] end connection 10.4.127.218:49799 (2 connections now open) 2015-03-02T12:54:27.355-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49805 #5 (3 connections now open) 2015-03-02T12:54:27.365-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:54:27.488-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21213 records 217993273 bytes) is inconsistent with full validation results (21648 records 222462028 bytes). Updating size storer with new values. 2015-03-02T12:54:27.489-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:54:27.497-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:54:27.503-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 137ms 2015-03-02T12:54:27.513-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:54:27.578-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:54:27.581-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:54:27.586-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:54:27.656-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:54:27.668-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:54:27.683-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:54:27.783-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:54:27.788-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:54:27.793-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 109ms 2015-03-02T12:54:27.800-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:54:27.898-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:54:27.901-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:54:27.903-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 102ms 2015-03-02T12:54:28.270-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:54:28.273-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:28.401-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22648 records 232792501 bytes) are inconsistent with full validation results (22648 records 232783635 bytes). Updating counters with new values. 2015-03-02T12:54:28.401-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22564 records 231919533 bytes) is inconsistent with full validation results (22648 records 232783635 bytes). Updating size storer with new values. 2015-03-02T12:54:28.405-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:28.410-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:28.422-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 149ms 2015-03-02T12:54:28.596-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 164ms 2015-03-02T12:54:29.214-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 2579.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20160 nscannedObjects:20160 nMatched:9969 nModified:9969 keyUpdates:1 writeConflicts:0 numYields:165 locks:{} 1304ms 2015-03-02T12:54:29.215-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2579.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1304ms 2015-03-02T12:54:29.219-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:54:29.374-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (23648 records 243056635 bytes) are inconsistent with full validation results (23648 records 243065501 bytes). Updating counters with new values. 2015-03-02T12:54:29.374-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (23648 records 243056635 bytes) is inconsistent with full validation results (23648 records 243065501 bytes). Updating size storer with new values. 2015-03-02T12:54:29.374-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:54:29.387-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:54:29.400-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 179ms 2015-03-02T12:54:29.761-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7792.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:19938 nscannedObjects:19938 nMatched:9969 nModified:9969 keyUpdates:1 writeConflicts:604 numYields:166 locks:{} 1334ms 2015-03-02T12:54:29.761-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7792.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1334ms 2015-03-02T12:54:29.767-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:29.832-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:29.846-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:29.857-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:29.913-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:29.919-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:29.927-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:30.036-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:30.045-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:30.050-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 122ms 2015-03-02T12:54:30.059-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:30.146-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:30.151-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:30.172-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:30.291-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:30.297-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:30.301-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 128ms 2015-03-02T12:54:30.312-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:54:30.427-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:54:30.431-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:54:30.433-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 120ms 2015-03-02T12:54:31.344-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:54:33.936-0500 I NETWORK [conn1] end connection 10.4.127.218:49796 (2 connections now open) 2015-03-02T12:54:33.985-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49807 #6 (3 connections now open) 2015-03-02T12:54:33.999-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:55:00.952-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:55:00.971-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:55:00.971-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:55:00.971-0500 I CONTROL [initandlisten] 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:55:00.972-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:55:00.973-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:55:00.973-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:55:00.973-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:55:00.982-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:55:01.048-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:55:01.048-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:55:01.048-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:55:01.145-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:55:02.394-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49813 #1 (1 connection now open) 2015-03-02T12:55:02.407-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:55:03.921-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49814 #2 (2 connections now open) 2015-03-02T12:55:04.104-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:55:04.110-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:55:04.113-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 187ms 2015-03-02T12:55:04.114-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1706ms 2015-03-02T12:55:04.129-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:55:04.251-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34459 records 354126219 bytes) are inconsistent with full validation results (37021 records 380460985 bytes). Updating counters with new values. 2015-03-02T12:55:04.251-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (35298 records 362756173 bytes) is inconsistent with full validation results (37021 records 380460985 bytes). Updating size storer with new values. 2015-03-02T12:55:04.252-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:55:04.259-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:55:04.261-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 132ms 2015-03-02T12:55:04.572-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 8802.0 } } ndeleted:794 keyUpdates:0 writeConflicts:17 numYields:73 locks:{} 452ms 2015-03-02T12:55:04.572-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8802.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 453ms 2015-03-02T12:55:04.575-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 7656.0 } } ndeleted:0 keyUpdates:0 writeConflicts:19 numYields:41 locks:{} 306ms 2015-03-02T12:55:04.575-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7656.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 306ms 2015-03-02T12:55:04.575-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:04.577-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:55:04.657-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (24025 records 246824165 bytes) are inconsistent with full validation results (21463 records 220489399 bytes). Updating counters with new values. 2015-03-02T12:55:04.657-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (24860 records 255402735 bytes) is inconsistent with full validation results (21463 records 220489399 bytes). Updating size storer with new values. 2015-03-02T12:55:04.657-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:04.659-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:55:04.664-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:55:04.667-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:04.675-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:55:04.677-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:04.744-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:04.746-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:55:04.749-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:04.751-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:55:04.760-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:04.768-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:55:04.844-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:04.850-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:04.853-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:55:04.858-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:55:04.863-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:04.873-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:55:04.941-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:55:04.941-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:04.944-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:04.949-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:55:04.957-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:55:04.958-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.049-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.050-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:55:05.053-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:55:05.056-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.058-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T12:55:05.093-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.135-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (21298 records 218794354 bytes) is inconsistent with full validation results (20779 records 213462667 bytes). Updating size storer with new values. 2015-03-02T12:55:05.135-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.138-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.144-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.186-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.189-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.196-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.261-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.264-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.270-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.305-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.307-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.455-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 4797.0 } } ndeleted:5524 keyUpdates:0 writeConflicts:0 numYields:43 locks:{} 144ms 2015-03-02T12:55:05.455-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4797.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T12:55:05.456-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.486-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (15298 records 157156354 bytes) is inconsistent with full validation results (15255 records 156714615 bytes). Updating size storer with new values. 2015-03-02T12:55:05.487-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.490-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.496-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.522-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.524-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.527-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.553-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.561-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.828-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2994.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:8806 nscannedObjects:8806 nMatched:4403 nModified:4403 keyUpdates:1 writeConflicts:0 numYields:68 locks:{} 263ms 2015-03-02T12:55:05.828-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2994.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 263ms 2015-03-02T12:55:05.835-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.883-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (15255 records 156766056 bytes) is inconsistent with full validation results (15255 records 156771854 bytes). Updating size storer with new values. 2015-03-02T12:55:05.883-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.885-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:05.891-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:05.953-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:05.963-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:06.256-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2954.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:8966 nscannedObjects:8966 nMatched:4483 nModified:4483 keyUpdates:1 writeConflicts:0 numYields:70 locks:{} 284ms 2015-03-02T12:55:06.257-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2954.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 284ms 2015-03-02T12:55:06.261-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:06.296-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:06.298-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:07.307-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49815 #3 (3 connections now open) 2015-03-02T12:55:07.313-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:55:07.378-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (16326 records 167775277 bytes) is inconsistent with full validation results (17255 records 177318894 bytes). Updating size storer with new values. 2015-03-02T12:55:07.378-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:55:07.380-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:55:07.391-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:55:07.467-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:55:07.471-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:55:07.481-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:55:07.514-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:55:07.516-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:55:08.064-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:55:09.976-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:55:11.442-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T12:55:11.964-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:55:13.184-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:55:14.154-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:55:15.581-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:55:15.842-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:16.201-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:55:16.600-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (40255 records 413597894 bytes) are inconsistent with full validation results (39255 records 403324894 bytes). Updating counters with new values. 2015-03-02T12:55:16.601-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39326 records 404054277 bytes) is inconsistent with full validation results (39255 records 403324894 bytes). Updating size storer with new values. 2015-03-02T12:55:16.601-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:16.606-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:16.609-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 767ms 2015-03-02T12:55:17.402-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49816 #4 (4 connections now open) 2015-03-02T12:55:17.487-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T12:55:17.533-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T12:55:17.534-0500 I NETWORK [conn1] end connection 10.4.127.218:49813 (3 connections now open) 2015-03-02T12:55:17.808-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6271.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21340 nscannedObjects:21340 nMatched:10670 nModified:10670 keyUpdates:1 writeConflicts:0 numYields:175 locks:{} 1196ms 2015-03-02T12:55:17.808-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6271.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1196ms 2015-03-02T12:55:17.809-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:17.908-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (41255 records 423951325 bytes) are inconsistent with full validation results (42255 records 434224325 bytes). Updating counters with new values. 2015-03-02T12:55:17.908-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (41255 records 423951325 bytes) is inconsistent with full validation results (42255 records 434224325 bytes). Updating size storer with new values. 2015-03-02T12:55:17.908-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:17.922-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:17.939-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 129ms 2015-03-02T12:55:17.952-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:18.099-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:18.107-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:18.111-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 158ms 2015-03-02T12:55:18.135-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:18.245-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:18.254-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:18.258-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T12:55:19.012-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:55:19.015-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:55:19.255-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:55:19.264-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:55:19.273-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 257ms 2015-03-02T12:55:19.286-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:55:19.403-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9346.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:21340 nscannedObjects:21340 nMatched:10670 nModified:10670 keyUpdates:1 writeConflicts:0 numYields:174 locks:{} 1144ms 2015-03-02T12:55:19.403-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9346.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1144ms 2015-03-02T12:55:19.406-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:19.481-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:55:19.495-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:55:19.503-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 216ms 2015-03-02T12:55:19.557-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:19.563-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:19.566-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 160ms 2015-03-02T12:55:20.265-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T12:55:21.288-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6766.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:27340 nscannedObjects:27340 nMatched:13670 nModified:13670 keyUpdates:1 writeConflicts:0 numYields:226 locks:{} 1719ms 2015-03-02T12:55:21.289-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6766.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1719ms 2015-03-02T12:55:21.292-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:21.529-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (46255 records 475355325 bytes) are inconsistent with full validation results (45255 records 465082325 bytes). Updating counters with new values. 2015-03-02T12:55:21.529-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (45316 records 465708978 bytes) is inconsistent with full validation results (45255 records 465082325 bytes). Updating size storer with new values. 2015-03-02T12:55:21.529-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:21.544-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:21.557-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 264ms 2015-03-02T12:55:21.567-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:21.798-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (45255 records 465082325 bytes) are inconsistent with full validation results (46255 records 475355325 bytes). Updating counters with new values. 2015-03-02T12:55:21.799-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (45255 records 465082325 bytes) is inconsistent with full validation results (46255 records 475355325 bytes). Updating size storer with new values. 2015-03-02T12:55:21.799-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:21.809-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:21.815-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 248ms 2015-03-02T12:55:21.825-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:21.949-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:21.955-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:21.960-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 134ms 2015-03-02T12:55:22.579-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:55:23.371-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:55:24.068-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:55:24.070-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T12:55:25.864-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T12:55:27.290-0500 I NETWORK [conn3] end connection 10.4.127.218:49815 (2 connections now open) 2015-03-02T12:55:27.314-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49818 #5 (3 connections now open) 2015-03-02T12:55:27.803-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 188ms 2015-03-02T12:55:27.820-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 219ms 2015-03-02T12:55:30.449-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3533.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:59424 nscannedObjects:59424 nMatched:29712 nModified:29712 keyUpdates:1 writeConflicts:0 numYields:484 locks:{} 3129ms 2015-03-02T12:55:30.449-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3533.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3129ms 2015-03-02T12:55:30.453-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:55:30.514-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:55:31.757-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (65255 records 670750871 bytes) are inconsistent with full validation results (64511 records 663107759 bytes). Updating counters with new values. 2015-03-02T12:55:31.757-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (64604 records 664063148 bytes) is inconsistent with full validation results (64511 records 663107759 bytes). Updating size storer with new values. 2015-03-02T12:55:31.758-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:55:31.798-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:55:31.831-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 1378ms 2015-03-02T12:55:32.896-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:55:33.749-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:55:33.925-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49819 #6 (4 connections now open) 2015-03-02T12:55:34.163-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (69511 records 714472759 bytes) are inconsistent with full validation results (70255 records 722115871 bytes). Updating counters with new values. 2015-03-02T12:55:34.163-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (68860 records 707785036 bytes) is inconsistent with full validation results (70255 records 722115871 bytes). Updating size storer with new values. 2015-03-02T12:55:34.163-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:55:34.184-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:55:34.192-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 257ms 2015-03-02T12:55:34.192-0500 I WRITE [conn5] insert test.foo query: { _id: ObjectId('54f4a4159b67819528697bb8'), x: 1000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database2015-03-02T12:56:02.633-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:56:02.651-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:56:02.651-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:56:02.651-0500 I CONTROL [initandlisten] 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:56:02.652-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:56:02.660-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:56:02.736-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:56:02.736-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:56:02.736-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:56:02.804-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:56:04.036-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49828 #1 (1 connection now open) 2015-03-02T12:56:06.274-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4997.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:42888 nscannedObjects:42888 nMatched:21444 nModified:21444 keyUpdates:1 writeConflicts:0 numYields:338 locks:{} 2230ms 2015-03-02T12:56:06.274-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4997.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2230ms 2015-03-02T12:56:06.277-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:56:07.040-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:56:07.046-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:56:07.053-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 775ms 2015-03-02T12:56:09.352-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49829 #2 (2 connections now open) 2015-03-02T12:56:09.367-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:56:09.499-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39856 records 409709220 bytes) is inconsistent with full validation results (40299 records 414260159 bytes). Updating size storer with new values. 2015-03-02T12:56:09.499-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:56:09.504-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:56:09.507-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T12:56:12.527-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49830 #3 (3 connections now open) 2015-03-02T12:56:12.935-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:56:14.638-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:56:14.922-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 14.0 } } ndeleted:47187 keyUpdates:0 writeConflicts:0 numYields:371 locks:{} 2388ms 2015-03-02T12:56:14.922-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 14.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2388ms 2015-03-02T12:56:14.925-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:56:15.041-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (2742 records 28166516 bytes) is inconsistent with full validation results (2112 records 21696576 bytes). Updating size storer with new values. 2015-03-02T12:56:15.042-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:56:15.058-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:56:15.065-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T12:56:15.171-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 226.0 } } ndeleted:2095 keyUpdates:0 writeConflicts:0 numYields:17 locks:{} 104ms 2015-03-02T12:56:15.171-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 226.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:56:15.178-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:56:15.183-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (274 records 2814802 bytes) are inconsistent with full validation results (236 records 2424428 bytes). Updating counters with new values. 2015-03-02T12:56:15.183-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (742 records 7622566 bytes) is inconsistent with full validation results (236 records 2424428 bytes). Updating size storer with new values. 2015-03-02T12:56:15.183-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:56:15.184-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:56:15.193-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:56:15.194-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (473 records 4859129 bytes) are inconsistent with full validation results (510 records 5239230 bytes). Updating counters with new values. 2015-03-02T12:56:15.194-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (254 records 2609342 bytes) is inconsistent with full validation results (510 records 5239230 bytes). Updating size storer with new values. 2015-03-02T12:56:15.195-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:56:15.195-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:56:16.270-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:56:16.345-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (4016 records 41256368 bytes) are inconsistent with full validation results (4017 records 41266641 bytes). Updating counters with new values. 2015-03-02T12:56:16.345-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (3291 records 33808443 bytes) is inconsistent with full validation results (4017 records 41266641 bytes). Updating size storer with new values. 2015-03-02T12:56:16.349-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:56:16.350-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:56:16.357-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:56:16.373-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:56:16.374-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:56:16.524-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7769.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3810 nscannedObjects:3810 nMatched:1905 nModified:1905 keyUpdates:1 writeConflicts:0 numYields:30 locks:{} 145ms 2015-03-02T12:56:16.524-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7769.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 145ms 2015-03-02T12:56:16.529-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:56:16.551-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (4017 records 41283216 bytes) is inconsistent with full validation results (4017 records 41291406 bytes). Updating size storer with new values. 2015-03-02T12:56:16.551-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:56:16.558-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:56:17.529-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49831 #4 (4 connections now open) 2015-03-02T12:56:17.701-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:56:17.746-0500 I NETWORK [conn3] end connection 10.4.127.218:49830 (3 connections now open) 2015-03-02T12:56:18.061-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1099.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9612 nscannedObjects:9612 nMatched:4806 nModified:4806 keyUpdates:1 writeConflicts:0 numYields:77 locks:{} 519ms 2015-03-02T12:56:18.061-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1099.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 519ms 2015-03-02T12:56:18.065-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:56:18.132-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:56:18.135-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:56:18.141-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:56:18.156-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:56:18.157-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:56:18.590-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7744.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9612 nscannedObjects:9612 nMatched:4806 nModified:4806 keyUpdates:1 writeConflicts:0 numYields:77 locks:{} 430ms 2015-03-02T12:56:18.590-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7744.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 430ms 2015-03-02T12:56:18.591-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:56:18.605-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:56:18.606-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:56:18.755-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:56:18.916-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 559.0 } } ndeleted:5787 keyUpdates:0 writeConflicts:0 numYields:45 locks:{} 306ms 2015-03-02T12:56:18.916-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 559.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 306ms 2015-03-02T12:56:18.918-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:56:18.937-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (2259 records 23207084 bytes) is inconsistent with full validation results (2230 records 22908790 bytes). Updating size storer with new values. 2015-03-02T12:56:18.937-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:56:18.940-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:56:18.950-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:56:18.956-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (2230 records 22908790 bytes) is inconsistent with full validation results (2231 records 22908836 bytes). Updating size storer with new values. 2015-03-02T12:56:18.956-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:56:18.957-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:56:22.169-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:56:22.277-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (9201 records 94511646 bytes) is inconsistent with full validation results (9231 records 94819836 bytes). Updating size storer with new values. 2015-03-02T12:56:22.278-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:56:22.280-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:56:22.282-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T12:56:22.294-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:56:22.336-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:56:22.339-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:56:22.982-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:56:23.147-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 614.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16002 nscannedObjects:16002 nMatched:8001 nModified:8001 keyUpdates:1 writeConflicts:0 numYields:129 locks:{} 802ms 2015-03-02T12:56:23.147-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 614.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 802ms 2015-03-02T12:56:23.152-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:56:23.235-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (11231 records 115469446 bytes) is inconsistent with full validation results (11231 records 115469836 bytes). Updating size storer with new values. 2015-03-02T12:56:23.235-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:56:23.236-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:56:23.245-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:56:23.278-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:56:23.280-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:56:23.292-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:56:23.357-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:56:23.359-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:56:23.371-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:56:23.399-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:56:23.401-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:56:26.544-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:56:27.423-0500 I NETWORK [conn2] end connection 10.4.127.218:49829 (2 connections now open) 2015-03-02T12:56:27.471-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49832 #5 (3 connections now open) 2015-03-02T12:56:27.489-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:56:27.558-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:56:27.564-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:56:27.802-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (20231 records 207926836 bytes) are inconsistent with full validation results (19792 records 203416989 bytes). Updating counters with new values. 2015-03-02T12:56:27.802-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (20200 records 207608373 bytes) is inconsistent with full validation results (19792 records 203416989 bytes). Updating size storer with new values. 2015-03-02T12:56:27.803-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:56:27.808-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (19792 records 203416989 bytes) are inconsistent with full validation results (20231 records 207926836 bytes). Updating counters with new values. 2015-03-02T12:56:27.808-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19792 records 203416989 bytes) is inconsistent with full validation results (20231 records 207926836 bytes). Updating size storer with new values. 2015-03-02T12:56:27.808-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:56:27.810-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:56:27.816-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:56:27.818-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 329ms 2015-03-02T12:56:27.826-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 262ms 2015-03-02T12:56:27.833-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:56:27.845-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:56:27.983-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:56:27.992-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:56:27.997-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T12:56:27.994-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:56:28.007-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:56:28.013-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T12:56:28.020-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:56:28.030-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:56:28.157-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:56:28.166-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:56:28.172-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:56:28.174-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 153ms 2015-03-02T12:56:28.193-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:56:28.196-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:56:28.198-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 168ms 2015-03-02T12:56:28.305-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:56:28.311-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:56:28.320-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 127ms 2015-03-02T12:56:29.926-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:56:30.408-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:56:31.169-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T12:56:32.201-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:56:32.303-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T12:56:34.057-0500 I NETWORK [conn1] end connection 10.4.127.218:49828 (2 connections now open) 2015-03-02T12:56:34.058-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49833 #6 (3 connections now open) 2015-03-02T12:56:34.572-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 8644.0 } } ndeleted:9357 keyUpdates:0 writeConflicts:0 numYields:73 locks:{} 501ms 2015-03-02T12:56:34.572-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8644.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 507ms 2015-03-02T12:56:34.577-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:56:34.787-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T12:56:35.007-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (24874 records 255530602 bytes) are inconsistent with full validation results (23874 records 245257602 bytes). Updating counters with new values. 2015-03-02T12:56:35.007-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (24486 records 251544678 bytes) is inconsistent with full validation results (23874 records 245257602 bytes). Updating size storer with new values. 2015-03-02T12:56:35.007-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:56:35.036-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:56:35.047-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 469ms 2015-03-02T12:57:06.939-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:57:06.956-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:57:06.956-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:57:06.956-0500 I CONTROL [initandlisten] 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:57:06.959-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:57:06.968-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:57:07.043-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:57:07.043-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:57:07.043-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:57:07.126-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:57:12.451-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49854 #1 (1 connection now open) 2015-03-02T12:57:12.472-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:57:13.652-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49855 #2 (2 connections now open) 2015-03-02T12:57:14.064-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49856 #3 (3 connections now open) 2015-03-02T12:57:14.314-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:57:14.320-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:57:14.324-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 254ms 2015-03-02T12:57:14.324-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 667ms 2015-03-02T12:57:14.324-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1851ms 2015-03-02T12:57:14.339-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:57:14.489-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (34373 records 353253245 bytes) are inconsistent with full validation results (37028 records 380532896 bytes). Updating counters with new values. 2015-03-02T12:57:14.489-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (35298 records 362760606 bytes) is inconsistent with full validation results (37028 records 380532896 bytes). Updating size storer with new values. 2015-03-02T12:57:14.489-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:57:14.501-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:57:14.509-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 170ms 2015-03-02T12:57:14.837-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 8355.0 } } ndeleted:14438 keyUpdates:0 writeConflicts:0 numYields:112 locks:{} 507ms 2015-03-02T12:57:14.837-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8355.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 508ms 2015-03-02T12:57:14.840-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:14.942-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (25516 records 262130704 bytes) are inconsistent with full validation results (22861 records 234851053 bytes). Updating counters with new values. 2015-03-02T12:57:14.942-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (25953 records 266615446 bytes) is inconsistent with full validation results (22861 records 234851053 bytes). Updating size storer with new values. 2015-03-02T12:57:14.942-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:14.949-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:14.951-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 111ms 2015-03-02T12:57:14.956-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:14.997-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (22861 records 234851053 bytes) is inconsistent with full validation results (22862 records 234851099 bytes). Updating size storer with new values. 2015-03-02T12:57:14.997-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:15.000-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:15.009-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:15.119-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:15.127-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:15.135-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 126ms 2015-03-02T12:57:15.140-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:15.263-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:15.270-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:15.276-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T12:57:16.035-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T12:57:16.044-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 185ms 2015-03-02T12:57:16.137-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5517.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11354 nscannedObjects:11354 nMatched:5677 nModified:5677 keyUpdates:1 writeConflicts:0 numYields:96 locks:{} 855ms 2015-03-02T12:57:16.137-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5517.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 855ms 2015-03-02T12:57:16.140-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:16.270-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (24862 records 255469405 bytes) is inconsistent with full validation results (24862 records 255470887 bytes). Updating size storer with new values. 2015-03-02T12:57:16.271-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:16.277-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:16.289-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 149ms 2015-03-02T12:57:16.307-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:16.414-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:16.420-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:16.424-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 117ms 2015-03-02T12:57:16.721-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 7807.0 } } ndeleted:5677 keyUpdates:0 writeConflicts:0 numYields:45 locks:{} 295ms 2015-03-02T12:57:16.721-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7807.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 295ms 2015-03-02T12:57:16.722-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:16.796-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (19977 records 205223777 bytes) is inconsistent with full validation results (19185 records 197087505 bytes). Updating size storer with new values. 2015-03-02T12:57:16.796-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:16.803-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:17.063-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:57:17.202-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:57:17.498-0500 I NETWORK [conn2] end connection 10.4.127.218:49855 (2 connections now open) 2015-03-02T12:57:17.542-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49857 #4 (3 connections now open) 2015-03-02T12:57:17.562-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:17.619-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (20393 records 209497289 bytes) is inconsistent with full validation results (21185 records 217633505 bytes). Updating size storer with new values. 2015-03-02T12:57:17.619-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:17.622-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:19.349-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T12:57:19.621-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:57:19.933-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 694.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:33266 nscannedObjects:33266 nMatched:16633 nModified:16633 keyUpdates:1 writeConflicts:0 numYields:276 locks:{} 2306ms 2015-03-02T12:57:19.933-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 694.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2306ms 2015-03-02T12:57:19.942-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:20.185-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25185 records 258936209 bytes) is inconsistent with full validation results (25185 records 258941734 bytes). Updating size storer with new values. 2015-03-02T12:57:20.185-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:20.191-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:20.198-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 256ms 2015-03-02T12:57:20.493-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T12:57:20.693-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T12:57:21.545-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:57:22.501-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T12:57:22.729-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T12:57:22.872-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T12:57:24.213-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T12:57:24.435-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T12:57:25.540-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 190ms 2015-03-02T12:57:25.613-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T12:57:25.617-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:57:26.088-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T12:57:26.378-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (41185 records 423309734 bytes) are inconsistent with full validation results (40185 records 413036734 bytes). Updating counters with new values. 2015-03-02T12:57:26.378-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (40760 records 418943709 bytes) is inconsistent with full validation results (40185 records 413036734 bytes). Updating size storer with new values. 2015-03-02T12:57:26.378-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:57:26.383-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:57:26.387-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 769ms 2015-03-02T12:57:26.393-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:57:26.546-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (40185 records 413036734 bytes) are inconsistent with full validation results (41185 records 423309734 bytes). Updating counters with new values. 2015-03-02T12:57:26.546-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (40185 records 413036734 bytes) is inconsistent with full validation results (41185 records 423309734 bytes). Updating size storer with new values. 2015-03-02T12:57:26.546-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:57:26.555-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:57:26.561-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T12:57:27.201-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:57:27.473-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49859 #5 (4 connections now open) 2015-03-02T12:57:27.977-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T12:57:27.987-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 7750.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6307 nscannedObjects:6307 nMatched:3139 nModified:3139 keyUpdates:1 writeConflicts:46 numYields:52 locks:{} 497ms 2015-03-02T12:57:27.987-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7750.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 497ms 2015-03-02T12:57:27.992-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:57:28.359-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 7883.0 } } ndeleted:3886 keyUpdates:0 writeConflicts:29 numYields:152 locks:{} 1794ms 2015-03-02T12:57:28.364-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7883.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1799ms 2015-03-02T12:57:28.364-0500 I NETWORK [conn1] end connection 10.4.127.218:49854 (3 connections now open) 2015-03-02T12:57:28.424-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (23147 records 237789131 bytes) are inconsistent with full validation results (25824 records 265324753 bytes). Updating counters with new values. 2015-03-02T12:57:28.424-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (23761 records 244104735 bytes) is inconsistent with full validation results (25824 records 265324753 bytes). Updating size storer with new values. 2015-03-02T12:57:28.424-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:57:28.467-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:57:28.480-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 487ms 2015-03-02T12:57:28.593-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 6934.0 } } ndeleted:1727 keyUpdates:0 writeConflicts:0 numYields:13 locks:{} 104ms 2015-03-02T12:57:28.593-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6934.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:57:28.598-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:57:28.717-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (24097 records 247583282 bytes) are inconsistent with full validation results (21420 records 220047660 bytes). Updating counters with new values. 2015-03-02T12:57:28.717-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24438 records 251086375 bytes) is inconsistent with full validation results (21420 records 220047660 bytes). Updating size storer with new values. 2015-03-02T12:57:28.717-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:57:28.730-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:57:28.733-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T12:57:28.748-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:57:28.842-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:57:28.857-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:57:28.865-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 117ms 2015-03-02T12:57:29.410-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:29.576-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T12:57:29.745-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (23420 records 240593660 bytes) are inconsistent with full validation results (22420 records 230320660 bytes). Updating counters with new values. 2015-03-02T12:57:29.745-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (23079 records 237090567 bytes) is inconsistent with full validation results (22420 records 230320660 bytes). Updating size storer with new values. 2015-03-02T12:57:29.745-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:29.748-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:29.750-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 340ms 2015-03-02T12:57:29.753-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:29.810-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (22420 records 230320660 bytes) are inconsistent with full validation results (23420 records 240593660 bytes). Updating counters with new values. 2015-03-02T12:57:29.810-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (22420 records 230320660 bytes) is inconsistent with full validation results (23420 records 240593660 bytes). Updating size storer with new values. 2015-03-02T12:57:29.811-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:29.814-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:29.829-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:29.897-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:29.908-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:30.239-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T12:57:31.037-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T12:57:31.474-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 187ms 2015-03-02T12:57:32.480-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 466.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39520 nscannedObjects:39520 nMatched:19760 nModified:19760 keyUpdates:1 writeConflicts:0 numYields:329 locks:{} 2565ms 2015-03-02T12:57:32.480-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 466.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2565ms 2015-03-02T12:57:32.481-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:32.623-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27420 records 281942540 bytes) are inconsistent with full validation results (26420 records 271669540 bytes). Updating counters with new values. 2015-03-02T12:57:32.623-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (27319 records 280904967 bytes) is inconsistent with full validation results (26420 records 271669540 bytes). Updating size storer with new values. 2015-03-02T12:57:32.623-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:32.627-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:32.634-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T12:57:32.655-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:57:32.897-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (27319 records 280904967 bytes) is inconsistent with full validation results (27420 records 281942540 bytes). Updating size storer with new values. 2015-03-02T12:57:32.898-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T12:57:32.899-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:57:32.906-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:57:32.910-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 255ms 2015-03-02T12:57:34.068-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49862 #6 (4 connections now open) 2015-03-02T12:57:34.101-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.244-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 155ms 2015-03-02T12:57:34.311-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (10248 records 105315846 bytes) are inconsistent with full validation results (11888 records 122184470 bytes). Updating counters with new values. 2015-03-02T12:57:34.312-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (10521 records 108123924 bytes) is inconsistent with full validation results (11888 records 122184470 bytes). Updating size storer with new values. 2015-03-02T12:57:34.312-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.345-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.358-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 256ms 2015-03-02T12:57:34.373-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.467-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (10475 records 107650352 bytes) are inconsistent with full validation results (10557 records 108481220 bytes). Updating counters with new values. 2015-03-02T12:57:34.467-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (11161 records 114706548 bytes) is inconsistent with full validation results (10557 records 108481220 bytes). Updating size storer with new values. 2015-03-02T12:57:34.467-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.477-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.485-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T12:57:34.589-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 1654.0 } } ndeleted:22106 keyUpdates:0 writeConflicts:0 numYields:179 locks:{} 1673ms 2015-03-02T12:57:34.590-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1654.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1673ms 2015-03-02T12:57:34.591-0500 I NETWORK [conn3] end connection 10.4.127.218:49856 (3 connections now open) 2015-03-02T12:57:34.653-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 3023.0 } } ndeleted:1977 keyUpdates:0 writeConflicts:0 numYields:15 locks:{} 162ms 2015-03-02T12:57:34.653-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3023.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T12:57:34.656-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.694-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (7059 records 72526493 bytes) are inconsistent with full validation results (6337 records 65100001 bytes). Updating counters with new values. 2015-03-02T12:57:34.694-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (7243 records 74416725 bytes) is inconsistent with full validation results (6337 records 65100001 bytes). Updating size storer with new values. 2015-03-02T12:57:34.694-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.696-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.705-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.726-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.728-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.737-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.760-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.761-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.767-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.788-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.792-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.798-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.821-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.822-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.827-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.858-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.861-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:34.872-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T12:57:34.912-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (6337 records 65100001 bytes) is inconsistent with full validation results (6338 records 65100047 bytes). Updating size storer with new values. 2015-03-02T12:57:34.913-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T12:57:34.914-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T12:57:35.221-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.266-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (8169 records 83909910 bytes) are inconsistent with full validation results (7505 records 77088638 bytes). Updating counters with new values. 2015-03-02T12:57:35.266-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (8153 records 83745542 bytes) is inconsistent with full validation results (7505 records 77088638 bytes). Updating size storer with new values. 2015-03-02T12:57:35.266-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.267-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.275-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.301-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (7674 records 78824775 bytes) are inconsistent with full validation results (8281 records 85060486 bytes). Updating counters with new values. 2015-03-02T12:57:35.301-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (7505 records 77088638 bytes) is inconsistent with full validation results (8281 records 85060486 bytes). Updating size storer with new values. 2015-03-02T12:57:35.301-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.303-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.308-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.361-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (8281 records 85060486 bytes) are inconsistent with full validation results (8338 records 85646047 bytes). Updating counters with new values. 2015-03-02T12:57:35.361-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (8281 records 85060486 bytes) is inconsistent with full validation results (8338 records 85646047 bytes). Updating size storer with new values. 2015-03-02T12:57:35.361-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.362-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.371-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.417-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.423-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.433-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.459-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.460-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.470-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.515-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.516-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.529-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.573-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.579-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.589-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.631-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.637-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.645-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.694-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.696-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.705-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.752-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.754-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.767-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:35.808-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:35.816-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:35.966-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 6250.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2002 nscannedObjects:2002 nMatched:1001 nModified:1001 keyUpdates:1 writeConflicts:0 numYields:16 locks:{} 142ms 2015-03-02T12:57:35.966-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6250.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 142ms 2015-03-02T12:57:35.970-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:36.019-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (8338 records 85656642 bytes) is inconsistent with full validation results (8338 records 85659047 bytes). Updating size storer with new values. 2015-03-02T12:57:36.019-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:36.028-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:36.039-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:57:36.080-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:57:36.090-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:57:37.472-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T12:57:38.118-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:57:38.658-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T12:57:40.004-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:57:40.831-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:57:40.836-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:57:41.023-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (22338 records 229481047 bytes) are inconsistent with full validation results (21953 records 225525942 bytes). Updating counters with new values. 2015-03-02T12:57:41.024-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (22152 records 227570269 bytes) is inconsistent with full validation results (21953 records 225525942 bytes). Updating size storer with new values. 2015-03-02T12:57:41.024-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:57:41.027-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:57:41.029-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 193ms 2015-03-02T12:57:41.049-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:57:41.123-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (21953 records 225525942 bytes) are inconsistent with full validation results (22338 records 229481047 bytes). Updating counters with new values. 2015-03-02T12:57:41.123-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21953 records 225525942 bytes) is inconsistent with full validation results (22338 records 229481047 bytes). Updating size storer with new values. 2015-03-02T12:57:41.123-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:57:41.126-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:57:42.239-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T12:57:44.573-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:57:44.815-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms2015-03-02T12:58:15.757-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:58:15.781-0500 I CONTROL [initandlisten] MongoDB starting : pid=1275 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:58:15.781-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:58:15.781-0500 I CONTROL [initandlisten] 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:58:15.784-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:58:15.795-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:58:15.879-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:58:15.879-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:58:15.879-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:58:15.957-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:58:17.448-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49885 #1 (1 connection now open) 2015-03-02T12:58:17.463-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:58:18.965-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49886 #2 (2 connections now open) 2015-03-02T12:58:19.330-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:58:19.336-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:58:19.339-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 368ms 2015-03-02T12:58:19.340-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1876ms 2015-03-02T12:58:19.349-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:58:19.359-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:58:19.474-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:58:19.482-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:58:19.484-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:58:19.487-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 138ms 2015-03-02T12:58:19.491-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:58:19.499-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 140ms 2015-03-02T12:58:19.500-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:58:19.569-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:58:19.573-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:58:19.581-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:58:19.654-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:58:19.666-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:58:22.368-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49888 #3 (3 connections now open) 2015-03-02T12:58:22.389-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:58:22.679-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (41300 records 424419152 bytes) is inconsistent with full validation results (42299 records 434681879 bytes). Updating size storer with new values. 2015-03-02T12:58:22.680-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:58:22.698-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:58:22.708-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 319ms 2015-03-02T12:58:23.125-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 205ms 2015-03-02T12:58:23.278-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 200ms 2015-03-02T12:58:24.831-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T12:58:25.078-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T12:58:26.969-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T12:58:27.064-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:58:27.346-0500 I NETWORK [conn3] end connection 10.4.127.218:49888 (2 connections now open) 2015-03-02T12:58:27.371-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49894 #4 (3 connections now open) 2015-03-02T12:58:27.398-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:27.452-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:58:27.880-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (54299 records 557957879 bytes) are inconsistent with full validation results (53773 records 552554281 bytes). Updating counters with new values. 2015-03-02T12:58:27.880-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (53300 records 547695152 bytes) is inconsistent with full validation results (53773 records 552554281 bytes). Updating size storer with new values. 2015-03-02T12:58:27.880-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:27.885-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (53773 records 552554281 bytes) are inconsistent with full validation results (54299 records 557957879 bytes). Updating counters with new values. 2015-03-02T12:58:27.885-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (53773 records 552554281 bytes) is inconsistent with full validation results (54299 records 557957879 bytes). Updating size storer with new values. 2015-03-02T12:58:27.886-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:58:27.898-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:27.902-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:58:27.910-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 511ms 2015-03-02T12:58:27.910-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 458ms 2015-03-02T12:58:29.068-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T12:58:29.155-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T12:58:30.689-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 706.0 } } ndeleted:48453 keyUpdates:0 writeConflicts:0 numYields:385 locks:{} 2773ms 2015-03-02T12:58:30.689-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 706.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2773ms 2015-03-02T12:58:30.692-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:30.843-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (9298 records 95513990 bytes) is inconsistent with full validation results (8846 records 90874958 bytes). Updating size storer with new values. 2015-03-02T12:58:30.843-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:30.855-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:30.864-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 171ms 2015-03-02T12:58:30.867-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:30.919-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:30.921-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:30.964-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:30.985-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (8846 records 90874958 bytes) is inconsistent with full validation results (8354 records 85820642 bytes). Updating size storer with new values. 2015-03-02T12:58:30.985-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:30.986-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:30.991-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:31.009-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (8354 records 85820642 bytes) is inconsistent with full validation results (8355 records 85820688 bytes). Updating size storer with new values. 2015-03-02T12:58:31.010-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:31.011-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:31.015-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:31.059-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:31.063-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:31.070-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:31.100-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:31.101-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:31.105-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:31.122-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:31.124-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:31.127-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:31.145-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:58:31.146-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:58:31.155-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:58:33.958-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49898 #5 (4 connections now open) 2015-03-02T12:58:34.129-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be058c'), x: 5032.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 33 } }, Database: { acquireCount: { w: 33 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 54325 } }, Collection: { acquireCount: { w: 33 } } } 140ms 2015-03-02T12:58:34.216-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644610f'), x: 2174.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 35 } }, Database: { acquireCount: { w: 35 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 86684 } }, Collection: { acquireCount: { w: 35 } } } 173ms 2015-03-02T12:58:34.303-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be058d'), x: 5033.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 34 } }, Database: { acquireCount: { w: 34 }, acquireWaitCount: { w: 2 }, timeAcquiringMicros: { w: 141367 } }, Collection: { acquireCount: { w: 34 } } } 174ms 2015-03-02T12:58:34.388-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446110'), x: 2175.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 36 } }, Database: { acquireCount: { w: 36 }, acquireWaitCount: { w: 2 }, timeAcquiringMicros: { w: 173811 } }, Collection: { acquireCount: { w: 36 } } } 172ms 2015-03-02T12:58:34.473-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be058e'), x: 5034.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 35 } }, Database: { acquireCount: { w: 35 }, acquireWaitCount: { w: 3 }, timeAcquiringMicros: { w: 226397 } }, Collection: { acquireCount: { w: 35 } } } 169ms 2015-03-02T12:58:34.557-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446111'), x: 2176.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 37 } }, Database: { acquireCount: { w: 37 }, acquireWaitCount: { w: 3 }, timeAcquiringMicros: { w: 258310 } }, Collection: { acquireCount: { w: 37 } } } 169ms 2015-03-02T12:58:34.645-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be058f'), x: 5035.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 36 } }, Database: { acquireCount: { w: 36 }, acquireWaitCount: { w: 4 }, timeAcquiringMicros: { w: 311169 } }, Collection: { acquireCount: { w: 36 } } } 172ms 2015-03-02T12:58:34.732-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446112'), x: 2177.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 38 } }, Database: { acquireCount: { w: 38 }, acquireWaitCount: { w: 4 }, timeAcquiringMicros: { w: 345897 } }, Collection: { acquireCount: { w: 38 } } } 174ms 2015-03-02T12:58:34.819-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0590'), x: 5036.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 37 } }, Database: { acquireCount: { w: 37 }, acquireWaitCount: { w: 5 }, timeAcquiringMicros: { w: 398465 } }, Collection: { acquireCount: { w: 37 } } } 173ms 2015-03-02T12:58:34.905-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446113'), x: 2178.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 39 } }, Database: { acquireCount: { w: 39 }, acquireWaitCount: { w: 5 }, timeAcquiringMicros: { w: 432677 } }, Collection: { acquireCount: { w: 39 } } } 173ms 2015-03-02T12:58:34.990-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0591'), x: 5037.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 38 } }, Database: { acquireCount: { w: 38 }, acquireWaitCount: { w: 6 }, timeAcquiringMicros: { w: 485093 } }, Collection: { acquireCount: { w: 38 } } } 171ms 2015-03-02T12:58:35.075-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446114'), x: 2179.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 40 } }, Database: { acquireCount: { w: 40 }, acquireWaitCount: { w: 6 }, timeAcquiringMicros: { w: 517668 } }, Collection: { acquireCount: { w: 40 } } } 169ms 2015-03-02T12:58:35.160-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0592'), x: 5038.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 39 } }, Database: { acquireCount: { w: 39 }, acquireWaitCount: { w: 7 }, timeAcquiringMicros: { w: 569557 } }, Collection: { acquireCount: { w: 39 } } } 168ms 2015-03-02T12:58:35.244-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446115'), x: 2180.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 41 } }, Database: { acquireCount: { w: 41 }, acquireWaitCount: { w: 7 }, timeAcquiringMicros: { w: 602316 } }, Collection: { acquireCount: { w: 41 } } } 168ms 2015-03-02T12:58:35.332-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0593'), x: 5039.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 40 } }, Database: { acquireCount: { w: 40 }, acquireWaitCount: { w: 8 }, timeAcquiringMicros: { w: 653655 } }, Collection: { acquireCount: { w: 40 } } } 172ms 2015-03-02T12:58:35.419-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446116'), x: 2181.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 42 } }, Database: { acquireCount: { w: 42 }, acquireWaitCount: { w: 8 }, timeAcquiringMicros: { w: 690633 } }, Collection: { acquireCount: { w: 42 } } } 175ms 2015-03-02T12:58:35.506-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0594'), x: 5040.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 41 } }, Database: { acquireCount: { w: 41 }, acquireWaitCount: { w: 9 }, timeAcquiringMicros: { w: 741185 } }, Collection: { acquireCount: { w: 41 } } } 173ms 2015-03-02T12:58:35.591-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446117'), x: 2182.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 43 } }, Database: { acquireCount: { w: 43 }, acquireWaitCount: { w: 9 }, timeAcquiringMicros: { w: 777119 } }, Collection: { acquireCount: { w: 43 } } } 171ms 2015-03-02T12:58:35.678-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0595'), x: 5041.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 42 } }, Database: { acquireCount: { w: 42 }, acquireWaitCount: { w: 10 }, timeAcquiringMicros: { w: 826056 } }, Collection: { acquireCount: { w: 42 } } } 171ms 2015-03-02T12:58:35.765-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446118'), x: 2183.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 44 } }, Database: { acquireCount: { w: 44 }, acquireWaitCount: { w: 10 }, timeAcquiringMicros: { w: 864173 } }, Collection: { acquireCount: { w: 44 } } } 174ms 2015-03-02T12:58:35.852-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0596'), x: 5042.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 43 } }, Database: { acquireCount: { w: 43 }, acquireWaitCount: { w: 11 }, timeAcquiringMicros: { w: 913821 } }, Collection: { acquireCount: { w: 43 } } } 174ms 2015-03-02T12:58:35.938-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446119'), x: 2184.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 45 } }, Database: { acquireCount: { w: 45 }, acquireWaitCount: { w: 11 }, timeAcquiringMicros: { w: 950717 } }, Collection: { acquireCount: { w: 45 } } } 171ms 2015-03-02T12:58:36.023-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0597'), x: 5043.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 44 } }, Database: { acquireCount: { w: 44 }, acquireWaitCount: { w: 12 }, timeAcquiringMicros: { w: 999402 } }, Collection: { acquireCount: { w: 44 } } } 170ms 2015-03-02T12:58:36.109-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644611a'), x: 2185.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 46 } }, Database: { acquireCount: { w: 46 }, acquireWaitCount: { w: 12 }, timeAcquiringMicros: { w: 1036061 } }, Collection: { acquireCount: { w: 46 } } } 171ms 2015-03-02T12:58:36.197-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0598'), x: 5044.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 45 } }, Database: { acquireCount: { w: 45 }, acquireWaitCount: { w: 13 }, timeAcquiringMicros: { w: 1085644 } }, Collection: { acquireCount: { w: 45 } } } 173ms 2015-03-02T12:58:36.281-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644611b'), x: 2186.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 47 } }, Database: { acquireCount: { w: 47 }, acquireWaitCount: { w: 13 }, timeAcquiringMicros: { w: 1123391 } }, Collection: { acquireCount: { w: 47 } } } 172ms 2015-03-02T12:58:36.369-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be0599'), x: 5045.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 46 } }, Database: { acquireCount: { w: 46 }, acquireWaitCount: { w: 14 }, timeAcquiringMicros: { w: 1170608 } }, Collection: { acquireCount: { w: 46 } } } 172ms 2015-03-02T12:58:36.455-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644611c'), x: 2187.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 48 } }, Database: { acquireCount: { w: 48 }, acquireWaitCount: { w: 14 }, timeAcquiringMicros: { w: 1210954 } }, Collection: { acquireCount: { w: 48 } } } 173ms 2015-03-02T12:58:36.541-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be059a'), x: 5046.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 47 } }, Database: { acquireCount: { w: 47 }, acquireWaitCount: { w: 15 }, timeAcquiringMicros: { w: 1257117 } }, Collection: { acquireCount: { w: 47 } } } 172ms 2015-03-02T12:58:36.629-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644611d'), x: 2188.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 49 } }, Database: { acquireCount: { w: 49 }, acquireWaitCount: { w: 15 }, timeAcquiringMicros: { w: 1297036 } }, Collection: { acquireCount: { w: 49 } } } 173ms 2015-03-02T12:58:36.715-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be059b'), x: 5047.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 48 } }, Database: { acquireCount: { w: 48 }, acquireWaitCount: { w: 16 }, timeAcquiringMicros: { w: 1344448 } }, Collection: { acquireCount: { w: 48 } } } 173ms 2015-03-02T12:58:36.801-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644611e'), x: 2189.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 50 } }, Database: { acquireCount: { w: 50 }, acquireWaitCount: { w: 16 }, timeAcquiringMicros: { w: 1383378 } }, Collection: { acquireCount: { w: 50 } } } 172ms 2015-03-02T12:58:36.888-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be059c'), x: 5048.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 49 } }, Database: { acquireCount: { w: 49 }, acquireWaitCount: { w: 17 }, timeAcquiringMicros: { w: 1430665 } }, Collection: { acquireCount: { w: 49 } } } 172ms 2015-03-02T12:58:36.975-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644611f'), x: 2190.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 51 } }, Database: { acquireCount: { w: 51 }, acquireWaitCount: { w: 17 }, timeAcquiringMicros: { w: 1470090 } }, Collection: { acquireCount: { w: 51 } } } 173ms 2015-03-02T12:58:37.060-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be059d'), x: 5049.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 50 } }, Database: { acquireCount: { w: 50 }, acquireWaitCount: { w: 18 }, timeAcquiringMicros: { w: 1517552 } }, Collection: { acquireCount: { w: 50 } } } 172ms 2015-03-02T12:58:37.147-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446120'), x: 2191.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 52 } }, Database: { acquireCount: { w: 52 }, acquireWaitCount: { w: 18 }, timeAcquiringMicros: { w: 1556158 } }, Collection: { acquireCount: { w: 52 } } } 172ms 2015-03-02T12:58:37.232-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be059e'), x: 5050.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 51 } }, Database: { acquireCount: { w: 51 }, acquireWaitCount: { w: 19 }, timeAcquiringMicros: { w: 1603759 } }, Collection: { acquireCount: { w: 51 } } } 171ms 2015-03-02T12:58:37.320-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446121'), x: 2192.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 53 } }, Database: { acquireCount: { w: 53 }, acquireWaitCount: { w: 19 }, timeAcquiringMicros: { w: 1641751 } }, Collection: { acquireCount: { w: 53 } } } 173ms 2015-03-02T12:58:37.405-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be059f'), x: 5051.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 52 } }, Database: { acquireCount: { w: 52 }, acquireWaitCount: { w: 20 }, timeAcquiringMicros: { w: 1691335 } }, Collection: { acquireCount: { w: 52 } } } 172ms 2015-03-02T12:58:37.490-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446122'), x: 2193.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 54 } }, Database: { acquireCount: { w: 54 }, acquireWaitCount: { w: 20 }, timeAcquiringMicros: { w: 1726536 } }, Collection: { acquireCount: { w: 54 } } } 169ms 2015-03-02T12:58:37.575-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a0'), x: 5052.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 53 } }, Database: { acquireCount: { w: 53 }, acquireWaitCount: { w: 21 }, timeAcquiringMicros: { w: 1776543 } }, Collection: { acquireCount: { w: 53 } } } 170ms 2015-03-02T12:58:37.662-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446123'), x: 2194.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 55 } }, Database: { acquireCount: { w: 55 }, acquireWaitCount: { w: 21 }, timeAcquiringMicros: { w: 1812202 } }, Collection: { acquireCount: { w: 55 } } } 171ms 2015-03-02T12:58:37.747-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a1'), x: 5053.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 54 } }, Database: { acquireCount: { w: 54 }, acquireWaitCount: { w: 22 }, timeAcquiringMicros: { w: 1862755 } }, Collection: { acquireCount: { w: 54 } } } 171ms 2015-03-02T12:58:37.835-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446124'), x: 2195.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 56 } }, Database: { acquireCount: { w: 56 }, acquireWaitCount: { w: 22 }, timeAcquiringMicros: { w: 1898188 } }, Collection: { acquireCount: { w: 56 } } } 172ms 2015-03-02T12:58:37.921-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a2'), x: 5054.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 55 } }, Database: { acquireCount: { w: 55 }, acquireWaitCount: { w: 23 }, timeAcquiringMicros: { w: 1949886 } }, Collection: { acquireCount: { w: 55 } } } 173ms 2015-03-02T12:58:38.007-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446125'), x: 2196.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 57 } }, Database: { acquireCount: { w: 57 }, acquireWaitCount: { w: 23 }, timeAcquiringMicros: { w: 1984697 } }, Collection: { acquireCount: { w: 57 } } } 171ms 2015-03-02T12:58:38.093-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a3'), x: 5055.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 56 } }, Database: { acquireCount: { w: 56 }, acquireWaitCount: { w: 24 }, timeAcquiringMicros: { w: 2035555 } }, Collection: { acquireCount: { w: 56 } } } 171ms 2015-03-02T12:58:38.178-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446126'), x: 2197.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 58 } }, Database: { acquireCount: { w: 58 }, acquireWaitCount: { w: 24 }, timeAcquiringMicros: { w: 2071160 } }, Collection: { acquireCount: { w: 58 } } } 171ms 2015-03-02T12:58:38.265-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a4'), x: 5056.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 57 } }, Database: { acquireCount: { w: 57 }, acquireWaitCount: { w: 25 }, timeAcquiringMicros: { w: 2120555 } }, Collection: { acquireCount: { w: 57 } } } 171ms 2015-03-02T12:58:38.350-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446127'), x: 2198.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 59 } }, Database: { acquireCount: { w: 59 }, acquireWaitCount: { w: 25 }, timeAcquiringMicros: { w: 2157882 } }, Collection: { acquireCount: { w: 59 } } } 171ms 2015-03-02T12:58:38.435-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a5'), x: 5057.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 58 } }, Database: { acquireCount: { w: 58 }, acquireWaitCount: { w: 26 }, timeAcquiringMicros: { w: 2205939 } }, Collection: { acquireCount: { w: 58 } } } 170ms 2015-03-02T12:58:38.521-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446128'), x: 2199.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 60 } }, Database: { acquireCount: { w: 60 }, acquireWaitCount: { w: 26 }, timeAcquiringMicros: { w: 2242763 } }, Collection: { acquireCount: { w: 60 } } } 170ms 2015-03-02T12:58:38.607-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a6'), x: 5058.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 59 } }, Database: { acquireCount: { w: 59 }, acquireWaitCount: { w: 27 }, timeAcquiringMicros: { w: 2291660 } }, Collection: { acquireCount: { w: 59 } } } 172ms 2015-03-02T12:58:38.693-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446129'), x: 2200.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 61 } }, Database: { acquireCount: { w: 61 }, acquireWaitCount: { w: 27 }, timeAcquiringMicros: { w: 2329633 } }, Collection: { acquireCount: { w: 61 } } } 172ms 2015-03-02T12:58:38.778-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a7'), x: 5059.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 60 } }, Database: { acquireCount: { w: 60 }, acquireWaitCount: { w: 28 }, timeAcquiringMicros: { w: 2377496 } }, Collection: { acquireCount: { w: 60 } } } 170ms 2015-03-02T12:58:38.864-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644612a'), x: 2201.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 62 } }, Database: { acquireCount: { w: 62 }, acquireWaitCount: { w: 28 }, timeAcquiringMicros: { w: 2414156 } }, Collection: { acquireCount: { w: 62 } } } 170ms 2015-03-02T12:58:38.950-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a8'), x: 5060.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 61 } }, Database: { acquireCount: { w: 61 }, acquireWaitCount: { w: 29 }, timeAcquiringMicros: { w: 2463541 } }, Collection: { acquireCount: { w: 61 } } } 172ms 2015-03-02T12:58:39.035-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644612b'), x: 2202.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 63 } }, Database: { acquireCount: { w: 63 }, acquireWaitCount: { w: 29 }, timeAcquiringMicros: { w: 2500467 } }, Collection: { acquireCount: { w: 63 } } } 171ms 2015-03-02T12:58:39.122-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05a9'), x: 5061.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 62 } }, Database: { acquireCount: { w: 62 }, acquireWaitCount: { w: 30 }, timeAcquiringMicros: { w: 2548497 } }, Collection: { acquireCount: { w: 62 } } } 172ms 2015-03-02T12:58:39.208-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644612c'), x: 2203.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 64 } }, Database: { acquireCount: { w: 64 }, acquireWaitCount: { w: 30 }, timeAcquiringMicros: { w: 2587817 } }, Collection: { acquireCount: { w: 64 } } } 172ms 2015-03-02T12:58:39.292-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05aa'), x: 5062.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 63 } }, Database: { acquireCount: { w: 63 }, acquireWaitCount: { w: 31 }, timeAcquiringMicros: { w: 2633877 } }, Collection: { acquireCount: { w: 63 } } } 169ms 2015-03-02T12:58:39.380-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644612d'), x: 2204.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 65 } }, Database: { acquireCount: { w: 65 }, acquireWaitCount: { w: 31 }, timeAcquiringMicros: { w: 2672370 } }, Collection: { acquireCount: { w: 65 } } } 172ms 2015-03-02T12:58:39.466-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05ab'), x: 5063.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 64 } }, Database: { acquireCount: { w: 64 }, acquireWaitCount: { w: 32 }, timeAcquiringMicros: { w: 2721706 } }, Collection: { acquireCount: { w: 64 } } } 173ms 2015-03-02T12:58:39.551-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644612e'), x: 2205.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 66 } }, Database: { acquireCount: { w: 66 }, acquireWaitCount: { w: 32 }, timeAcquiringMicros: { w: 2758626 } }, Collection: { acquireCount: { w: 66 } } } 171ms 2015-03-02T12:58:39.638-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05ac'), x: 5064.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 65 } }, Database: { acquireCount: { w: 65 }, acquireWaitCount: { w: 33 }, timeAcquiringMicros: { w: 2806931 } }, Collection: { acquireCount: { w: 65 } } } 171ms 2015-03-02T12:58:39.725-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644612f'), x: 2206.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 67 } }, Database: { acquireCount: { w: 67 }, acquireWaitCount: { w: 33 }, timeAcquiringMicros: { w: 2844816 } }, Collection: { acquireCount: { w: 67 } } } 173ms 2015-03-02T12:58:39.811-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05ad'), x: 5065.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 66 } }, Database: { acquireCount: { w: 66 }, acquireWaitCount: { w: 34 }, timeAcquiringMicros: { w: 2894704 } }, Collection: { acquireCount: { w: 66 } } } 173ms 2015-03-02T12:58:39.897-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446130'), x: 2207.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 68 } }, Database: { acquireCount: { w: 68 }, acquireWaitCount: { w: 34 }, timeAcquiringMicros: { w: 2930313 } }, Collection: { acquireCount: { w: 68 } } } 171ms 2015-03-02T12:58:39.983-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05ae'), x: 5066.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 67 } }, Database: { acquireCount: { w: 67 }, acquireWaitCount: { w: 35 }, timeAcquiringMicros: { w: 2980700 } }, Collection: { acquireCount: { w: 67 } } } 172ms 2015-03-02T12:58:40.068-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446131'), x: 2208.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 69 } }, Database: { acquireCount: { w: 69 }, acquireWaitCount: { w: 35 }, timeAcquiringMicros: { w: 3016442 } }, Collection: { acquireCount: { w: 69 } } } 171ms 2015-03-02T12:58:40.155-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05af'), x: 5067.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 68 } }, Database: { acquireCount: { w: 68 }, acquireWaitCount: { w: 36 }, timeAcquiringMicros: { w: 3066320 } }, Collection: { acquireCount: { w: 68 } } } 172ms 2015-03-02T12:58:40.243-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446132'), x: 2209.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 70 } }, Database: { acquireCount: { w: 70 }, acquireWaitCount: { w: 36 }, timeAcquiringMicros: { w: 3103104 } }, Collection: { acquireCount: { w: 70 } } } 174ms 2015-03-02T12:58:40.330-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b0'), x: 5068.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 69 } }, Database: { acquireCount: { w: 69 }, acquireWaitCount: { w: 37 }, timeAcquiringMicros: { w: 3154490 } }, Collection: { acquireCount: { w: 69 } } } 174ms 2015-03-02T12:58:40.416-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446133'), x: 2210.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 71 } }, Database: { acquireCount: { w: 71 }, acquireWaitCount: { w: 37 }, timeAcquiringMicros: { w: 3190000 } }, Collection: { acquireCount: { w: 71 } } } 172ms 2015-03-02T12:58:40.502-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b1'), x: 5069.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 70 } }, Database: { acquireCount: { w: 70 }, acquireWaitCount: { w: 38 }, timeAcquiringMicros: { w: 3240313 } }, Collection: { acquireCount: { w: 70 } } } 172ms 2015-03-02T12:58:40.587-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446134'), x: 2211.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 72 } }, Database: { acquireCount: { w: 72 }, acquireWaitCount: { w: 38 }, timeAcquiringMicros: { w: 3276598 } }, Collection: { acquireCount: { w: 72 } } } 171ms 2015-03-02T12:58:40.674-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b2'), x: 5070.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 71 } }, Database: { acquireCount: { w: 71 }, acquireWaitCount: { w: 39 }, timeAcquiringMicros: { w: 3325186 } }, Collection: { acquireCount: { w: 71 } } } 171ms 2015-03-02T12:58:40.759-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446135'), x: 2212.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 73 } }, Database: { acquireCount: { w: 73 }, acquireWaitCount: { w: 39 }, timeAcquiringMicros: { w: 3363085 } }, Collection: { acquireCount: { w: 73 } } } 171ms 2015-03-02T12:58:40.847-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b3'), x: 5071.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 72 } }, Database: { acquireCount: { w: 72 }, acquireWaitCount: { w: 40 }, timeAcquiringMicros: { w: 3410495 } }, Collection: { acquireCount: { w: 72 } } } 172ms 2015-03-02T12:58:40.935-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446136'), x: 2213.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 74 } }, Database: { acquireCount: { w: 74 }, acquireWaitCount: { w: 40 }, timeAcquiringMicros: { w: 3450783 } }, Collection: { acquireCount: { w: 74 } } } 175ms 2015-03-02T12:58:41.020-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b4'), x: 5072.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 73 } }, Database: { acquireCount: { w: 73 }, acquireWaitCount: { w: 41 }, timeAcquiringMicros: { w: 3498788 } }, Collection: { acquireCount: { w: 73 } } } 173ms 2015-03-02T12:58:41.107-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446137'), x: 2214.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 75 } }, Database: { acquireCount: { w: 75 }, acquireWaitCount: { w: 41 }, timeAcquiringMicros: { w: 3535892 } }, Collection: { acquireCount: { w: 75 } } } 171ms 2015-03-02T12:58:41.193-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b5'), x: 5073.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 74 } }, Database: { acquireCount: { w: 74 }, acquireWaitCount: { w: 42 }, timeAcquiringMicros: { w: 3585430 } }, Collection: { acquireCount: { w: 74 } } } 172ms 2015-03-02T12:58:41.278-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446138'), x: 2215.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 76 } }, Database: { acquireCount: { w: 76 }, acquireWaitCount: { w: 42 }, timeAcquiringMicros: { w: 3621693 } }, Collection: { acquireCount: { w: 76 } } } 171ms 2015-03-02T12:58:41.364-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b6'), x: 5074.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 75 } }, Database: { acquireCount: { w: 75 }, acquireWaitCount: { w: 43 }, timeAcquiringMicros: { w: 3671053 } }, Collection: { acquireCount: { w: 75 } } } 171ms 2015-03-02T12:58:41.449-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446139'), x: 2216.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 77 } }, Database: { acquireCount: { w: 77 }, acquireWaitCount: { w: 43 }, timeAcquiringMicros: { w: 3707999 } }, Collection: { acquireCount: { w: 77 } } } 170ms 2015-03-02T12:58:41.535-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b7'), x: 5075.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 76 } }, Database: { acquireCount: { w: 76 }, acquireWaitCount: { w: 44 }, timeAcquiringMicros: { w: 3755386 } }, Collection: { acquireCount: { w: 76 } } } 170ms 2015-03-02T12:58:41.623-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644613a'), x: 2217.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 78 } }, Database: { acquireCount: { w: 78 }, acquireWaitCount: { w: 44 }, timeAcquiringMicros: { w: 3793967 } }, Collection: { acquireCount: { w: 78 } } } 173ms 2015-03-02T12:58:41.710-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b8'), x: 5076.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 77 } }, Database: { acquireCount: { w: 77 }, acquireWaitCount: { w: 45 }, timeAcquiringMicros: { w: 3843478 } }, Collection: { acquireCount: { w: 77 } } } 175ms 2015-03-02T12:58:41.798-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644613b'), x: 2218.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 79 } }, Database: { acquireCount: { w: 79 }, acquireWaitCount: { w: 45 }, timeAcquiringMicros: { w: 3881464 } }, Collection: { acquireCount: { w: 79 } } } 175ms 2015-03-02T12:58:41.884-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05b9'), x: 5077.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 78 } }, Database: { acquireCount: { w: 78 }, acquireWaitCount: { w: 46 }, timeAcquiringMicros: { w: 3931309 } }, Collection: { acquireCount: { w: 78 } } } 173ms 2015-03-02T12:58:41.969-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644613c'), x: 2219.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 80 } }, Database: { acquireCount: { w: 80 }, acquireWaitCount: { w: 46 }, timeAcquiringMicros: { w: 3967532 } }, Collection: { acquireCount: { w: 80 } } } 170ms 2015-03-02T12:58:42.055-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05ba'), x: 5078.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 79 } }, Database: { acquireCount: { w: 79 }, acquireWaitCount: { w: 47 }, timeAcquiringMicros: { w: 4016151 } }, Collection: { acquireCount: { w: 79 } } } 171ms 2015-03-02T12:58:42.142-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644613d'), x: 2220.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 81 } }, Database: { acquireCount: { w: 81 }, acquireWaitCount: { w: 47 }, timeAcquiringMicros: { w: 4053828 } }, Collection: { acquireCount: { w: 81 } } } 173ms 2015-03-02T12:58:42.228-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05bb'), x: 5079.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 80 } }, Database: { acquireCount: { w: 80 }, acquireWaitCount: { w: 48 }, timeAcquiringMicros: { w: 4103225 } }, Collection: { acquireCount: { w: 80 } } } 172ms 2015-03-02T12:58:42.314-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644613e'), x: 2221.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 82 } }, Database: { acquireCount: { w: 82 }, acquireWaitCount: { w: 48 }, timeAcquiringMicros: { w: 4139342 } }, Collection: { acquireCount: { w: 82 } } } 172ms 2015-03-02T12:58:42.401-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05bc'), x: 5080.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 81 } }, Database: { acquireCount: { w: 81 }, acquireWaitCount: { w: 49 }, timeAcquiringMicros: { w: 4189838 } }, Collection: { acquireCount: { w: 81 } } } 172ms 2015-03-02T12:58:42.486-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644613f'), x: 2222.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 83 } }, Database: { acquireCount: { w: 83 }, acquireWaitCount: { w: 49 }, timeAcquiringMicros: { w: 4225605 } }, Collection: { acquireCount: { w: 83 } } } 171ms 2015-03-02T12:58:42.573-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05bd'), x: 5081.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 82 } }, Database: { acquireCount: { w: 82 }, acquireWaitCount: { w: 50 }, timeAcquiringMicros: { w: 4275497 } }, Collection: { acquireCount: { w: 82 } } } 172ms 2015-03-02T12:58:42.659-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446140'), x: 2223.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 84 } }, Database: { acquireCount: { w: 84 }, acquireWaitCount: { w: 50 }, timeAcquiringMicros: { w: 4312448 } }, Collection: { acquireCount: { w: 84 } } } 173ms 2015-03-02T12:58:42.746-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05be'), x: 5082.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 83 } }, Database: { acquireCount: { w: 83 }, acquireWaitCount: { w: 51 }, timeAcquiringMicros: { w: 4361947 } }, Collection: { acquireCount: { w: 83 } } } 173ms 2015-03-02T12:58:42.832-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446141'), x: 2224.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 85 } }, Database: { acquireCount: { w: 85 }, acquireWaitCount: { w: 51 }, timeAcquiringMicros: { w: 4399322 } }, Collection: { acquireCount: { w: 85 } } } 172ms 2015-03-02T12:58:42.918-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05bf'), x: 5083.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 84 } }, Database: { acquireCount: { w: 84 }, acquireWaitCount: { w: 52 }, timeAcquiringMicros: { w: 4447739 } }, Collection: { acquireCount: { w: 84 } } } 171ms 2015-03-02T12:58:43.003-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446142'), x: 2225.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 86 } }, Database: { acquireCount: { w: 86 }, acquireWaitCount: { w: 52 }, timeAcquiringMicros: { w: 4484907 } }, Collection: { acquireCount: { w: 86 } } } 171ms 2015-03-02T12:58:43.090-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c0'), x: 5084.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 85 } }, Database: { acquireCount: { w: 85 }, acquireWaitCount: { w: 53 }, timeAcquiringMicros: { w: 4533506 } }, Collection: { acquireCount: { w: 85 } } } 172ms 2015-03-02T12:58:43.176-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446143'), x: 2226.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 87 } }, Database: { acquireCount: { w: 87 }, acquireWaitCount: { w: 53 }, timeAcquiringMicros: { w: 4572013 } }, Collection: { acquireCount: { w: 87 } } } 172ms 2015-03-02T12:58:43.263-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c1'), x: 5085.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 86 } }, Database: { acquireCount: { w: 86 }, acquireWaitCount: { w: 54 }, timeAcquiringMicros: { w: 4619237 } }, Collection: { acquireCount: { w: 86 } } } 172ms 2015-03-02T12:58:43.348-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446144'), x: 2227.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 88 } }, Database: { acquireCount: { w: 88 }, acquireWaitCount: { w: 54 }, timeAcquiringMicros: { w: 4658558 } }, Collection: { acquireCount: { w: 88 } } } 172ms 2015-03-02T12:58:43.435-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c2'), x: 5086.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 87 } }, Database: { acquireCount: { w: 87 }, acquireWaitCount: { w: 55 }, timeAcquiringMicros: { w: 4704902 } }, Collection: { acquireCount: { w: 87 } } } 172ms 2015-03-02T12:58:43.521-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446145'), x: 2228.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 89 } }, Database: { acquireCount: { w: 89 }, acquireWaitCount: { w: 55 }, timeAcquiringMicros: { w: 4745197 } }, Collection: { acquireCount: { w: 89 } } } 172ms 2015-03-02T12:58:43.608-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c3'), x: 5087.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 88 } }, Database: { acquireCount: { w: 88 }, acquireWaitCount: { w: 56 }, timeAcquiringMicros: { w: 4790764 } }, Collection: { acquireCount: { w: 88 } } } 173ms 2015-03-02T12:58:43.693-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446146'), x: 2229.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 90 } }, Database: { acquireCount: { w: 90 }, acquireWaitCount: { w: 56 }, timeAcquiringMicros: { w: 4832495 } }, Collection: { acquireCount: { w: 90 } } } 171ms 2015-03-02T12:58:43.779-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c4'), x: 5088.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 89 } }, Database: { acquireCount: { w: 89 }, acquireWaitCount: { w: 57 }, timeAcquiringMicros: { w: 4875491 } }, Collection: { acquireCount: { w: 89 } } } 171ms 2015-03-02T12:58:43.866-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446147'), x: 2230.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 91 } }, Database: { acquireCount: { w: 91 }, acquireWaitCount: { w: 57 }, timeAcquiringMicros: { w: 4919062 } }, Collection: { acquireCount: { w: 91 } } } 173ms 2015-03-02T12:58:43.952-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c5'), x: 5089.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 90 } }, Database: { acquireCount: { w: 90 }, acquireWaitCount: { w: 58 }, timeAcquiringMicros: { w: 4962594 } }, Collection: { acquireCount: { w: 90 } } } 172ms 2015-03-02T12:58:44.037-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446148'), x: 2231.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 92 } }, Database: { acquireCount: { w: 92 }, acquireWaitCount: { w: 58 }, timeAcquiringMicros: { w: 5004492 } }, Collection: { acquireCount: { w: 92 } } } 170ms 2015-03-02T12:58:44.124-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c6'), x: 5090.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 91 } }, Database: { acquireCount: { w: 91 }, acquireWaitCount: { w: 59 }, timeAcquiringMicros: { w: 5048514 } }, Collection: { acquireCount: { w: 91 } } } 171ms 2015-03-02T12:58:44.211-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446149'), x: 2232.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 93 } }, Database: { acquireCount: { w: 93 }, acquireWaitCount: { w: 59 }, timeAcquiringMicros: { w: 5090696 } }, Collection: { acquireCount: { w: 93 } } } 173ms 2015-03-02T12:58:44.298-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c7'), x: 5091.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 92 } }, Database: { acquireCount: { w: 92 }, acquireWaitCount: { w: 60 }, timeAcquiringMicros: { w: 5135698 } }, Collection: { acquireCount: { w: 92 } } } 174ms 2015-03-02T12:58:44.385-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644614a'), x: 2233.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 94 } }, Database: { acquireCount: { w: 94 }, acquireWaitCount: { w: 60 }, timeAcquiringMicros: { w: 5177779 } }, Collection: { acquireCount: { w: 94 } } } 174ms 2015-03-02T12:58:44.471-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c8'), x: 5092.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 93 } }, Database: { acquireCount: { w: 93 }, acquireWaitCount: { w: 61 }, timeAcquiringMicros: { w: 5222995 } }, Collection: { acquireCount: { w: 93 } } } 173ms 2015-03-02T12:58:44.558-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644614b'), x: 2234.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 95 } }, Database: { acquireCount: { w: 95 }, acquireWaitCount: { w: 61 }, timeAcquiringMicros: { w: 5264189 } }, Collection: { acquireCount: { w: 95 } } } 172ms 2015-03-02T12:58:44.645-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05c9'), x: 5093.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 94 } }, Database: { acquireCount: { w: 94 }, acquireWaitCount: { w: 62 }, timeAcquiringMicros: { w: 5309595 } }, Collection: { acquireCount: { w: 94 } } } 173ms 2015-03-02T12:58:44.733-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644614c'), x: 2235.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 96 } }, Database: { acquireCount: { w: 96 }, acquireWaitCount: { w: 62 }, timeAcquiringMicros: { w: 5351135 } }, Collection: { acquireCount: { w: 96 } } } 174ms 2015-03-02T12:58:44.818-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05ca'), x: 5094.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 95 } }, Database: { acquireCount: { w: 95 }, acquireWaitCount: { w: 63 }, timeAcquiringMicros: { w: 5397499 } }, Collection: { acquireCount: { w: 95 } } } 172ms 2015-03-02T12:58:44.904-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644614d'), x: 2236.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 97 } }, Database: { acquireCount: { w: 97 }, acquireWaitCount: { w: 63 }, timeAcquiringMicros: { w: 5435883 } }, Collection: { acquireCount: { w: 97 } } } 170ms 2015-03-02T12:58:44.990-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05cb'), x: 5095.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 96 } }, Database: { acquireCount: { w: 96 }, acquireWaitCount: { w: 64 }, timeAcquiringMicros: { w: 5483495 } }, Collection: { acquireCount: { w: 96 } } } 172ms 2015-03-02T12:58:45.075-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644614e'), x: 2237.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 98 } }, Database: { acquireCount: { w: 98 }, acquireWaitCount: { w: 64 }, timeAcquiringMicros: { w: 5522058 } }, Collection: { acquireCount: { w: 98 } } } 171ms 2015-03-02T12:58:45.162-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05cc'), x: 5096.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 97 } }, Database: { acquireCount: { w: 97 }, acquireWaitCount: { w: 65 }, timeAcquiringMicros: { w: 5568953 } }, Collection: { acquireCount: { w: 97 } } } 172ms 2015-03-02T12:58:45.248-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644614f'), x: 2238.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 99 } }, Database: { acquireCount: { w: 99 }, acquireWaitCount: { w: 65 }, timeAcquiringMicros: { w: 5609376 } }, Collection: { acquireCount: { w: 99 } } } 172ms 2015-03-02T12:58:45.333-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05cd'), x: 5097.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 98 } }, Database: { acquireCount: { w: 98 }, acquireWaitCount: { w: 66 }, timeAcquiringMicros: { w: 5654331 } }, Collection: { acquireCount: { w: 98 } } } 170ms 2015-03-02T12:58:45.420-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446150'), x: 2239.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 100 } }, Database: { acquireCount: { w: 100 }, acquireWaitCount: { w: 66 }, timeAcquiringMicros: { w: 5695060 } }, Collection: { acquireCount: { w: 100 } } } 171ms 2015-03-02T12:58:45.505-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05ce'), x: 5098.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 99 } }, Database: { acquireCount: { w: 99 }, acquireWaitCount: { w: 67 }, timeAcquiringMicros: { w: 5740659 } }, Collection: { acquireCount: { w: 99 } } } 171ms 2015-03-02T12:58:45.592-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446151'), x: 2240.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 101 } }, Database: { acquireCount: { w: 101 }, acquireWaitCount: { w: 67 }, timeAcquiringMicros: { w: 5780863 } }, Collection: { acquireCount: { w: 101 } } } 172ms 2015-03-02T12:58:45.679-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05cf'), x: 5099.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 100 } }, Database: { acquireCount: { w: 100 }, acquireWaitCount: { w: 68 }, timeAcquiringMicros: { w: 5827099 } }, Collection: { acquireCount: { w: 100 } } } 173ms 2015-03-02T12:58:45.764-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446152'), x: 2241.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 102 } }, Database: { acquireCount: { w: 102 }, acquireWaitCount: { w: 68 }, timeAcquiringMicros: { w: 5868068 } }, Collection: { acquireCount: { w: 102 } } } 172ms 2015-03-02T12:58:45.849-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d0'), x: 5100.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 101 } }, Database: { acquireCount: { w: 101 }, acquireWaitCount: { w: 69 }, timeAcquiringMicros: { w: 5912486 } }, Collection: { acquireCount: { w: 101 } } } 170ms 2015-03-02T12:58:45.935-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446153'), x: 2242.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 103 } }, Database: { acquireCount: { w: 103 }, acquireWaitCount: { w: 69 }, timeAcquiringMicros: { w: 5952976 } }, Collection: { acquireCount: { w: 103 } } } 170ms 2015-03-02T12:58:46.020-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d1'), x: 5101.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 102 } }, Database: { acquireCount: { w: 102 }, acquireWaitCount: { w: 70 }, timeAcquiringMicros: { w: 5997906 } }, Collection: { acquireCount: { w: 102 } } } 170ms 2015-03-02T12:58:46.107-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446154'), x: 2243.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 104 } }, Database: { acquireCount: { w: 104 }, acquireWaitCount: { w: 70 }, timeAcquiringMicros: { w: 6038221 } }, Collection: { acquireCount: { w: 104 } } } 172ms 2015-03-02T12:58:46.194-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d2'), x: 5102.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 103 } }, Database: { acquireCount: { w: 103 }, acquireWaitCount: { w: 71 }, timeAcquiringMicros: { w: 6084816 } }, Collection: { acquireCount: { w: 103 } } } 174ms 2015-03-02T12:58:46.282-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446155'), x: 2244.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 105 } }, Database: { acquireCount: { w: 105 }, acquireWaitCount: { w: 71 }, timeAcquiringMicros: { w: 6125519 } }, Collection: { acquireCount: { w: 105 } } } 174ms 2015-03-02T12:58:46.368-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d3'), x: 5103.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 104 } }, Database: { acquireCount: { w: 104 }, acquireWaitCount: { w: 72 }, timeAcquiringMicros: { w: 6172463 } }, Collection: { acquireCount: { w: 104 } } } 173ms 2015-03-02T12:58:46.457-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446156'), x: 2245.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 106 } }, Database: { acquireCount: { w: 106 }, acquireWaitCount: { w: 72 }, timeAcquiringMicros: { w: 6211976 } }, Collection: { acquireCount: { w: 106 } } } 175ms 2015-03-02T12:58:46.542-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d4'), x: 5104.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 105 } }, Database: { acquireCount: { w: 105 }, acquireWaitCount: { w: 73 }, timeAcquiringMicros: { w: 6261631 } }, Collection: { acquireCount: { w: 105 } } } 174ms 2015-03-02T12:58:46.628-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446157'), x: 2246.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 107 } }, Database: { acquireCount: { w: 107 }, acquireWaitCount: { w: 73 }, timeAcquiringMicros: { w: 6296935 } }, Collection: { acquireCount: { w: 107 } } } 170ms 2015-03-02T12:58:46.715-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d5'), x: 5105.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 106 } }, Database: { acquireCount: { w: 106 }, acquireWaitCount: { w: 74 }, timeAcquiringMicros: { w: 6347154 } }, Collection: { acquireCount: { w: 106 } } } 172ms 2015-03-02T12:58:46.800-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446158'), x: 2247.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 108 } }, Database: { acquireCount: { w: 108 }, acquireWaitCount: { w: 74 }, timeAcquiringMicros: { w: 6383703 } }, Collection: { acquireCount: { w: 108 } } } 172ms 2015-03-02T12:58:46.886-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d6'), x: 5106.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 107 } }, Database: { acquireCount: { w: 107 }, acquireWaitCount: { w: 75 }, timeAcquiringMicros: { w: 6432739 } }, Collection: { acquireCount: { w: 107 } } } 170ms 2015-03-02T12:58:46.972-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b096446159'), x: 2248.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 109 } }, Database: { acquireCount: { w: 109 }, acquireWaitCount: { w: 75 }, timeAcquiringMicros: { w: 6469408 } }, Collection: { acquireCount: { w: 109 } } } 171ms 2015-03-02T12:58:47.058-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d7'), x: 5107.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 108 } }, Database: { acquireCount: { w: 108 }, acquireWaitCount: { w: 76 }, timeAcquiringMicros: { w: 6519043 } }, Collection: { acquireCount: { w: 108 } } } 172ms 2015-03-02T12:58:47.146-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644615a'), x: 2249.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 110 } }, Database: { acquireCount: { w: 110 }, acquireWaitCount: { w: 76 }, timeAcquiringMicros: { w: 6555975 } }, Collection: { acquireCount: { w: 110 } } } 174ms 2015-03-02T12:58:47.233-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d8'), x: 5108.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 109 } }, Database: { acquireCount: { w: 109 }, acquireWaitCount: { w: 77 }, timeAcquiringMicros: { w: 6606687 } }, Collection: { acquireCount: { w: 109 } } } 173ms 2015-03-02T12:58:47.319-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644615b'), x: 2250.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 111 } }, Database: { acquireCount: { w: 111 }, acquireWaitCount: { w: 77 }, timeAcquiringMicros: { w: 6642446 } }, Collection: { acquireCount: { w: 111 } } } 173ms 2015-03-02T12:58:47.406-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05d9'), x: 5109.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 110 } }, Database: { acquireCount: { w: 110 }, acquireWaitCount: { w: 78 }, timeAcquiringMicros: { w: 6693638 } }, Collection: { acquireCount: { w: 110 } } } 173ms 2015-03-02T12:58:47.461-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49901 #6 (5 connections now open) 2015-03-02T12:58:47.494-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644615c'), x: 2251.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 112 } }, Database: { acquireCount: { w: 112 }, acquireWaitCount: { w: 78 }, timeAcquiringMicros: { w: 6729456 } }, Collection: { acquireCount: { w: 112 } } } 174ms 2015-03-02T12:58:47.580-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4a4c5c5fb7a4843be05da'), x: 5110.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 111 } }, Database: { acquireCount: { w: 111 }, acquireWaitCount: { w: 79 }, timeAcquiringMicros: { w: 6781618 } }, Collection: { acquireCount: { w: 111 } } } 173ms 2015-03-02T12:58:47.666-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a4c6d8a738b09644615d'), x: 2252.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueL2015-03-02T12:59:15.220-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T12:59:15.236-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T12:59:15.236-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T12:59:15.236-0500 I CONTROL [initandlisten] 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T12:59:15.238-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T12:59:15.239-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T12:59:15.244-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T12:59:15.314-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T12:59:15.314-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T12:59:15.315-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T12:59:15.404-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T12:59:17.580-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49923 #1 (1 connection now open) 2015-03-02T12:59:19.112-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49924 #2 (2 connections now open) 2015-03-02T12:59:21.832-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 5849.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24696 nscannedObjects:24696 nMatched:12046 nModified:12046 keyUpdates:1 writeConflicts:744 numYields:236 locks:{} 2699ms 2015-03-02T12:59:21.832-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5849.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2700ms 2015-03-02T12:59:21.835-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:59:21.914-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 381.0 } } ndeleted:1099 keyUpdates:0 writeConflicts:146 numYields:267 locks:{} 4327ms 2015-03-02T12:59:21.914-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 381.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 4327ms 2015-03-02T12:59:21.918-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:59:22.048-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (2362 records 24255574 bytes) is inconsistent with full validation results (2286 records 23484078 bytes). Updating size storer with new values. 2015-03-02T12:59:22.048-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:59:22.050-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (2286 records 23484078 bytes) are inconsistent with full validation results (3385 records 34778152 bytes). Updating counters with new values. 2015-03-02T12:59:22.050-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (2286 records 23484078 bytes) is inconsistent with full validation results (3385 records 34778152 bytes). Updating size storer with new values. 2015-03-02T12:59:22.050-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:59:22.054-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:59:22.055-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:59:22.056-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 138ms 2015-03-02T12:59:22.057-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 221ms 2015-03-02T12:59:22.062-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:59:22.065-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:59:22.070-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (3385 records 34778152 bytes) are inconsistent with full validation results (2286 records 23484078 bytes). Updating counters with new values. 2015-03-02T12:59:22.070-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (3385 records 34778152 bytes) is inconsistent with full validation results (2286 records 23484078 bytes). Updating size storer with new values. 2015-03-02T12:59:22.072-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:59:22.073-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:59:22.074-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:59:22.074-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:59:22.077-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:59:22.080-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:59:22.084-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:59:22.085-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:59:22.088-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:59:22.089-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:59:22.092-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:59:22.098-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:59:22.099-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:59:22.498-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49925 #3 (3 connections now open) 2015-03-02T12:59:22.511-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.517-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (2286 records 23484078 bytes) is inconsistent with full validation results (2287 records 23484124 bytes). Updating size storer with new values. 2015-03-02T12:59:22.518-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.518-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.528-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.532-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.536-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.541-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.549-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.549-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.557-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.565-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (2287 records 23484124 bytes) is inconsistent with full validation results (2286 records 23484078 bytes). Updating size storer with new values. 2015-03-02T12:59:22.565-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.566-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.581-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.586-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (2329 records 23915590 bytes) are inconsistent with full validation results (2327 records 23895044 bytes). Updating counters with new values. 2015-03-02T12:59:22.586-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (2286 records 23484078 bytes) is inconsistent with full validation results (2327 records 23895044 bytes). Updating size storer with new values. 2015-03-02T12:59:22.586-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.586-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.597-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.603-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (2567 records 26360564 bytes) are inconsistent with full validation results (2551 records 26196196 bytes). Updating counters with new values. 2015-03-02T12:59:22.603-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (2327 records 23895044 bytes) is inconsistent with full validation results (2551 records 26196196 bytes). Updating size storer with new values. 2015-03-02T12:59:22.603-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.605-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.615-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.623-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (2905 records 29832838 bytes) are inconsistent with full validation results (2858 records 29350007 bytes). Updating counters with new values. 2015-03-02T12:59:22.623-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (2551 records 26196196 bytes) is inconsistent with full validation results (2858 records 29350007 bytes). Updating size storer with new values. 2015-03-02T12:59:22.623-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.625-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.634-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.644-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (3190 records 32770870 bytes) are inconsistent with full validation results (3160 records 32462680 bytes). Updating counters with new values. 2015-03-02T12:59:22.644-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (3140 records 32257220 bytes) is inconsistent with full validation results (3160 records 32462680 bytes). Updating size storer with new values. 2015-03-02T12:59:22.645-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.646-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.812-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 266.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2848 nscannedObjects:2848 nMatched:1424 nModified:1424 keyUpdates:1 writeConflicts:0 numYields:23 locks:{} 156ms 2015-03-02T12:59:22.813-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 266.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 156ms 2015-03-02T12:59:22.814-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.823-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (3191 records 32799655 bytes) are inconsistent with full validation results (3286 records 33775590 bytes). Updating counters with new values. 2015-03-02T12:59:22.823-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (3191 records 32793090 bytes) is inconsistent with full validation results (3286 records 33775590 bytes). Updating size storer with new values. 2015-03-02T12:59:22.823-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.824-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:22.837-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T12:59:22.849-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T12:59:22.849-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T12:59:26.373-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T12:59:27.136-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T12:59:27.483-0500 I NETWORK [conn3] end connection 10.4.127.218:49925 (2 connections now open) 2015-03-02T12:59:27.504-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49926 #4 (3 connections now open) 2015-03-02T12:59:27.510-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:59:27.616-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (11781 records 121044725 bytes) is inconsistent with full validation results (12286 records 126232590 bytes). Updating size storer with new values. 2015-03-02T12:59:27.617-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:59:27.618-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:59:27.619-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T12:59:27.623-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T12:59:27.656-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T12:59:27.657-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T12:59:28.455-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T12:59:30.803-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T12:59:31.043-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T12:59:32.729-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:59:32.939-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (21781 records 223774725 bytes) is inconsistent with full validation results (22286 records 228962590 bytes). Updating size storer with new values. 2015-03-02T12:59:32.939-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:59:32.947-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:59:32.949-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 220ms 2015-03-02T12:59:33.306-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T12:59:33.889-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2702.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22636 nscannedObjects:22636 nMatched:11318 nModified:11318 keyUpdates:1 writeConflicts:0 numYields:180 locks:{} 939ms 2015-03-02T12:59:33.894-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2702.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 943ms 2015-03-02T12:59:33.897-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:59:33.960-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:59:33.963-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:59:33.986-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T12:59:34.119-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T12:59:34.121-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49927 #5 (4 connections now open) 2015-03-02T12:59:34.134-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T12:59:34.138-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T12:59:34.138-0500 I NETWORK [conn2] end connection 10.4.127.218:49924 (3 connections now open) 2015-03-02T12:59:34.152-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:59:34.261-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T12:59:34.293-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (24286 records 249637212 bytes) are inconsistent with full validation results (23484 records 241398266 bytes). Updating counters with new values. 2015-03-02T12:59:34.293-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (23463 records 241182533 bytes) is inconsistent with full validation results (23484 records 241398266 bytes). Updating size storer with new values. 2015-03-02T12:59:34.294-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:59:34.305-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:59:34.312-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 160ms 2015-03-02T12:59:37.287-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T12:59:37.300-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T12:59:38.839-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T12:59:39.571-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T12:59:40.504-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:59:41.183-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (38484 records 395493266 bytes) are inconsistent with full validation results (38998 records 400773588 bytes). Updating counters with new values. 2015-03-02T12:59:41.183-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37661 records 387038587 bytes) is inconsistent with full validation results (38998 records 400773588 bytes). Updating size storer with new values. 2015-03-02T12:59:41.183-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:59:41.195-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:59:41.200-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 696ms 2015-03-02T12:59:41.799-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T12:59:42.219-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 192ms 2015-03-02T12:59:43.068-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7314.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29380 nscannedObjects:29380 nMatched:14690 nModified:14690 keyUpdates:1 writeConflicts:0 numYields:240 locks:{} 1862ms 2015-03-02T12:59:43.068-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7314.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1862ms 2015-03-02T12:59:43.072-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T12:59:43.245-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T12:59:43.248-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T12:59:43.492-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (41998 records 431636424 bytes) are inconsistent with full validation results (41286 records 424322048 bytes). Updating counters with new values. 2015-03-02T12:59:43.492-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (41485 records 426366375 bytes) is inconsistent with full validation results (41286 records 424322048 bytes). Updating size storer with new values. 2015-03-02T12:59:43.493-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T12:59:43.509-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T12:59:43.537-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 464ms 2015-03-02T12:59:43.540-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (41286 records 424322048 bytes) are inconsistent with full validation results (42286 records 434595048 bytes). Updating counters with new values. 2015-03-02T12:59:43.541-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (41286 records 424322048 bytes) is inconsistent with full validation results (42286 records 434595048 bytes). Updating size storer with new values. 2015-03-02T12:59:43.542-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T12:59:43.557-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T12:59:43.580-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 331ms 2015-03-02T12:59:44.488-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 268ms 2015-03-02T12:59:45.180-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T12:59:46.858-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 191ms 2015-03-02T12:59:47.111-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered2015-03-02T13:01:20.924-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:01:20.941-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:01:20.941-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:01:20.941-0500 I CONTROL [initandlisten] 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:01:20.942-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:01:20.947-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:01:21.026-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:01:21.026-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:01:21.026-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:01:21.122-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:01:27.540-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49970 #1 (1 connection now open) 2015-03-02T13:01:27.628-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49971 #2 (2 connections now open) 2015-03-02T13:01:29.141-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49972 #3 (3 connections now open) 2015-03-02T13:01:29.167-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:01:30.913-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5079.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:23461 nscannedObjects:23461 nMatched:11436 nModified:11436 keyUpdates:1 writeConflicts:640 numYields:259 locks:{} 3363ms 2015-03-02T13:01:30.913-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5079.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3363ms 2015-03-02T13:01:30.919-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:31.353-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 6134.0 } } ndeleted:11511 keyUpdates:0 writeConflicts:131 numYields:183 locks:{} 3707ms 2015-03-02T13:01:31.353-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6134.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3707ms 2015-03-02T13:01:31.358-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:01:32.013-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16734 records 171906371 bytes) is inconsistent with full validation results (16101 records 165405573 bytes). Updating size storer with new values. 2015-03-02T13:01:32.013-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:01:32.014-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16101 records 165405573 bytes) are inconsistent with full validation results (20243 records 207999945 bytes). Updating counters with new values. 2015-03-02T13:01:32.014-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16101 records 165405573 bytes) is inconsistent with full validation results (20243 records 207999945 bytes). Updating size storer with new values. 2015-03-02T13:01:32.014-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:32.015-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (20243 records 207999945 bytes) are inconsistent with full validation results (28822 records 296243539 bytes). Updating counters with new values. 2015-03-02T13:01:32.015-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20243 records 207999945 bytes) is inconsistent with full validation results (28822 records 296243539 bytes). Updating size storer with new values. 2015-03-02T13:01:32.015-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:01:32.031-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:32.033-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:01:32.036-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2868ms 2015-03-02T13:01:32.036-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:01:32.039-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1120ms 2015-03-02T13:01:32.049-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 691ms 2015-03-02T13:01:33.426-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:01:34.063-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 317.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28398 nscannedObjects:28398 nMatched:14199 nModified:14199 keyUpdates:1 writeConflicts:0 numYields:236 locks:{} 2017ms 2015-03-02T13:01:34.063-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 317.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2017ms 2015-03-02T13:01:34.065-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:34.071-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 217ms 2015-03-02T13:01:34.108-0500 I NETWORK [conn3] end connection 10.4.127.218:49972 (2 connections now open) 2015-03-02T13:01:34.161-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49975 #4 (3 connections now open) 2015-03-02T13:01:34.208-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (30822 records 316974126 bytes) are inconsistent with full validation results (18084 records 185961519 bytes). Updating counters with new values. 2015-03-02T13:01:34.208-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29990 records 308426990 bytes) is inconsistent with full validation results (18084 records 185961519 bytes). Updating size storer with new values. 2015-03-02T13:01:34.208-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:34.215-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:34.223-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 157ms 2015-03-02T13:01:35.165-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8546.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:15478 nscannedObjects:15478 nMatched:7716 nModified:7716 keyUpdates:1 writeConflicts:124 numYields:127 locks:{} 938ms 2015-03-02T13:01:35.165-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8546.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 938ms 2015-03-02T13:01:35.169-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.263-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (9646 records 99168251 bytes) are inconsistent with full validation results (10821 records 111254080 bytes). Updating counters with new values. 2015-03-02T13:01:35.263-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9662 records 99332827 bytes) is inconsistent with full validation results (10821 records 111254080 bytes). Updating size storer with new values. 2015-03-02T13:01:35.263-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.271-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.278-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T13:01:35.612-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5061.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5915 nscannedObjects:5915 nMatched:2942 nModified:2942 keyUpdates:1 writeConflicts:66 numYields:48 locks:{} 331ms 2015-03-02T13:01:35.612-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5061.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 331ms 2015-03-02T13:01:35.618-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.663-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (6924 records 71169538 bytes) are inconsistent with full validation results (6392 records 65697386 bytes). Updating counters with new values. 2015-03-02T13:01:35.663-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (7779 records 79964068 bytes) is inconsistent with full validation results (6392 records 65697386 bytes). Updating size storer with new values. 2015-03-02T13:01:35.663-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.670-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.687-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.720-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (5711 records 58692620 bytes) are inconsistent with full validation results (5450 records 56007974 bytes). Updating counters with new values. 2015-03-02T13:01:35.720-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6247 records 64205916 bytes) is inconsistent with full validation results (5450 records 56007974 bytes). Updating size storer with new values. 2015-03-02T13:01:35.720-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.721-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.765-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.770-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 4147.0 } } ndeleted:0 keyUpdates:0 writeConflicts:109 numYields:71 locks:{} 1541ms 2015-03-02T13:01:35.770-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4147.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1541ms 2015-03-02T13:01:35.774-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:01:35.784-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (4267 records 43839636 bytes) are inconsistent with full validation results (3902 records 40085246 bytes). Updating counters with new values. 2015-03-02T13:01:35.785-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (4986 records 51235270 bytes) is inconsistent with full validation results (3902 records 40085246 bytes). Updating size storer with new values. 2015-03-02T13:01:35.785-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.786-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.787-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:01:35.788-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:01:35.792-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.799-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:01:35.809-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (3903 records 40085292 bytes) are inconsistent with full validation results (3902 records 40085246 bytes). Updating counters with new values. 2015-03-02T13:01:35.809-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.810-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.812-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (3902 records 40085246 bytes) are inconsistent with full validation results (3903 records 40085292 bytes). Updating counters with new values. 2015-03-02T13:01:35.812-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (3902 records 40085246 bytes) is inconsistent with full validation results (3903 records 40085292 bytes). Updating size storer with new values. 2015-03-02T13:01:35.812-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:01:35.813-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:01:35.820-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.836-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.836-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.843-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.860-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.861-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.869-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:35.885-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (3903 records 40085292 bytes) is inconsistent with full validation results (3902 records 40085246 bytes). Updating size storer with new values. 2015-03-02T13:01:35.886-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:35.887-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:35.988-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:36.000-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1623 records 16673079 bytes) is inconsistent with full validation results (1528 records 15697144 bytes). Updating size storer with new values. 2015-03-02T13:01:36.000-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:36.001-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:36.014-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:36.019-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:36.020-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:36.028-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:36.206-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1543 records 15851239 bytes) are inconsistent with full validation results (1528 records 15697144 bytes). Updating counters with new values. 2015-03-02T13:01:36.207-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:36.207-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:36.207-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 179ms 2015-03-02T13:01:36.216-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:36.224-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (1681 records 17258686 bytes) are inconsistent with full validation results (1606 records 16488211 bytes). Updating counters with new values. 2015-03-02T13:01:36.224-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (1528 records 15697144 bytes) is inconsistent with full validation results (1606 records 16488211 bytes). Updating size storer with new values. 2015-03-02T13:01:36.224-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:36.227-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:36.264-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 232ms 2015-03-02T13:01:37.626-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:01:38.506-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:01:40.160-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T13:01:42.978-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 182ms 2015-03-02T13:01:42.981-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 177ms 2015-03-02T13:01:46.572-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:01:46.893-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T13:01:47.168-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (26819 records 275501360 bytes) are inconsistent with full validation results (25529 records 262249190 bytes). Updating counters with new values. 2015-03-02T13:01:47.168-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (26343 records 270611412 bytes) is inconsistent with full validation results (25529 records 262249190 bytes). Updating size storer with new values. 2015-03-02T13:01:47.169-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:01:47.179-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:01:47.188-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 616ms 2015-03-02T13:01:47.211-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:01:47.252-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T13:01:47.394-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (26149 records 268618450 bytes) are inconsistent with full validation results (27270 records 280134483 bytes). Updating counters with new values. 2015-03-02T13:01:47.394-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (26053 records 267632242 bytes) is inconsistent with full validation results (27270 records 280134483 bytes). Updating size storer with new values. 2015-03-02T13:01:47.394-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:01:47.405-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:01:47.412-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 201ms 2015-03-02T13:01:47.417-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:01:47.531-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (27270 records 280134483 bytes) are inconsistent with full validation results (27529 records 282795190 bytes). Updating counters with new values. 2015-03-02T13:01:47.531-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (27270 records 280134483 bytes) is inconsistent with full validation results (27529 records 282795190 bytes). Updating size storer with new values. 2015-03-02T13:01:47.531-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:01:47.535-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:01:47.538-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 121ms 2015-03-02T13:01:47.600-0500 I NETWORK [conn2] end connection 10.4.127.218:49971 (2 connections now open) 2015-03-02T13:01:47.655-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49978 #5 (3 connections now open) 2015-03-02T13:01:48.824-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T13:01:48.830-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:49.038-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (28529 records 293200400 bytes) are inconsistent with full validation results (28529 records 293179639 bytes). Updating counters with new values. 2015-03-02T13:01:49.038-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (28529 records 293196942 bytes) is inconsistent with full validation results (28529 records 293179639 bytes). Updating size storer with new values. 2015-03-02T13:01:49.038-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:49.048-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:49.061-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 231ms 2015-03-02T13:01:49.078-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:49.348-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29394 records 302090419 bytes) are inconsistent with full validation results (28529 records 293205171 bytes). Updating counters with new values. 2015-03-02T13:01:49.348-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29369 records 301833581 bytes) is inconsistent with full validation results (28529 records 293205171 bytes). Updating size storer with new values. 2015-03-02T13:01:49.353-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:49.364-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:49.371-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 292ms 2015-03-02T13:01:49.391-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:49.414-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 231ms 2015-03-02T13:01:49.662-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (28664 records 294607652 bytes) are inconsistent with full validation results (29401 records 302183299 bytes). Updating counters with new values. 2015-03-02T13:01:49.662-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (28664 records 294602933 bytes) is inconsistent with full validation results (29401 records 302183299 bytes). Updating size storer with new values. 2015-03-02T13:01:49.667-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:49.678-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:49.692-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 301ms 2015-03-02T13:01:49.713-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:49.908-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29401 records 302201304 bytes) are inconsistent with full validation results (29529 records 303516807 bytes). Updating counters with new values. 2015-03-02T13:01:49.911-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29401 records 302191580 bytes) is inconsistent with full validation results (29529 records 303516807 bytes). Updating size storer with new values. 2015-03-02T13:01:49.911-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:49.920-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:49.927-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 213ms 2015-03-02T13:01:49.948-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:50.150-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29529 records 303534474 bytes) are inconsistent with full validation results (29529 records 303535579 bytes). Updating counters with new values. 2015-03-02T13:01:50.150-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29529 records 303532498 bytes) is inconsistent with full validation results (29529 records 303535579 bytes). Updating size storer with new values. 2015-03-02T13:01:50.150-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:50.163-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:50.169-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 221ms 2015-03-02T13:01:50.205-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:50.294-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4250.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32114 nscannedObjects:32114 nMatched:16057 nModified:16057 keyUpdates:1 writeConflicts:0 numYields:276 locks:{} 2629ms 2015-03-02T13:01:50.294-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4250.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2629ms 2015-03-02T13:01:50.302-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:01:50.394-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29529 records 303535579 bytes) are inconsistent with full validation results (29529 records 303549918 bytes). Updating counters with new values. 2015-03-02T13:01:50.394-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29529 records 303535579 bytes) is inconsistent with full validation results (29529 records 303549918 bytes). Updating size storer with new values. 2015-03-02T13:01:50.395-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:50.404-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:50.409-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 204ms 2015-03-02T13:01:50.490-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:01:50.502-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:01:50.510-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 208ms 2015-03-02T13:01:50.534-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:01:50.712-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:01:50.726-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:01:50.731-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 196ms 2015-03-02T13:01:52.039-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 243ms 2015-03-02T13:01:52.042-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:01:52.396-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:01:52.416-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:01:52.448-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 405ms 2015-03-02T13:01:52.471-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:01:52.723-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:01:52.742-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:01:52.751-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 280ms 2015-03-02T13:01:52.769-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:01:53.047-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:01:53.070-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:01:53.083-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 313ms 2015-03-02T13:01:54.173-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8457.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:30432 nscannedObjects:30432 nMatched:14640 nModified:14640 keyUpdates:1 writeConflicts:3424 numYields:300 locks:{} 3758ms 2015-03-02T13:01:54.173-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8457.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3758ms 2015-03-02T13:01:54.177-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:54.454-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23309 records 239569568 bytes) are inconsistent with full validation results (25206 records 259082110 bytes). Updating counters with new values. 2015-03-02T13:01:54.457-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23393 records 240433592 bytes) is inconsistent with full validation results (25185 records 258866104 bytes). Updating size storer with new values. 2015-03-02T13:01:54.457-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:54.504-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:54.517-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 339ms 2015-03-02T13:01:54.542-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:01:54.783-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23332 records 239806146 bytes) are inconsistent with full validation results (22905 records 235414024 bytes). Updating counters with new values. 2015-03-02T13:01:54.783-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23449 records 241009608 bytes) is inconsistent with full validation results (22905 records 235414024 bytes). Updating size storer with new values. 2015-03-02T13:01:54.783-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:01:54.803-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:01:54.815-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 272ms 2015-03-02T13:01:55.055-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 9721.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:18382 nscannedObjects:18382 nMatched:7220 nModified:7220 keyUpdates:1 writeConflicts:15652 numYields:258 locks:{} 4313ms 2015-03-02T13:01:55.058-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9721.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4316ms 2015-03-02T13:01:55.069-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:01:55.329-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (20452 records 210182466 bytes) are inconsistent with full validation results (20137 records 206942376 bytes). Updating counters with new values. 2015-03-02T13:01:55.329-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21022 records 216045486 bytes) is inconsistent with full validation results (20137 records 206942376 bytes). Updating size storer with new values. 2015-03-02T13:01:55.329-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:01:55.342-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:01:55.346-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 277ms 2015-03-02T13:01:55.360-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:01:55.527-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (18398 records 189055022 bytes) are inconsistent with full validation results (18655 records 191698524 bytes). Updating counters with new values. 2015-03-02T13:01:55.527-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18707 records 192233396 bytes) is inconsistent with full validation results (18655 records 191698524 bytes). Updating size storer with new values. 2015-03-02T13:01:55.527-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:01:55.534-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:01:55.545-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 184ms 2015-03-02015-03-02T13:02:27.256-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:02:27.284-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:02:27.284-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:02:27.284-0500 I CONTROL [initandlisten] 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:02:27.290-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:02:27.298-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:02:27.376-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:02:27.376-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:02:27.376-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:02:27.531-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:02:27.559-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49995 #1 (1 connection now open) 2015-03-02T13:02:32.650-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49996 #2 (2 connections now open) 2015-03-02T13:02:32.687-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49997 #3 (3 connections now open) 2015-03-02T13:02:32.728-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:02:33.197-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T13:02:33.202-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:02:34.153-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:49998 #4 (4 connections now open) 2015-03-02T13:02:35.847-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486116403 bytes) are inconsistent with full validation results (46299 records 475777519 bytes). Updating counters with new values. 2015-03-02T13:02:35.847-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486111892 bytes) is inconsistent with full validation results (46299 records 475777519 bytes). Updating size storer with new values. 2015-03-02T13:02:35.847-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:02:35.851-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (46299 records 475777519 bytes) are inconsistent with full validation results (47299 records 486071735 bytes). Updating counters with new values. 2015-03-02T13:02:35.851-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (46299 records 475777519 bytes) is inconsistent with full validation results (47299 records 486071735 bytes). Updating size storer with new values. 2015-03-02T13:02:35.851-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:02:35.860-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:02:35.863-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:02:35.866-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 3138ms 2015-03-02T13:02:35.872-0500 I COMMAND [conn4] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1712ms 2015-03-02T13:02:35.874-0500 I NETWORK [conn3] end connection 10.4.127.218:49997 (3 connections now open) 2015-03-02T13:02:35.877-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2674ms 2015-03-02T13:02:35.906-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:02:36.120-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486094875 bytes) are inconsistent with full validation results (47299 records 486119731 bytes). Updating counters with new values. 2015-03-02T13:02:36.120-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486093224 bytes) is inconsistent with full validation results (47299 records 486119731 bytes). Updating size storer with new values. 2015-03-02T13:02:36.121-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:02:36.131-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:02:36.138-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 231ms 2015-03-02T13:02:37.419-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:02:38.533-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 181ms 2015-03-02T13:02:38.843-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:02:39.681-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2665.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:68880 nscannedObjects:68880 nMatched:34440 nModified:34440 keyUpdates:1 writeConflicts:0 numYields:596 locks:{} 7023ms 2015-03-02T13:02:39.681-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2665.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 7023ms 2015-03-02T13:02:39.685-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:02:40.118-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (50299 records 517139295 bytes) are inconsistent with full validation results (50299 records 517159107 bytes). Updating counters with new values. 2015-03-02T13:02:40.118-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (50299 records 517139295 bytes) is inconsistent with full validation results (50299 records 517159107 bytes). Updating size storer with new values. 2015-03-02T13:02:40.118-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:02:40.130-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:02:40.181-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 496ms 2015-03-02T13:02:40.397-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:02:42.288-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T13:02:42.938-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T13:02:43.634-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:02:45.124-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:02:45.166-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1227.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:81494 nscannedObjects:81494 nMatched:40747 nModified:40747 keyUpdates:1 writeConflicts:0 numYields:668 locks:{} 4975ms 2015-03-02T13:02:45.166-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1227.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4975ms 2015-03-02T13:02:45.169-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:02:45.634-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T13:02:45.816-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (57299 records 589152098 bytes) are inconsistent with full validation results (56299 records 578879098 bytes). Updating counters with new values. 2015-03-02T13:02:45.817-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (57113 records 587241320 bytes) is inconsistent with full validation results (56299 records 578879098 bytes). Updating size storer with new values. 2015-03-02T13:02:45.817-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:02:45.841-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:02:45.849-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 680ms 2015-03-02T13:02:45.872-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:02:46.381-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (56299 records 578879098 bytes) are inconsistent with full validation results (57299 records 589152098 bytes). Updating counters with new values. 2015-03-02T13:02:46.381-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (56299 records 578879098 bytes) is inconsistent with full validation results (57299 records 589152098 bytes). Updating size storer with new values. 2015-03-02T13:02:46.381-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:02:46.393-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:02:46.409-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 537ms 2015-03-02T13:02:46.436-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:02:46.628-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T13:02:46.792-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (58299 records 599425098 bytes) are inconsistent with full validation results (57299 records 589152098 bytes). Updating counters with new values. 2015-03-02T13:02:46.792-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (58113 records 597514320 bytes) is inconsistent with full validation results (57299 records 589152098 bytes). Updating size storer with new values. 2015-03-02T13:02:46.793-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:02:46.803-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:02:46.808-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 371ms 2015-03-02T13:02:47.651-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50003 #5 (4 connections now open) 2015-03-02T13:02:48.020-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:02:48.586-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 219ms 2015-03-02T13:02:50.325-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 188ms 2015-03-02T13:02:51.006-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 200ms 2015-03-02T13:02:52.102-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 212ms 2015-03-02T13:02:52.106-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:02:52.980-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (28274 records 290679871 bytes) are inconsistent with full validation results (35586 records 365875789 bytes). Updating counters with new values. 2015-03-02T13:02:52.980-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (28842 records 296522319 bytes) is inconsistent with full validation results (35586 records 365875789 bytes). Updating size storer with new values. 2015-03-02T13:02:52.980-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:02:53.000-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:02:53.015-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 908ms 2015-03-02T13:02:53.537-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1164.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:74689 nscannedObjects:74689 nMatched:37749 nModified:37749 keyUpdates:1 writeConflicts:231 numYields:651 locks:{} 6727ms 2015-03-02T13:02:53.537-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1164.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6727ms 2015-03-02T13:02:53.537-0500 I NETWORK [conn2] end connection 10.4.127.218:49996 (3 connections now open) 2015-03-02T13:02:53.792-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:02:54.412-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 5143.0 } } ndeleted:24886 keyUpdates:0 writeConflicts:169 numYields:393 locks:{} 6740ms 2015-03-02T13:02:54.412-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5143.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 6740ms 2015-03-02T13:02:54.416-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:02:54.619-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:02:54.658-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (19793 records 203413231 bytes) are inconsistent with full validation results (12481 records 128217313 bytes). Updating counters with new values. 2015-03-02T13:02:54.658-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18984 records 195102374 bytes) is inconsistent with full validation results (12481 records 128217313 bytes). Updating size storer with new values. 2015-03-02T13:02:54.659-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:02:54.677-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:02:54.685-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 265ms 2015-03-02T13:02:54.690-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:02:54.773-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (12481 records 128217313 bytes) are inconsistent with full validation results (13481 records 138490313 bytes). Updating counters with new values. 2015-03-02T13:02:54.773-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (12481 records 128217313 bytes) is inconsistent with full validation results (13481 records 138490313 bytes). Updating size storer with new values. 2015-03-02T13:02:54.773-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:02:54.780-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:02:55.005-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3278.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4286 nscannedObjects:4286 nMatched:2143 nModified:2143 keyUpdates:1 writeConflicts:0 numYields:35 locks:{} 216ms 2015-03-02T13:02:55.005-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3278.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 216ms 2015-03-02T13:02:55.007-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:02:55.055-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (13481 records 138505796 bytes) is inconsistent with full validation results (13481 records 138518172 bytes). Updating size storer with new values. 2015-03-02T13:02:55.056-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:02:55.063-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:02:55.138-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:02:55.176-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (11433 records 117452444 bytes) is inconsistent with full validation results (11338 records 116475274 bytes). Updating size storer with new values. 2015-03-02T13:02:55.177-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:02:55.180-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:02:55.193-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:02:55.257-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:02:55.261-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:02:56.920-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:02:57.581-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50004 #6 (4 connections now open) 2015-03-02T13:02:57.596-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:02:57.715-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15243 records 156591339 bytes) is inconsistent with full validation results (15338 records 157567274 bytes). Updating size storer with new values. 2015-03-02T13:02:57.715-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:02:57.718-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:02:57.719-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 123ms 2015-03-02T13:02:57.723-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:02:57.785-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:02:57.788-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:02:57.821-0500 I NETWORK [conn1] end connection 10.4.127.218:49995 (3 connections now open) 2015-03-02T13:02:58.033-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6135.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4000 nscannedObjects:4000 nMatched:2000 nModified:2000 keyUpdates:1 writeConflicts:0 numYields:32 locks:{} 238ms 2015-03-02T13:02:58.033-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6135.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 238ms 2015-03-02T13:02:58.037-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:02:58.052-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T13:02:58.121-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (16338 records 167866274 bytes) are inconsistent with full validation results (16234 records 166797882 bytes). Updating counters with new values. 2015-03-02T13:02:58.121-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (16243 records 166890339 bytes) is inconsistent with full validation results (16234 records 166797882 bytes). Updating size storer with new values. 2015-03-02T13:02:58.121-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:02:58.124-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:02:58.138-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:02:58.188-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (16234 records 166797882 bytes) are inconsistent with full validation results (16338 records 167866274 bytes). Updating counters with new values. 2015-03-02T13:02:58.188-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (16234 records 166797882 bytes) is inconsistent with full validation results (16338 records 167866274 bytes). Updating size storer with new values. 2015-03-02T13:02:58.188-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:02:58.191-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:02:58.767-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:02:58.818-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17243 records 177163339 bytes) is inconsistent with full validation results (17338 records 2015-03-02T13:03:27.889-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:03:27.904-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:03:27.904-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:03:27.904-0500 I CONTROL [initandlisten] 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:03:27.907-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:03:27.915-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:03:27.975-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:03:27.975-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:03:27.975-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:03:28.067-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:03:32.667-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50015 #1 (1 connection now open) 2015-03-02T13:03:32.679-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:03:34.183-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50016 #2 (2 connections now open) 2015-03-02T13:03:34.409-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:03:34.415-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:03:34.418-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 228ms 2015-03-02T13:03:34.419-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1738ms 2015-03-02T13:03:34.429-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:03:34.555-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383332076 bytes) are inconsistent with full validation results (37299 records 383317542 bytes). Updating counters with new values. 2015-03-02T13:03:34.555-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329892 bytes) is inconsistent with full validation results (37299 records 383317542 bytes). Updating size storer with new values. 2015-03-02T13:03:34.555-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:03:34.562-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:03:34.567-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 138ms 2015-03-02T13:03:36.244-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:03:37.476-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 29.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:74250 nscannedObjects:74250 nMatched:37125 nModified:37125 keyUpdates:1 writeConflicts:0 numYields:583 locks:{} 3053ms 2015-03-02T13:03:37.477-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 29.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3053ms 2015-03-02T13:03:37.482-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:03:37.588-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50018 #3 (3 connections now open) 2015-03-02T13:03:37.622-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (39210 records 403262181 bytes) are inconsistent with full validation results (38299 records 393918012 bytes). Updating counters with new values. 2015-03-02T13:03:37.622-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (39175 records 402902626 bytes) is inconsistent with full validation results (38299 records 393918012 bytes). Updating size storer with new values. 2015-03-02T13:03:37.623-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:03:37.627-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:03:37.641-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T13:03:37.646-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:03:37.665-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:03:37.888-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (38388 records 394832309 bytes) are inconsistent with full validation results (39299 records 404191012 bytes). Updating counters with new values. 2015-03-02T13:03:37.888-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (38388 records 394832309 bytes) is inconsistent with full validation results (39299 records 404191012 bytes). Updating size storer with new values. 2015-03-02T13:03:37.888-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:03:37.901-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:03:37.907-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 241ms 2015-03-02T13:03:37.924-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:03:38.201-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:03:38.217-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:03:38.222-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 297ms 2015-03-02T13:03:39.323-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:03:40.863-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:03:41.018-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:03:41.287-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5281.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:74250 nscannedObjects:74250 nMatched:37125 nModified:37125 keyUpdates:1 writeConflicts:0 numYields:595 locks:{} 3644ms 2015-03-02T13:03:41.287-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5281.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3644ms 2015-03-02T13:03:41.290-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:03:41.591-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:03:41.596-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:03:41.600-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 309ms 2015-03-02T13:03:43.022-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:03:43.027-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T13:03:46.714-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T13:03:47.649-0500 I NETWORK [conn1] end connection 10.4.127.218:50015 (2 connections now open) 2015-03-02T13:03:47.673-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50021 #4 (3 connections now open) 2015-03-02T13:03:47.712-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:03:47.731-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:03:47.961-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 215ms 2015-03-02T13:03:47.969-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:03:48.534-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (58299 records 599378012 bytes) are inconsistent with full validation results (57170 records 587779795 bytes). Updating counters with new values. 2015-03-02T13:03:48.534-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (58050 records 596820035 bytes) is inconsistent with full validation results (57170 records 587779795 bytes). Updating size storer with new values. 2015-03-02T13:03:48.534-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:03:48.537-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (57170 records 587779795 bytes) are inconsistent with full validation results (58299 records 599378012 bytes). Updating counters with new values. 2015-03-02T13:03:48.537-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (57170 records 587779795 bytes) is inconsistent with full validation results (58299 records 599378012 bytes). Updating size storer with new values. 2015-03-02T13:03:48.538-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:03:48.556-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:03:48.557-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:03:48.569-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 857ms 2015-03-02T13:03:48.570-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 601ms 2015-03-02T13:03:48.589-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:03:48.966-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:03:48.973-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:03:48.978-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 389ms 2015-03-02T13:03:49.945-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T13:03:50.001-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T13:03:50.589-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:03:50.771-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:03:51.225-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (64299 records 661016012 bytes) are inconsistent with full validation results (63299 records 650743012 bytes). Updating counters with new values. 2015-03-02T13:03:51.225-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (64050 records 658458035 bytes) is inconsistent with full validation results (63299 records 650743012 bytes). Updating size storer with new values. 2015-03-02T13:03:51.225-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:03:51.246-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:03:51.262-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 490ms 2015-03-02T13:03:52.165-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:03:52.380-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:03:53.965-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:03:54.187-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 163ms 2015-03-02T13:03:55.179-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9123.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:77758 nscannedObjects:77758 nMatched:38879 nModified:38879 keyUpdates:1 writeConflicts:0 numYields:625 locks:{} 3914ms 2015-03-02T13:03:55.179-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9123.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3914ms 2015-03-02T13:03:55.184-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:03:55.704-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:03:56.168-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (69299 records 712403814 bytes) are inconsistent with full validation results (68299 records 702130814 bytes). Updating counters with new values. 2015-03-02T13:03:56.168-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (69171 records 711088870 bytes) is inconsistent with full validation results (68299 records 702130814 bytes). Updating size storer with new values. 2015-03-02T13:03:56.169-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:03:56.191-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:03:56.205-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 1020ms 2015-03-02T13:03:56.908-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:03:57.371-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T13:03:57.594-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50023 #5 (4 connections now open) 2015-03-02T13:03:57.642-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:03:58.621-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 194ms 2015-03-02T13:03:59.207-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (71542 records 735493057 bytes) are inconsistent with full validation results (72299 records 743269718 bytes). Updating counters with new values. 2015-03-02T13:03:59.207-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (71299 records 732996718 bytes) is inconsistent with full validation results (72299 records 743269718 bytes). Updating size storer with new values. 2015-03-02T13:03:59.208-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:03:59.249-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:03:59.280-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 1637ms 2015-03-02T13:03:59.306-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T13:03:59.320-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:04:00.279-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 190ms 2015-03-02T13:04:00.948-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (74056 records 761319379 bytes) are inconsistent with full validation results (74299 records 763815718 bytes). Updating counters with new values. 2015-03-02T13:04:00.948-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (74056 records 761319379 bytes) is inconsistent with full validation results (74299 records 763815718 bytes). Updating size storer with new values. 2015-03-02T13:04:00.948-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:04:00.988-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:04:01.018-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 1698ms 2015-03-02T13:04:01.414-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 267ms 2015-03-02T13:04:02.176-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 319ms 2015-03-02T13:04:03.234-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 310ms 2015-03-02T13:04:04.168-0500 I NETWORK [conn2] end connection 10.4.127.218:50016 (3 connections now open) 2015-03-02T13:04:04.196-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50024 #6 (4 connections now open) 2015-03-02T13:04:04.270-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7319.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:90314 nscannedObjects:90314 nMatched:42487 nModified:42487 keyUpdates:1 writeConflicts:0 numYields:782 locks:{} 8061ms 2015-03-02T13:04:04.270-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7319.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 8061ms 2015-03-02T13:04:04.270-0500 I NETWORK [conn3] end connection 10.4.127.218:50018 (3 connections now open) 2015-03-02T13:04:05.297-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:04:06.673-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T13:04:06.697-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T13:04:06.703-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:04:07.287-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 8482.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:84974 nscannedObjects:84974 nMatched:42487 nModified:42487 keyUpdates:1 writeConflicts:0 numYields:726 locks:{} 6261ms 2015-03-02T13:04:07.287-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8482.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6261ms 2015-03-02T13:04:07.296-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:04:34.040-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:04:34.058-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:04:34.058-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:04:34.058-0500 I CONTROL [initandlisten] 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:04:34.059-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:04:34.070-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:04:34.151-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:04:34.151-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:04:34.151-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:04:34.249-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:04:41.118-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50037 #1 (1 connection now open) 2015-03-02T13:04:42.665-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50038 #2 (2 connections now open) 2015-03-02T13:04:42.691-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:04:42.835-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:04:43.688-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:04:44.182-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50039 #3 (3 connections now open) 2015-03-02T13:04:45.394-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (43299 records 444954879 bytes) are inconsistent with full validation results (41299 records 424408879 bytes). Updating counters with new values. 2015-03-02T13:04:45.394-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42300 records 434692152 bytes) is inconsistent with full validation results (41299 records 424408879 bytes). Updating size storer with new values. 2015-03-02T13:04:45.394-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:04:45.399-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:04:45.402-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1216ms 2015-03-02T13:04:45.403-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4a63b58549748f3022fd3'), x: 6000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database: { acquireCount: { w: 1 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 1157314 } }, Collection: { acquireCount: { w: 1 } } } 657ms 2015-03-02T13:04:45.407-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2715ms 2015-03-02T13:04:45.423-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:04:45.546-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 811ms 2015-03-02T13:04:45.724-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434701639 bytes) are inconsistent with full validation results (43414 records 446137145 bytes). Updating counters with new values. 2015-03-02T13:04:45.724-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42299 records 434694892 bytes) is inconsistent with full validation results (43414 records 446137145 bytes). Updating size storer with new values. 2015-03-02T13:04:45.724-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:04:45.743-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:04:45.750-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 326ms 2015-03-02T13:04:45.765-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:04:46.076-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (43414 records 446158257 bytes) are inconsistent with full validation results (44299 records 455250642 bytes). Updating counters with new values. 2015-03-02T13:04:46.076-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (43414 records 446156398 bytes) is inconsistent with full validation results (44299 records 455250642 bytes). Updating size storer with new values. 2015-03-02T13:04:46.076-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:04:46.089-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:04:46.098-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 332ms 2015-03-02T13:04:47.011-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 225ms 2015-03-02T13:04:47.660-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50044 #4 (4 connections now open) 2015-03-02T13:04:47.707-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:04:48.100-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (45299 records 465630528 bytes) are inconsistent with full validation results (45299 records 465648637 bytes). Updating counters with new values. 2015-03-02T13:04:48.109-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (45299 records 465630528 bytes) is inconsistent with full validation results (45299 records 465648637 bytes). Updating size storer with new values. 2015-03-02T13:04:48.109-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:04:48.121-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:04:48.131-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 423ms 2015-03-02T13:04:48.170-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:04:48.518-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (45497 records 467682691 bytes) are inconsistent with full validation results (45299 records 465648637 bytes). Updating counters with new values. 2015-03-02T13:04:48.518-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (45449 records 467189587 bytes) is inconsistent with full validation results (45299 records 465648637 bytes). Updating size storer with new values. 2015-03-02T13:04:48.523-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:04:48.537-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:04:48.581-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 410ms 2015-03-02T13:04:48.707-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 267ms 2015-03-02T13:04:51.388-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 293ms 2015-03-02T13:04:51.392-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:04:51.510-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5086.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:67589 nscannedObjects:67589 nMatched:24094 nModified:24094 keyUpdates:1 writeConflicts:14 numYields:601 locks:{} 6103ms 2015-03-02T13:04:51.510-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5086.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6103ms 2015-03-02T13:04:51.519-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:04:51.989-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (47101 records 484171555 bytes) are inconsistent with full validation results (47299 records 486205609 bytes). Updating counters with new values. 2015-03-02T13:04:51.989-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (47101 records 484171555 bytes) is inconsistent with full validation results (47299 records 486205609 bytes). Updating size storer with new values. 2015-03-02T13:04:51.989-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:04:51.992-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:04:52.019-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:04:52.021-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:04:52.064-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 672ms 2015-03-02T13:04:52.082-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 562ms 2015-03-02T13:04:52.103-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:04:52.127-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:04:52.142-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9421.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53007 nscannedObjects:53007 nMatched:24094 nModified:24094 keyUpdates:1 writeConflicts:603 numYields:506 locks:{} 6036ms 2015-03-02T13:04:52.142-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9421.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6036ms 2015-03-02T13:04:52.148-0500 I NETWORK [conn2] end connection 10.4.127.218:50038 (3 connections now open) 2015-03-02T13:04:52.431-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:04:52.439-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:04:52.448-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:04:52.456-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:04:52.461-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 334ms 2015-03-02T13:04:52.466-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 363ms 2015-03-02T13:04:52.494-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:04:52.495-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:04:52.842-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:04:52.849-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:04:52.856-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:04:52.864-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:04:52.865-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 370ms 2015-03-02T13:04:52.876-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 381ms 2015-03-02T13:04:52.890-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:04:53.240-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486234768 bytes) are inconsistent with full validation results (47299 records 486206428 bytes). Updating counters with new values. 2015-03-02T13:04:53.240-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486231531 bytes) is inconsistent with full validation results (47299 records 486206428 bytes). Updating size storer with new values. 2015-03-02T13:04:53.240-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:04:53.255-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:04:53.266-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 376ms 2015-03-02T13:04:53.294-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:04:53.688-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486239838 bytes) are inconsistent with full validation results (47299 records 486239500 bytes). Updating counters with new values. 2015-03-02T13:04:53.688-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486235860 bytes) is inconsistent with full validation results (47299 records 486239500 bytes). Updating size storer with new values. 2015-03-02T13:04:53.688-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:04:53.707-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:04:53.722-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 427ms 2015-03-02T13:04:53.760-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:04:54.124-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8156.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:48870 nscannedObjects:48870 nMatched:24094 nModified:24094 keyUpdates:1 writeConflicts:326 numYields:464 locks:{} 5537ms 2015-03-02T13:04:54.125-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8156.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5538ms 2015-03-02T13:04:54.132-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:04:54.236-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486278851 bytes) are inconsistent with full validation results (47299 records 486273443 bytes). Updating counters with new values. 2015-03-02T13:04:54.236-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486277278 bytes) is inconsistent with full validation results (47299 records 486273443 bytes). Updating size storer with new values. 2015-03-02T13:04:54.236-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:04:54.259-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:04:54.278-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 518ms 2015-03-02T13:04:54.542-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486295725 bytes) are inconsistent with full validation results (47299 records 486302706 bytes). Updating counters with new values. 2015-03-02T13:04:54.542-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486291890 bytes) is inconsistent with full validation results (47299 records 486302706 bytes). Updating size storer with new values. 2015-03-02T13:04:54.542-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:04:54.556-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:04:54.569-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 436ms 2015-03-02T13:04:54.596-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:04:54.976-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486335947 bytes) are inconsistent with full validation results (47299 records 486334673 bytes). Updating counters with new values. 2015-03-02T13:04:54.977-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486326938 bytes) is inconsistent with full validation results (47299 records 486334673 bytes). Updating size storer with new values. 2015-03-02T13:04:54.977-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:04:55.004-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:04:55.026-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 429ms 2015-03-02T13:04:55.057-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:04:55.450-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486369539 bytes) are inconsistent with full validation results (47299 records 486368824 bytes). Updating counters with new values. 2015-03-02T13:04:55.450-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486363169 bytes) is inconsistent with full validation results (47299 records 486368824 bytes). Updating size storer with new values. 2015-03-02T13:04:55.450-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:04:55.465-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:04:55.479-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 418ms 2015-03-02T13:04:57.587-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50045 #5 (4 connections now open) 2015-03-02T13:05:02.689-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 566.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:96117 nscannedObjects:96117 nMatched:43337 nModified:43337 keyUpdates:1 writeConflicts:1573 numYields:884 locks:{} 9807ms 2015-03-02T13:05:02.689-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 566.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 9807ms 2015-03-02T13:05:02.690-0500 I NETWORK [conn1] end connection 10.4.127.218:50037 (3 connections now open) 2015-03-02T13:05:04.177-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50046 #6 (4 connections now open) 2015-03-02T13:05:04.207-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:04.760-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (19280 records 198223240 bytes) are inconsistent with full validation results (21803 records 224203912 bytes). Updating counters with new values. 2015-03-02T13:05:04.761-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (19637 records 201895342 bytes) is inconsistent with full validation results (21803 records 224203912 bytes). Updating size storer with new values. 2015-03-02T13:05:04.764-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:04.783-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:04.799-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 588ms 2015-03-02T13:05:04.834-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:05.101-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (20322 records 208970346 bytes) are inconsistent with full validation results (18950 records 194857954 bytes). Updating counters with new values. 2015-03-02T13:05:05.101-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (20788 records 213763622 bytes) is inconsistent with full validation results (18950 records 194857954 bytes). Updating size storer with new values. 2015-03-02T13:05:05.103-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:05.123-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:05.137-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 303ms 2015-03-02T13:05:05.171-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:05.372-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (17776 records 182782190 bytes) are inconsistent with full validation results (17533 records 180282692 bytes). Updating counters with new values. 2015-03-02T13:05:05.372-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (18121 records 186330860 bytes) is inconsistent with full validation results (17533 records 180282692 bytes). Updating size storer with new values. 2015-03-02T13:05:05.372-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:05.385-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:05.401-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 229ms 2015-03-02T13:05:05.612-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7731.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:73826 nscannedObjects:73826 nMatched:33680 nModified:33680 keyUpdates:1 writeConflicts:13106 numYields:787 locks:{} 10129ms 2015-03-02T13:05:05.612-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7731.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 10129ms 2015-03-02T13:05:05.616-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:05:05.779-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1743.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:80527 nscannedObjects:80527 nMatched:36257 nModified:36257 keyUpdates:1 writeConflicts:20805 numYields:875 locks:{} 11495ms 2015-03-02T13:05:05.779-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1743.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 11495ms 2015-03-02T13:05:05.785-0500 I NETWORK [conn3] end connection 10.4.127.218:50039 (3 connections now open) 2015-03-02T13:05:05.802-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (15634 records 160749578 bytes) are inconsistent with full validation results (15453 records 158887812 bytes). Updating counters with new values. 2015-03-02T13:05:05.802-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16248 records 167065182 bytes) is inconsistent with full validation results (15453 records 158887812 bytes). Updating size storer with new values. 2015-03-02T13:05:05.802-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:05:05.815-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:05:05.826-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 209ms 2015-03-02T13:05:06.679-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6199.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9840 nscannedObjects:9840 nMatched:2914 nModified:2914 keyUpdates:1 writeConflicts:8056 numYields:96 locks:{} 1271ms 2015-03-02T13:05:06.679-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6199.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1271ms 2015-03-02T13:05:06.689-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:06.772-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 8129.0 } } ndeleted:1390 keyUpdates:0 writeConflicts:259 numYields:388 locks:{} 9158ms 2015-03-02T13:05:06.772-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8129.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 9158ms 2015-03-02T13:05:06.776-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:05:06.785-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (4689 records 48179548 bytes) are inconsistent with full validation results (4985 records 51224204 bytes). Updating counters with new values. 2015-03-02T13:05:06.785-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (5519 records 56716928 bytes) is inconsistent with full validation results (4985 records 51224204 bytes). Updating size storer with new values. 2015-03-02T13:05:06.785-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:06.795-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:06.796-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 106ms 2015-03-02T13:05:06.801-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:06.804-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (4985 records 51224204 bytes) are inconsistent with full validation results (3962 records 40701626 bytes). Updating counters with new values. 2015-03-02T13:05:06.804-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (4985 records 51224204 bytes) is inconsistent with full validation results (3962 records 40701626 bytes). Updating size storer with new values. 2015-03-02T13:05:06.804-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:05:06.806-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:05:06.826-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:06.827-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:06.835-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:06.845-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:06.847-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:06.851-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:06.866-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:06.867-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:06.871-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:06.884-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:06.885-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:06.890-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:06.901-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (3962 records 40701626 bytes) is inconsistent with full validation results (3963 records 40701672 bytes). Updating size storer with new values. 2015-03-02T13:05:06.901-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:06.902-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:06.906-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:05:06.915-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:05:06.916-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:05:07.649-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 187ms 2015-03-02T13:05:30.774-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:05:30.794-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:05:30.794-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:05:30.794-0500 I CONTROL [initandlisten] 2015-03-02T13:05:30.795-0500 I CONTROL [initandlisten] 2015-03-02T13:05:30.795-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:05:30.795-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:05:30.795-0500 I CONTROL [initandlisten] 2015-03-02T13:05:30.795-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:05:30.795-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:05:30.795-0500 I CONTROL [initandlisten] 2015-03-02T13:05:30.797-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:05:30.797-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:05:30.797-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:05:30.797-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:05:30.797-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:05:30.801-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:05:30.908-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:05:30.908-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:05:30.908-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:05:30.985-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:05:32.709-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50052 #1 (1 connection now open) 2015-03-02T13:05:34.197-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50054 #2 (2 connections now open) 2015-03-02T13:05:35.580-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:05:37.035-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:05:37.600-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50056 #3 (3 connections now open) 2015-03-02T13:05:39.151-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2269.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:55794 nscannedObjects:55794 nMatched:27897 nModified:27897 keyUpdates:1 writeConflicts:0 numYields:484 locks:{} 4942ms 2015-03-02T13:05:39.151-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2269.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4942ms 2015-03-02T13:05:39.156-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:05:39.368-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:05:40.304-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434890048 bytes) are inconsistent with full validation results (41299 records 424617048 bytes). Updating counters with new values. 2015-03-02T13:05:40.304-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (41403 records 425685440 bytes) is inconsistent with full validation results (41299 records 424617048 bytes). Updating size storer with new values. 2015-03-02T13:05:40.304-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:05:40.309-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:05:40.318-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1161ms 2015-03-02T13:05:40.815-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 174ms 2015-03-02T13:05:41.356-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 204ms 2015-03-02T13:05:42.389-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:05:43.437-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6712.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:55794 nscannedObjects:55794 nMatched:27897 nModified:27897 keyUpdates:1 writeConflicts:0 numYields:454 locks:{} 3112ms 2015-03-02T13:05:43.437-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6712.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3112ms 2015-03-02T13:05:43.439-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:05:43.651-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:05:44.038-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (46299 records 475982048 bytes) are inconsistent with full validation results (45299 records 465709048 bytes). Updating counters with new values. 2015-03-02T13:05:44.038-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (45506 records 467835559 bytes) is inconsistent with full validation results (45299 records 465709048 bytes). Updating size storer with new values. 2015-03-02T13:05:44.038-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:05:44.062-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:05:44.077-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 637ms 2015-03-02T13:05:45.960-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T13:05:45.962-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T13:05:47.491-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:05:47.674-0500 I NETWORK [conn1] end connection 10.4.127.218:50052 (2 connections now open) 2015-03-02T13:05:47.706-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50062 #4 (3 connections now open) 2015-03-02T13:05:47.734-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:05:47.821-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:05:48.331-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (54299 records 558166048 bytes) are inconsistent with full validation results (55440 records 569887541 bytes). Updating counters with new values. 2015-03-02T13:05:48.331-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (53506 records 550019559 bytes) is inconsistent with full validation results (55440 records 569887541 bytes). Updating size storer with new values. 2015-03-02T13:05:48.331-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:05:48.343-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:05:48.355-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 620ms 2015-03-02T13:05:49.066-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 193ms 2015-03-02T13:05:49.071-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:05:49.190-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T13:05:49.751-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (57440 records 590538035 bytes) are inconsistent with full validation results (57462 records 590717527 bytes). Updating counters with new values. 2015-03-02T13:05:49.751-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (57440 records 590527232 bytes) is inconsistent with full validation results (57462 records 590717527 bytes). Updating size storer with new values. 2015-03-02T13:05:49.751-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:05:49.764-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:05:49.775-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 704ms 2015-03-02T13:05:50.950-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T13:05:53.287-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 174ms 2015-03-02T13:05:56.049-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1512.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:104421 nscannedObjects:104421 nMatched:45875 nModified:45875 keyUpdates:1 writeConflicts:5848 numYields:879 locks:{} 7683ms 2015-03-02T13:05:56.050-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1512.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 7683ms 2015-03-02T13:05:56.056-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:05:57.065-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 212ms 2015-03-02T13:05:57.466-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (60462 records 621665747 bytes) are inconsistent with full validation results (60299 records 620037762 bytes). Updating counters with new values. 2015-03-02T13:05:57.466-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (60429 records 621326738 bytes) is inconsistent with full validation results (60299 records 620037762 bytes). Updating size storer with new values. 2015-03-02T13:05:57.466-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:05:57.488-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:05:57.505-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 1449ms 2015-03-02T13:05:57.528-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:05:57.616-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50064 #5 (4 connections now open) 2015-03-02T13:05:57.931-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (60299 records 620037762 bytes) are inconsistent with full validation results (61299 records 630310762 bytes). Updating counters with new values. 2015-03-02T13:05:57.931-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (60299 records 620037762 bytes) is inconsistent with full validation results (61299 records 630310762 bytes). Updating size storer with new values. 2015-03-02T13:05:57.932-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:05:57.940-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:05:57.946-0500 I COMMAND [conn5] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 324ms 2015-03-02T13:05:57.948-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 419ms 2015-03-02T13:05:57.984-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:05:57.996-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:05:58.591-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:05:58.602-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:05:58.622-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:05:58.628-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:05:58.636-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 639ms 2015-03-02T13:05:58.644-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 656ms 2015-03-02T13:05:58.679-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:05:58.681-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:05:58.735-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2939.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:91750 nscannedObjects:91750 nMatched:45875 nModified:45875 keyUpdates:1 writeConflicts:7542 numYields:811 locks:{} 8952ms 2015-03-02T13:05:58.735-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2939.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 8953ms 2015-03-02T13:05:58.736-0500 I NETWORK [conn3] end connection 10.4.127.218:50056 (3 connections now open) 2015-03-02T13:05:59.152-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:05:59.154-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:05:59.181-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:05:59.184-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:05:59.192-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 511ms 2015-03-02T13:05:59.197-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 518ms 2015-03-02T13:05:59.227-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:05:59.664-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (61299 records 630327441 bytes) are inconsistent with full validation results (61299 records 630312920 bytes). Updating counters with new values. 2015-03-02T13:05:59.664-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (61299 records 630327441 bytes) is inconsistent with full validation results (61299 records 630312920 bytes). Updating size storer with new values. 2015-03-02T13:05:59.664-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:05:59.677-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:05:59.686-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 459ms 2015-03-02T13:05:59.725-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:06:00.079-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (61299 records 630312920 bytes) are inconsistent with full validation results (61299 records 630327441 bytes). Updating counters with new values. 2015-03-02T13:06:00.079-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (61299 records 630312920 bytes) is inconsistent with full validation results (61299 records 630327441 bytes). Updating size storer with new values. 2015-03-02T13:06:00.079-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:06:00.092-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:06:00.102-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 377ms 2015-03-02T13:06:00.126-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:06:00.330-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 178ms 2015-03-02T13:06:00.780-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (62299 records 640600441 bytes) are inconsistent with full validation results (61299 records 630327441 bytes). Updating counters with new values. 2015-03-02T13:06:00.780-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (62299 records 640600441 bytes) is inconsistent with full validation results (61299 records 630327441 bytes). Updating size storer with new values. 2015-03-02T13:06:00.780-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:06:00.811-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:06:00.835-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 708ms 2015-03-02T13:06:03.337-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 190ms 2015-03-02T13:06:04.214-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50065 #6 (4 connections now open) 2015-03-02T13:06:04.216-0500 I NETWORK [conn2] end connection 10.4.127.218:50054 (3 connections now open) 2015-03-02T13:06:04.247-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:06:05.060-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (62299 records 640613441 bytes) are inconsistent with full validation results (63299 records 650886441 bytes). Updating counters with new values. 2015-03-02T13:06:05.060-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (62299 records 640613441 bytes) is inconsistent with full validation results (63299 records 650886441 bytes). Updating size storer with new values. 2015-03-02T13:06:05.060-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:06:05.082-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:06:05.102-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 854ms 2015-03-02T13:06:07.673-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5717.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:110934 nscannedObjects:110934 nMatched:47158 nModified:47158 keyUpdates:1 writeConflicts:4448 numYields:932 locks:{} 8472ms 2015-03-02T13:06:07.673-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5717.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 8473ms 2015-03-02T13:06:07.678-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:06:08.670-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (63942 records 657491980 bytes) are inconsistent with full validation results (63299 records 650886441 bytes). Updating counters with new values. 2015-03-02T13:06:08.670-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (63588 records 653855338 bytes) is inconsistent with full validation results (63299 records 650886441 bytes). Updating size storer with new values. 2015-03-02T13:06:08.670-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:06:08.696-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:06:08.731-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 1053ms 2015-03-02T13:06:08.738-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 233ms 2015-03-02T13:06:29.979-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:06:29.995-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:06:29.995-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:06:29.995-0500 I CONTROL [initandlisten] 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:06:30.000-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:06:30.007-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:06:30.089-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:06:30.089-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:06:30.089-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:06:30.175-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:06:32.681-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50073 #1 (1 connection now open) 2015-03-02T13:06:34.168-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50074 #2 (2 connections now open) 2015-03-02T13:06:37.573-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50076 #3 (3 connections now open) 2015-03-02T13:06:37.608-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:06:38.171-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 177ms 2015-03-02T13:06:38.311-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:06:39.769-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 182ms 2015-03-02T13:06:39.771-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 176ms 2015-03-02T13:06:40.965-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 183ms 2015-03-02T13:06:40.970-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:06:40.973-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 187ms 2015-03-02T13:06:42.098-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (53299 records 547684879 bytes) are inconsistent with full validation results (47299 records 486046879 bytes). Updating counters with new values. 2015-03-02T13:06:42.098-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (52300 records 537422152 bytes) is inconsistent with full validation results (47299 records 486046879 bytes). Updating size storer with new values. 2015-03-02T13:06:42.099-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:06:42.116-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:06:42.125-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 4516ms 2015-03-02T13:06:42.126-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486046879 bytes) are inconsistent with full validation results (53290 records 547592422 bytes). Updating counters with new values. 2015-03-02T13:06:42.126-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486046879 bytes) is inconsistent with full validation results (53290 records 547592422 bytes). Updating size storer with new values. 2015-03-02T13:06:42.127-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:06:42.146-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:06:42.153-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1183ms 2015-03-02T13:06:42.159-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:06:42.170-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:06:42.548-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (53290 records 547592422 bytes) are inconsistent with full validation results (53299 records 547684879 bytes). Updating counters with new values. 2015-03-02T13:06:42.548-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (53290 records 547592422 bytes) is inconsistent with full validation results (53299 records 547684879 bytes). Updating size storer with new values. 2015-03-02T13:06:42.548-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:06:42.558-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:06:42.569-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:06:42.578-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:06:42.581-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 422ms 2015-03-02T13:06:42.585-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 415ms 2015-03-02T13:06:42.607-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:06:42.815-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 185ms 2015-03-02T13:06:43.022-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (54299 records 557985517 bytes) are inconsistent with full validation results (53299 records 547684944 bytes). Updating counters with new values. 2015-03-02T13:06:43.022-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (54299 records 557983892 bytes) is inconsistent with full validation results (53299 records 547684944 bytes). Updating size storer with new values. 2015-03-02T13:06:43.022-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:06:43.045-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:06:43.068-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 461ms 2015-03-02T13:06:43.101-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:06:43.402-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (53299 records 547711984 bytes) are inconsistent with full validation results (54299 records 557989651 bytes). Updating counters with new values. 2015-03-02T13:06:43.402-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (53299 records 547709319 bytes) is inconsistent with full validation results (54299 records 557989651 bytes). Updating size storer with new values. 2015-03-02T13:06:43.403-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:06:43.418-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:06:43.426-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 325ms 2015-03-02T13:06:45.027-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 239ms 2015-03-02T13:06:47.227-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 265ms 2015-03-02T13:06:47.680-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50077 #4 (4 connections now open) 2015-03-02T13:06:49.397-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 256ms 2015-03-02T13:06:49.402-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:06:50.663-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (57299 records 589227992 bytes) are inconsistent with full validation results (57299 records 589250898 bytes). Updating counters with new values. 2015-03-02T13:06:50.663-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (57299 records 589227992 bytes) is inconsistent with full validation results (57299 records 589250898 bytes). Updating size storer with new values. 2015-03-02T13:06:50.664-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:06:50.691-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:06:50.709-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1307ms 2015-03-02T13:06:50.771-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:06:51.544-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 317ms 2015-03-02T13:06:52.064-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (58299 records 599523898 bytes) are inconsistent with full validation results (57299 records 589250898 bytes). Updating counters with new values. 2015-03-02T13:06:52.064-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (58299 records 599523898 bytes) is inconsistent with full validation results (57299 records 589250898 bytes). Updating size storer with new values. 2015-03-02T13:06:52.064-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:06:52.095-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:06:52.117-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 1345ms 2015-03-02T13:06:53.183-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7649.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:101985 nscannedObjects:101985 nMatched:48347 nModified:48347 keyUpdates:1 writeConflicts:0 numYields:923 locks:{} 10595ms 2015-03-02T13:06:53.189-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7649.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 10602ms 2015-03-02T13:06:53.195-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:06:54.078-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 269ms 2015-03-02T13:06:54.247-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 218ms 2015-03-02T13:06:54.256-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 994.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:106209 nscannedObjects:106209 nMatched:48347 nModified:48347 keyUpdates:1 writeConflicts:0 numYields:945 locks:{} 10823ms 2015-03-02T13:06:54.256-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 994.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 10823ms 2015-03-02T13:06:54.267-0500 I NETWORK [conn1] end connection 10.4.127.218:50073 (3 connections now open) 2015-03-02T13:06:54.706-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (59299 records 609796898 bytes) are inconsistent with full validation results (58299 records 599523898 bytes). Updating counters with new values. 2015-03-02T13:06:54.706-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (58878 records 605471965 bytes) is inconsistent with full validation results (58299 records 599523898 bytes). Updating size storer with new values. 2015-03-02T13:06:54.706-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:06:54.716-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:06:54.723-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 1527ms 2015-03-02T13:06:54.750-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:06:55.050-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (58299 records 599523898 bytes) are inconsistent with full validation results (60299 records 620069898 bytes). Updating counters with new values. 2015-03-02T13:06:55.050-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (58299 records 599523898 bytes) is inconsistent with full validation results (60299 records 620069898 bytes). Updating size storer with new values. 2015-03-02T13:06:55.050-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:06:55.057-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:06:55.062-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 311ms 2015-03-02T13:06:55.077-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:06:55.430-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:06:55.455-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (61299 records 630342898 bytes) are inconsistent with full validation results (60299 records 620069898 bytes). Updating counters with new values. 2015-03-02T13:06:55.455-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (60606 records 623223709 bytes) is inconsistent with full validation results (60299 records 620069898 bytes). Updating size storer with new values. 2015-03-02T13:06:55.463-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:06:55.473-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:06:55.483-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 406ms 2015-03-02T13:06:55.516-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:06:55.837-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (60299 records 620069898 bytes) are inconsistent with full validation results (61299 records 630342898 bytes). Updating counters with new values. 2015-03-02T13:06:55.837-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (60299 records 620069898 bytes) is inconsistent with full validation results (61299 records 630342898 bytes). Updating size storer with new values. 2015-03-02T13:06:55.837-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:06:55.845-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:06:55.850-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 334ms 2015-03-02T13:06:56.360-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:06:56.700-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:06:56.703-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:06:57.582-0500 I NETWORK [conn3] end connection 10.4.127.218:50076 (2 connections now open) 2015-03-02T13:06:57.582-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50079 #5 (4 connections now open) 2015-03-02T13:06:58.028-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:06:58.640-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:06:59.537-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:07:01.008-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 3702.0 } } ndeleted:49645 keyUpdates:0 writeConflicts:0 numYields:400 locks:{} 3411ms 2015-03-02T13:07:01.008-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3702.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3411ms 2015-03-02T13:07:01.013-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:07:01.348-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19992 records 205371970 bytes) is inconsistent with full validation results (19654 records 201905542 bytes). Updating size storer with new values. 2015-03-02T13:07:01.349-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:07:01.374-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:07:01.415-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 402ms 2015-03-02T13:07:01.433-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:07:01.652-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 237ms 2015-03-02T13:07:01.700-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (21432 records 220170936 bytes) are inconsistent with full validation results (19674 records 202111002 bytes). Updating counters with new values. 2015-03-02T13:07:01.706-0500 W STORAGE [conn5] table:collection-2-232115450068966992015-03-02T13:07:29.870-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:07:29.892-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:07:29.892-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:07:29.892-0500 I CONTROL [initandlisten] 2015-03-02T13:07:29.893-0500 I CONTROL [initandlisten] 2015-03-02T13:07:29.893-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:07:29.893-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:07:29.893-0500 I CONTROL [initandlisten] 2015-03-02T13:07:29.893-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:07:29.893-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:07:29.894-0500 I CONTROL [initandlisten] 2015-03-02T13:07:29.894-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:07:29.894-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:07:29.894-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:07:29.894-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:07:29.894-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:07:29.902-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:07:29.975-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:07:29.975-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:07:29.975-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:07:30.052-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:07:32.730-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50086 #1 (1 connection now open) 2015-03-02T13:07:32.748-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:34.222-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50087 #2 (2 connections now open) 2015-03-02T13:07:34.523-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:34.530-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:34.533-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 307ms 2015-03-02T13:07:34.534-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1784ms 2015-03-02T13:07:34.544-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:34.550-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:34.671-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:34.678-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:34.680-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:34.686-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:34.687-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 142ms 2015-03-02T13:07:34.690-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 139ms 2015-03-02T13:07:36.135-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6483.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24352 nscannedObjects:24352 nMatched:12154 nModified:12154 keyUpdates:1 writeConflicts:59 numYields:196 locks:{} 1443ms 2015-03-02T13:07:36.135-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6483.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1443ms 2015-03-02T13:07:36.139-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.239-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (12855 records 132071832 bytes) are inconsistent with full validation results (14651 records 150545464 bytes). Updating counters with new values. 2015-03-02T13:07:36.239-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13456 records 138253718 bytes) is inconsistent with full validation results (14651 records 150545464 bytes). Updating size storer with new values. 2015-03-02T13:07:36.239-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.251-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.254-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 115ms 2015-03-02T13:07:36.265-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.315-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (13219 records 135815912 bytes) are inconsistent with full validation results (12384 records 127227102 bytes). Updating counters with new values. 2015-03-02T13:07:36.315-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13252 records 136155350 bytes) is inconsistent with full validation results (12384 records 127227102 bytes). Updating size storer with new values. 2015-03-02T13:07:36.315-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.323-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.327-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 3125.0 } } ndeleted:12154 keyUpdates:0 writeConflicts:44 numYields:191 locks:{} 1630ms 2015-03-02T13:07:36.327-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3125.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1630ms 2015-03-02T13:07:36.329-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.332-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.369-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (12075 records 124058968 bytes) are inconsistent with full validation results (11114 records 114174122 bytes). Updating counters with new values. 2015-03-02T13:07:36.369-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (12384 records 127227102 bytes) is inconsistent with full validation results (11114 records 114174122 bytes). Updating size storer with new values. 2015-03-02T13:07:36.369-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.372-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.374-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.376-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.379-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.384-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.418-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.424-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.427-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.429-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.432-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.440-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.474-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.478-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.480-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.482-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.488-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.493-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.528-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.530-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.532-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.535-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.541-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.545-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.580-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11114 records 114174122 bytes) is inconsistent with full validation results (11115 records 114174168 bytes). Updating size storer with new values. 2015-03-02T13:07:36.580-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.582-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.584-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.587-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.591-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.596-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.626-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.631-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.633-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.636-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.640-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.642-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.684-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.687-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.688-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.690-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.699-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.740-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (11115 records 114180135 bytes) are inconsistent with full validation results (11115 records 114175312 bytes). Updating counters with new values. 2015-03-02T13:07:36.740-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (11115 records 114174168 bytes) is inconsistent with full validation results (11115 records 114175312 bytes). Updating size storer with new values. 2015-03-02T13:07:36.740-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.744-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.814-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2545.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:1511 nscannedObjects:1511 nMatched:1161 nModified:1161 keyUpdates:1 writeConflicts:0 numYields:12 locks:{} 122ms 2015-03-02T13:07:36.814-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2545.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 122ms 2015-03-02T13:07:36.816-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.833-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:36.858-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (9954 records 102252619 bytes) are inconsistent with full validation results (10196 records 104736414 bytes). Updating counters with new values. 2015-03-02T13:07:36.858-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10473 records 107578629 bytes) is inconsistent with full validation results (10196 records 104736414 bytes). Updating size storer with new values. 2015-03-02T13:07:36.858-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.862-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.872-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (10196 records 104736414 bytes) are inconsistent with full validation results (9954 records 102257442 bytes). Updating counters with new values. 2015-03-02T13:07:36.872-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (10196 records 104736414 bytes) is inconsistent with full validation results (9954 records 102257442 bytes). Updating size storer with new values. 2015-03-02T13:07:36.872-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:36.875-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.878-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:36.897-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.898-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:36.903-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:36.926-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:36.928-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:37.616-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50089 #3 (3 connections now open) 2015-03-02T13:07:37.626-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:07:37.669-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (10266 records 105462618 bytes) is inconsistent with full validation results (10954 records 112530442 bytes). Updating size storer with new values. 2015-03-02T13:07:37.669-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:07:37.674-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:07:37.682-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:07:37.734-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:07:37.735-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:07:37.741-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:07:37.799-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:07:37.805-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:07:37.822-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:07:37.891-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:07:37.893-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:07:38.505-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:07:39.303-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:07:39.541-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T13:07:41.230-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T13:07:42.441-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T13:07:42.621-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:07:43.815-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:07:44.307-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:07:44.826-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T13:07:45.269-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T13:07:45.278-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:07:46.689-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:47.153-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:07:47.231-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34954 records 359082442 bytes) are inconsistent with full validation results (33954 records 348809442 bytes). Updating counters with new values. 2015-03-02T13:07:47.231-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34266 records 352014618 bytes) is inconsistent with full validation results (33954 records 348809442 bytes). Updating size storer with new values. 2015-03-02T13:07:47.231-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:47.236-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:47.239-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 550ms 2015-03-02T13:07:47.243-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:07:47.343-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33954 records 348809442 bytes) are inconsistent with full validation results (34954 records 359082442 bytes). Updating counters with new values. 2015-03-02T13:07:47.344-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (33954 records 348809442 bytes) is inconsistent with full validation results (34954 records 359082442 bytes). Updating size storer with new values. 2015-03-02T13:07:47.344-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:07:47.348-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:07:47.352-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T13:07:47.606-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:07:47.612-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:07:47.727-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50092 #4 (4 connections now open) 2015-03-02T13:07:47.806-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (35954 records 369413942 bytes) are inconsistent with full validation results (35954 records 369403724 bytes). Updating counters with new values. 2015-03-02T13:07:47.806-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (35954 records 369411498 bytes) is inconsistent with full validation results (35954 records 369403724 bytes). Updating size storer with new values. 2015-03-02T13:07:47.807-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:07:47.811-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:07:47.820-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 208ms 2015-03-02T13:07:47.844-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:07:48.123-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (35954 records 369440670 bytes) are inconsistent with full validation results (35954 records 369417452 bytes). Updating counters with new values. 2015-03-02T13:07:48.123-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (35954 records 369440280 bytes) is inconsistent with full validation results (35954 records 369417452 bytes). Updating size storer with new values. 2015-03-02T13:07:48.123-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:07:48.150-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:07:48.160-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 315ms 2015-03-02T13:07:50.112-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 284ms 2015-03-02T13:07:53.263-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 244ms 2015-03-02T13:07:57.202-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 222ms 2015-03-02T13:07:57.329-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1640.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:81592 nscannedObjects:81592 nMatched:34524 nModified:34524 keyUpdates:1 writeConflicts:1505 numYields:783 locks:{} 9157ms 2015-03-02T13:07:57.329-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1640.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 9157ms 2015-03-02T13:07:57.337-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:07:57.436-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 270.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:86922 nscannedObjects:86922 nMatched:34524 nModified:34524 keyUpdates:1 writeConflicts:5514 numYields:875 locks:{} 10082ms 2015-03-02T13:07:57.447-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 270.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 10093ms 2015-03-02T13:07:57.456-0500 I NETWORK [conn1] end connection 10.4.127.218:50086 (3 connections now open) 2015-03-02T13:07:57.459-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7624.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:85119 nscannedObjects:85119 nMatched:34524 nModified:34524 keyUpdates:1 writeConflicts:2343 numYields:830 locks:{} 9636ms 2015-03-02T13:07:57.459-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7624.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 9637ms 2015-03-02T13:07:57.472-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:07:57.638-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50093 #5 (4 connections now open) 2015-03-02T13:07:57.730-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (38954 records 400589818 bytes) are inconsistent with full validation results (38954 records 400623254 bytes). Updating counters with new values. 2015-03-02T13:07:57.730-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (38694 records 397918838 bytes) is inconsistent with full validation results (38954 records 400623254 bytes). Updating size storer with new values. 2015-03-02T13:07:57.731-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:07:57.738-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:07:57.743-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 405ms 2015-03-02T13:07:57.744-0500 I NETWORK [conn3] end connection 10.4.127.218:50089 (3 connections now open) 2015-03-02T13:07:57.749-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:07:57.753-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:07:57.756-0500 I COMMAND [conn5] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 107ms 2015-03-02T13:07:57.756-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 284ms 2015-03-02T13:07:59.313-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 7862.0 } } ndeleted:35662 keyUpdates:0 writeConflicts:0 numYields:281 locks:{} 1550ms 2015-03-02T13:07:59.313-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7862.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1551ms 2015-03-02T13:07:59.320-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:07:59.470-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (4214 records 43302408 bytes) is inconsistent with full validation results (3292 records 33818716 bytes). Updating size storer with new values. 2015-03-02T13:07:59.471-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:07:59.482-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:07:59.492-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 172ms 2015-03-02T13:07:59.605-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1362.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:1724 nscannedObjects:1724 nMatched:862 nModified:862 keyUpdates:1 writeConflicts:0 numYields:14 locks:{} 104ms 2015-03-02T13:07:59.605-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1362.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 104ms 2015-03-02T13:07:59.607-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:07:59.636-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (3292 records 33819730 bytes) is inconsistent with full validation results (3292 records 33829922 bytes). Updating size storer with new values. 2015-03-02T13:07:59.637-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:07:59.637-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:07:59.645-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:07:59.651-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:07:59.652-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:07:59.663-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:07:59.682-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:07:59.683-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:07:59.811-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.823-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (3508 records 36048890 bytes) is inconsistent with full validation results (4292 records 44102922 bytes). Updating size storer with new values. 2015-03-02T13:07:59.823-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.825-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.911-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.917-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (3076 records 31608146 bytes) is inconsistent with full validation results (2430 records 24963390 bytes). Updating size storer with new values. 2015-03-02T13:07:59.917-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.918-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.922-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.926-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.927-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.930-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.936-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.937-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.940-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.944-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.945-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.950-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.955-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.956-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.960-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.965-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (2430 records 24963390 bytes) is inconsistent with full validation results (2431 records 24963436 bytes). Updating size storer with new values. 2015-03-02T13:07:59.965-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.966-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.969-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.974-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.974-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:07:59.977-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:07:59.983-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:07:59.984-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:02.106-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T13:08:04.193-0500 I NETWORK [conn2] end connection 10.4.127.218:50087 (2 connections now open) 2015-03-02T13:08:04.236-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50095 #6 (3 connections now open) 2015-03-02T13:08:04.398-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 1785.0 } } ndeleted:2646 keyUpdates:0 writeConflicts:0 numYields:21 locks:{} 152ms 2015-03-02T13:08:04.398-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "f2015-03-02T13:08:31.468-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:08:31.485-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:08:31.485-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:08:31.485-0500 I CONTROL [initandlisten] 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:08:31.488-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:08:31.495-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:08:31.576-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:08:31.576-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:08:31.576-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:08:31.651-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:08:32.746-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50101 #1 (1 connection now open) 2015-03-02T13:08:32.760-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:34.264-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50103 #2 (2 connections now open) 2015-03-02T13:08:34.520-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:34.526-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:34.530-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 261ms 2015-03-02T13:08:34.530-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1769ms 2015-03-02T13:08:34.545-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:34.696-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (34172 records 351193208 bytes) are inconsistent with full validation results (37085 records 381118457 bytes). Updating counters with new values. 2015-03-02T13:08:34.696-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (34298 records 352487606 bytes) is inconsistent with full validation results (37085 records 381118457 bytes). Updating size storer with new values. 2015-03-02T13:08:34.696-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:34.704-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:34.709-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 163ms 2015-03-02T13:08:34.724-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:34.856-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (34053 records 349970721 bytes) are inconsistent with full validation results (33658 records 345912886 bytes). Updating counters with new values. 2015-03-02T13:08:34.856-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (34211 records 351593855 bytes) is inconsistent with full validation results (33658 records 345912886 bytes). Updating size storer with new values. 2015-03-02T13:08:34.856-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:34.866-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:34.872-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 148ms 2015-03-02T13:08:34.883-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:35.002-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (31016 records 318771620 bytes) are inconsistent with full validation results (30589 records 314385049 bytes). Updating counters with new values. 2015-03-02T13:08:35.002-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (31816 records 326990020 bytes) is inconsistent with full validation results (30589 records 314385049 bytes). Updating size storer with new values. 2015-03-02T13:08:35.005-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:35.014-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:35.019-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T13:08:35.030-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:35.163-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (27781 records 285538465 bytes) are inconsistent with full validation results (27844 records 286185664 bytes). Updating counters with new values. 2015-03-02T13:08:35.163-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28389 records 291784449 bytes) is inconsistent with full validation results (27844 records 286185664 bytes). Updating size storer with new values. 2015-03-02T13:08:35.164-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:35.175-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:35.181-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 150ms 2015-03-02T13:08:35.494-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 5673.0 } } ndeleted:29 keyUpdates:0 writeConflicts:31 numYields:28 locks:{} 305ms 2015-03-02T13:08:35.494-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5673.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 305ms 2015-03-02T13:08:35.497-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:35.500-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4276.0 } } ndeleted:0 keyUpdates:0 writeConflicts:21 numYields:137 locks:{} 964ms 2015-03-02T13:08:35.500-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4276.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 964ms 2015-03-02T13:08:35.503-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:35.569-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (15846 records 162785958 bytes) are inconsistent with full validation results (13692 records 140657916 bytes). Updating counters with new values. 2015-03-02T13:08:35.569-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16452 records 169009034 bytes) is inconsistent with full validation results (13692 records 140657916 bytes). Updating size storer with new values. 2015-03-02T13:08:35.569-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:35.571-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:35.573-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:35.574-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:35.581-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:35.584-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:35.628-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (13692 records 140657916 bytes) is inconsistent with full validation results (13693 records 140657962 bytes). Updating size storer with new values. 2015-03-02T13:08:35.629-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:35.634-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:35.637-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:35.640-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:35.783-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2387.0 } } ndeleted:4055 keyUpdates:0 writeConflicts:0 numYields:31 locks:{} 141ms 2015-03-02T13:08:35.783-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2387.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T13:08:35.785-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:35.807-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10301 records 105811946 bytes) is inconsistent with full validation results (9638 records 99011174 bytes). Updating size storer with new values. 2015-03-02T13:08:35.807-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:35.809-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:35.813-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:35.832-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:35.834-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:35.839-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:35.876-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:35.877-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:37.667-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50104 #3 (3 connections now open) 2015-03-02T13:08:37.682-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:08:37.777-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11975 records 123019175 bytes) is inconsistent with full validation results (12638 records 129830174 bytes). Updating size storer with new values. 2015-03-02T13:08:37.778-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:08:37.782-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:08:37.783-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T13:08:37.786-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:08:37.845-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:08:37.846-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:08:37.856-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:08:37.913-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:08:37.915-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:08:39.022-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:08:39.214-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:08:40.216-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:08:41.190-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:08:43.240-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:08:44.543-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:45.057-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (30789 records 316295397 bytes) are inconsistent with full validation results (30638 records 314744174 bytes). Updating counters with new values. 2015-03-02T13:08:45.057-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29975 records 307933175 bytes) is inconsistent with full validation results (30638 records 314744174 bytes). Updating size storer with new values. 2015-03-02T13:08:45.057-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:45.064-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:45.070-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 526ms 2015-03-02T13:08:45.436-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7617.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4766 nscannedObjects:4766 nMatched:2383 nModified:2383 keyUpdates:1 writeConflicts:0 numYields:40 locks:{} 361ms 2015-03-02T13:08:45.436-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7617.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 361ms 2015-03-02T13:08:45.441-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:45.454-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T13:08:45.666-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (32487 records 333769930 bytes) are inconsistent with full validation results (32555 records 334468494 bytes). Updating counters with new values. 2015-03-02T13:08:45.666-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32441 records 333297372 bytes) is inconsistent with full validation results (32555 records 334468494 bytes). Updating size storer with new values. 2015-03-02T13:08:45.667-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:45.677-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:45.688-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 247ms 2015-03-02T13:08:45.708-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:45.825-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (32555 records 334468494 bytes) are inconsistent with full validation results (32638 records 335321153 bytes). Updating counters with new values. 2015-03-02T13:08:45.825-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32555 records 334468494 bytes) is inconsistent with full validation results (32638 records 335321153 bytes). Updating size storer with new values. 2015-03-02T13:08:45.826-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:45.830-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:45.833-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 124ms 2015-03-02T13:08:45.837-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:08:45.923-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:08:45.928-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:08:46.758-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 158ms 2015-03-02T13:08:47.109-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:08:47.446-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:08:47.676-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (36592 records 375940595 bytes) is inconsistent with full validation results (36638 records 376413153 bytes). Updating size storer with new values. 2015-03-02T13:08:47.676-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:08:47.699-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:08:47.708-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 261ms 2015-03-02T13:08:47.723-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:08:47.729-0500 I NETWORK [conn1] end connection 10.4.127.218:50101 (2 connections now open) 2015-03-02T13:08:47.761-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50105 #4 (3 connections now open) 2015-03-02T13:08:47.818-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:08:47.826-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:08:47.829-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 105ms 2015-03-02T13:08:47.844-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:08:47.851-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:08:48.011-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:08:48.019-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:08:48.022-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:08:48.027-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 183ms 2015-03-02T13:08:48.033-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:08:48.041-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 190ms 2015-03-02T13:08:48.053-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:08:48.057-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:08:48.265-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:08:48.267-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:08:48.275-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:08:48.276-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:08:48.280-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 227ms 2015-03-02T13:08:48.281-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 224ms 2015-03-02T13:08:48.697-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T13:08:49.448-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:08:50.389-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T13:08:51.674-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:08:53.039-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:53.182-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T13:08:53.244-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T13:08:53.950-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (49638 records 509962153 bytes) are inconsistent with full validation results (47665 records 489693524 bytes). Updating counters with new values. 2015-03-02T13:08:53.954-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (49592 records 509489595 bytes) is inconsistent with full validation results (47665 records 489693524 bytes). Updating size storer with new values. 2015-03-02T13:08:53.955-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:53.975-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:53.985-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 945ms 2015-03-02T13:08:54.332-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T13:08:55.786-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T13:08:56.532-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:08:57.156-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 155ms 2015-03-02T13:08:57.644-0500 I NETWORK [conn3] end connection 10.4.127.218:50104 (2 connections now open) 2015-03-02T13:08:57.685-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50106 #5 (3 connections now open) 2015-03-02T13:08:58.081-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2593.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:58250 nscannedObjects:58250 nMatched:29125 nModified:29125 keyUpdates:1 writeConflicts:0 numYields:488 locks:{} 4091ms 2015-03-02T13:08:58.081-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2593.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4091ms 2015-03-02T13:08:58.084-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:58.780-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37737 records 387856762 bytes) are inconsistent with full validation results (48873 records 502376009 bytes). Updating counters with new values. 2015-03-02T13:08:58.780-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37836 records 388875076 bytes) is inconsistent with full validation results (48873 records 502376009 bytes). Updating size storer with new values. 2015-03-02T13:08:58.780-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:58.790-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:58.813-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 729ms 2015-03-02T13:08:58.838-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:08:59.108-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (44244 records 454762115 bytes) are inconsistent with full validation results (38885 records 399639441 bytes). Updating counters with new values. 2015-03-02T13:08:59.108-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (44972 records 462250323 bytes) is inconsistent with full validation results (38885 records 399639441 bytes). Updating size storer with new values. 2015-03-02T13:08:59.108-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:08:59.122-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:08:59.129-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 291ms 2015-03-02T13:08:59.450-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 195ms 2015-03-02T13:09:00.230-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6068.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12665 nscannedObjects:12665 nMatched:6369 nModified:6369 keyUpdates:1 writeConflicts:12 numYields:105 locks:{} 1096ms 2015-03-02T13:09:00.231-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6068.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1096ms 2015-03-02T13:09:00.235-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:09:00.360-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 9227.0 } } ndeleted:3698 keyUpdates:0 writeConflicts:12 numYields:252 locks:{} 2653ms 2015-03-02T13:09:00.360-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9227.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2653ms 2015-03-02T13:09:00.365-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:00.679-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (27560 records 283173332 bytes) are inconsistent with full validation results (23756 records 244045388 bytes). Updating counters with new values. 2015-03-02T13:09:00.679-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (27982 records 287514024 bytes) is inconsistent with full validation results (23756 records 244045388 bytes). Updating size storer with new values. 2015-03-02T13:09:00.679-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:00.681-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23756 records 244045388 bytes) are inconsistent with full validation results (25171 records 258600078 bytes). Updating counters with new values. 2015-03-02T13:09:00.681-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23756 records 244045388 bytes) is inconsistent with full validation results (25171 records 258600078 bytes). Updating size storer with new values. 2015-03-02T13:09:00.681-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:09:00.699-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:09:00.705-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:00.716-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 480ms 2015-03-02T13:09:00.717-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 351ms 2015-03-02T13:09:00.722-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:09:00.723-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:00.799-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:09:00.874-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (26171 records 268873078 bytes) are inconsistent with full validation results (24072 records 247291656 bytes). Updating counters with new values. 2015-03-02T13:09:00.874-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25749 records 264537872 bytes) is inconsistent with full validation results (24072 records 247291656 bytes). Updating size storer with new values. 2015-03-02T13:09:00.874-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:09:00.878-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:00.887-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:09:00.890-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:00.892-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 169ms 2015-03-02T13:09:00.894-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 170ms 2015-03-02T13:09:00.901-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:01.029-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (24072 records 247291656 bytes) are inconsistent with full validation results (24756 records 254318388 bytes). Updating counters with new values. 2015-03-02T13:09:01.029-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24072 records 247291656 bytes) is inconsistent with full validation results (24756 records 254318388 bytes). Updating size storer with new values. 2015-03-02T13:09:01.029-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:01.036-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:01.041-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 140ms 2015-03-02T13:09:01.048-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:01.183-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24756 records 254318388 bytes) is inconsistent with full validation results (24757 records 254318434 bytes). Updating size storer with new values. 2015-03-02T13:09:01.183-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:01.192-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:01.194-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 146ms 2015-03-02T13:09:01.204-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:01.358-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:01.364-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:01.366-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 161ms 2015-03-02T13:09:01.374-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:01.534-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:01.540-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:01.551-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 177ms 2015-03-02T13:09:01.561-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:01.694-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:01.708-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:01.713-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T13:09:01.814-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:09:01.941-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25334 records 260245955 bytes) is inconsistent with full validation results (25757 records 264591434 bytes). Updating size storer with new values. 2015-03-02T13:09:01.941-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:09:01.945-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:09:01.947-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 132ms 2015-03-02T13:09:01.950-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:09:02.030-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:09:02.033-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:09:02.062-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:09:02.142-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25757 records 264591434 bytes) is inconsistent with full validation results (25757 records 264593618 bytes). Updating size storer with new values. 2015-03-02T13:09:02.142-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:09:02.147-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:09:04.232-0500 I NETWORK [conn2] end connection 10.4.127.218:50103 (2 connections now open) 2015-03-02T13:09:04.272-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50108 #6 (3 connections now open) 2015-03-02T13:09:04.278-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:09:04.440-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:09:04.498-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (30757 records 315958618 bytes) are inconsistent with full validation results (29757 records 305685618 bytes). Updating counters with new values. 2015-03-02T13:09:04.498-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (30165 records 309877002 bytes) is inconsistent with full validation results (29757 records 305685618 bytes). Updating size storer with new values. 2015-03-02T13:09:04.502-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:09:04.508-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:09:04.512-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 233ms 2015-03-02T13:09:04.968-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:09:05.119-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 2112.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:10218 nscannedObjects:10218 nMatched:5109 nModified:5109 keyUpdates:1 writeConflicts:0 numYields:82 locks:{} 596ms 2015-03-02T13:09:05.119-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2112.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 596ms 2015-03-02T13:09:05.123-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:09:05.342-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (30757 records 316022838 bytes) are inconsistent with full validation results (31757 records 326295838 bytes). Updating counters with new values. 2015-03-02T13:09:05.342-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (30757 records 316015922 bytes) is inconsistent with full validation results (31757 records 326295838 bytes). Updating size storer with new values. 2015-03-02T13:09:05.345-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:09:05.355-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:09:05.375-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 252ms 2015-03-02T13:09:06.554-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T13:09:35.534-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:09:35.556-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:09:35.557-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:09:35.557-0500 I CONTROL [initandlisten] 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:09:35.565-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:09:35.569-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:09:35.657-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:09:35.657-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:09:35.658-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:09:35.735-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:09:42.661-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50118 #1 (1 connection now open) 2015-03-02T13:09:42.756-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50119 #2 (2 connections now open) 2015-03-02T13:09:44.272-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50120 #3 (3 connections now open) 2015-03-02T13:09:44.291-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:09:45.185-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 3266.0 } } ndeleted:25903 keyUpdates:0 writeConflicts:0 numYields:217 locks:{} 2518ms 2015-03-02T13:09:45.188-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3266.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2518ms 2015-03-02T13:09:45.193-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:09:45.305-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:09:45.768-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (12396 records 127344108 bytes) are inconsistent with full validation results (19254 records 197888256 bytes). Updating counters with new values. 2015-03-02T13:09:45.768-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (11494 records 118077862 bytes) is inconsistent with full validation results (19254 records 197888256 bytes). Updating size storer with new values. 2015-03-02T13:09:45.768-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:09:45.768-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (19254 records 197888256 bytes) are inconsistent with full validation results (11396 records 117071108 bytes). Updating counters with new values. 2015-03-02T13:09:45.768-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19254 records 197888256 bytes) is inconsistent with full validation results (11396 records 117071108 bytes). Updating size storer with new values. 2015-03-02T13:09:45.769-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:09:45.778-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:09:45.779-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:09:45.785-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1493ms 2015-03-02T13:09:45.786-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 592ms 2015-03-02T13:09:45.797-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:09:45.859-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (10173 records 104507229 bytes) are inconsistent with full validation results (12190 records 125227870 bytes). Updating counters with new values. 2015-03-02T13:09:45.859-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10298 records 105791354 bytes) is inconsistent with full validation results (12190 records 125227870 bytes). Updating size storer with new values. 2015-03-02T13:09:45.859-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:09:45.864-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:09:45.875-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:09:45.915-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11094 records 113968662 bytes) are inconsistent with full validation results (10861 records 111575053 bytes). Updating counters with new values. 2015-03-02T13:09:45.915-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11315 records 116238995 bytes) is inconsistent with full validation results (10861 records 111575053 bytes). Updating size storer with new values. 2015-03-02T13:09:45.915-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:09:45.917-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:09:46.152-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 570.0 } } ndeleted:8406 keyUpdates:0 writeConflicts:0 numYields:65 locks:{} 361ms 2015-03-02T13:09:46.152-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 570.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 361ms 2015-03-02T13:09:46.161-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:09:46.187-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (4774 records 49043302 bytes) are inconsistent with full validation results (3990 records 40989270 bytes). Updating counters with new values. 2015-03-02T13:09:46.187-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (5082 records 52207386 bytes) is inconsistent with full validation results (3990 records 40989270 bytes). Updating size storer with new values. 2015-03-02T13:09:46.187-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:09:46.195-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:09:46.199-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:09:46.207-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:09:46.208-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:09:46.212-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:09:46.220-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (3990 records 40989270 bytes) is inconsistent with full validation results (3991 records 40989316 bytes). Updating size storer with new values. 2015-03-02T13:09:46.220-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:09:46.220-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:09:46.223-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:09:46.231-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:09:46.232-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:09:46.236-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:09:46.244-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:09:46.245-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:09:46.249-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:09:46.257-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:09:46.258-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:09:47.732-0500 I NETWORK [conn2] end connection 10.4.127.218:50119 (2 connections now open) 2015-03-02T13:09:47.753-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50121 #4 (3 connections now open) 2015-03-02T13:09:47.763-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:09:47.792-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (5682 records 58360959 bytes) is inconsistent with full validation results (5991 records 61535316 bytes). Updating size storer with new values. 2015-03-02T13:09:47.792-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:09:47.793-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:09:47.804-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:09:47.826-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:09:47.827-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:09:49.312-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:09:54.776-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:09:55.915-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:09:56.003-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:09:56.254-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (21991 records 225903316 bytes) are inconsistent with full validation results (21191 records 217684916 bytes). Updating counters with new values. 2015-03-02T13:09:56.254-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21681 records 222718686 bytes) is inconsistent with full validation results (21191 records 217684916 bytes). Updating size storer with new values. 2015-03-02T13:09:56.255-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:09:56.257-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:09:56.259-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 344ms 2015-03-02T13:09:56.263-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:09:56.329-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (21191 records 217684916 bytes) are inconsistent with full validation results (21991 records 225903316 bytes). Updating counters with new values. 2015-03-02T13:09:56.330-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21191 records 217684916 bytes) is inconsistent with full validation results (21991 records 225903316 bytes). Updating size storer with new values. 2015-03-02T13:09:56.330-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:09:56.333-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:09:56.338-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:09:56.394-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:09:56.414-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:09:57.651-0500 I NETWORK [conn1] end connection 10.4.127.218:50118 (2 connections now open) 2015-03-02T13:09:57.673-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50123 #5 (3 connections now open) 2015-03-02T13:09:57.681-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:57.789-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24681 records 253537686 bytes) is inconsistent with full validation results (24991 records 256722316 bytes). Updating size storer with new values. 2015-03-02T13:09:57.790-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:57.793-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:57.794-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 113ms 2015-03-02T13:09:57.802-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:57.865-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:57.868-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:57.884-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:57.952-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:57.962-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:57.969-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.030-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.042-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.051-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.123-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.126-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.683-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 1320.0 } } ndeleted:15721 keyUpdates:0 writeConflicts:0 numYields:123 locks:{} 551ms 2015-03-02T13:09:58.683-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1320.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 551ms 2015-03-02T13:09:58.690-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.736-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (9301 records 95538946 bytes) is inconsistent with full validation results (9270 records 95230710 bytes). Updating size storer with new values. 2015-03-02T13:09:58.737-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.742-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.752-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.787-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.789-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.801-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.821-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.823-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.834-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.857-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.859-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.863-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.881-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.883-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.892-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.917-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.918-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.933-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.950-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (9270 records 95230710 bytes) is inconsistent with full validation results (9271 records 95230756 bytes). Updating size storer with new values. 2015-03-02T13:09:58.951-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.952-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.964-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:58.988-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (9271 records 95230756 bytes) is inconsistent with full validation results (9270 records 95230710 bytes). Updating size storer with new values. 2015-03-02T13:09:58.988-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:58.989-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:58.993-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:59.012-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:59.014-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:59.018-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:59.051-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:59.052-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:59.058-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:59.090-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:59.094-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:59.098-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:59.131-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (9270 records 95230710 bytes) is inconsistent with full validation results (9271 records 95230756 bytes). Updating size storer with new values. 2015-03-02T13:09:59.132-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:59.133-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:59.141-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:59.160-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:59.161-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:09:59.174-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:09:59.197-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:09:59.199-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:10:04.245-0500 I NETWORK [conn3] end connection 10.4.127.218:50120 (2 connections now open) 2015-03-02T13:10:04.284-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50124 #6 (3 connections now open) 2015-03-02T13:10:04.832-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T13:10:04.957-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 2641.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12940 nscannedObjects:12940 nMatched:6470 nModified:6470 keyUpdates:1 writeConflicts:0 numYields:105 locks:{} 657ms 2015-03-02T13:10:04.957-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2641.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 658ms 2015-03-02T13:10:04.961-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:10:05.165-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (20271 records 208317853 bytes) are inconsistent with full validation results (19271 records 198044853 bytes). Updating counters with new values. 2015-03-02T13:10:05.165-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (19767 records 203140261 bytes) is inconsistent with full validation results (19271 records 198044853 bytes). Updating size storer with new values. 2015-03-02T13:10:05.166-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:10:05.171-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:10:05.187-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 225ms 2015-03-02T13:10:05.194-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:10:05.239-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (19271 records 198044853 bytes) are inconsistent with full validation results (20271 records 208317853 bytes). Updating counters with new values. 2015-03-02T13:10:05.239-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (19271 records 198044853 bytes) is inconsistent with full validation results (20271 records 208317853 bytes). Updating size storer with new values. 2015-03-02T13:10:05.239-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:10:05.242-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:10:05.253-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:10:05.313-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:10:05.316-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:10:06.181-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 8332.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:12940 nscannedObjects:12940 nMatched:6470 nModified:6470 keyUpdates:1 writeConflicts:0 numYields:107 locks:{} 862ms 2015-03-02T13:10:06.182-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8332.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 862ms 2015-03-02T13:10:06.185-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:10:06.250-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:10:06.253-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:10:06.262-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:10:06.321-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:10:06.323-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:10:06.328-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:10:06.375-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:10:06.378-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:10:06.696-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 159ms 2015-03-02T13:10:06.702-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 199ms 2015-03-02T13:10:32.121-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:10:32.134-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:10:32.134-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:10:32.134-0500 I CONTROL [initandlisten] 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:10:32.135-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:10:32.145-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:10:32.203-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:10:32.203-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:10:32.204-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:10:32.294-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:10:32.800-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50129 #1 (1 connection now open) 2015-03-02T13:10:34.316-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50130 #2 (2 connections now open) 2015-03-02T13:10:34.337-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:35.231-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:10:36.630-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:10:37.214-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (41299 records 424408879 bytes) are inconsistent with full validation results (39299 records 403862879 bytes). Updating counters with new values. 2015-03-02T13:10:37.220-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (40300 records 414146152 bytes) is inconsistent with full validation results (39299 records 403862879 bytes). Updating size storer with new values. 2015-03-02T13:10:37.220-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:37.229-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:37.234-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2897ms 2015-03-02T13:10:37.252-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:37.365-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (39299 records 403862879 bytes) are inconsistent with full validation results (41299 records 424408879 bytes). Updating counters with new values. 2015-03-02T13:10:37.365-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39299 records 403862879 bytes) is inconsistent with full validation results (41299 records 424408879 bytes). Updating size storer with new values. 2015-03-02T13:10:37.365-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:37.370-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:37.372-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 120ms 2015-03-02T13:10:38.816-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50132 #3 (3 connections now open) 2015-03-02T13:10:39.745-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 221ms 2015-03-02T13:10:39.901-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T13:10:41.117-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T13:10:41.631-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 6253.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:38778 nscannedObjects:38778 nMatched:19389 nModified:19389 keyUpdates:1 writeConflicts:0 numYields:330 locks:{} 2803ms 2015-03-02T13:10:41.631-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6253.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2803ms 2015-03-02T13:10:41.635-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:10:42.069-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (48636 records 499879445 bytes) are inconsistent with full validation results (48299 records 496417444 bytes). Updating counters with new values. 2015-03-02T13:10:42.069-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:10:42.089-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:10:42.126-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 490ms 2015-03-02T13:10:42.157-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:10:42.196-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 215ms 2015-03-02T13:10:42.210-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T13:10:42.215-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:10:42.468-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (49962 records 513501443 bytes) are inconsistent with full validation results (49566 records 509433335 bytes). Updating counters with new values. 2015-03-02T13:10:42.468-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (49574 records 509515519 bytes) is inconsistent with full validation results (49566 records 509433335 bytes). Updating size storer with new values. 2015-03-02T13:10:42.468-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:10:42.482-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:10:42.490-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (49566 records 509433335 bytes) are inconsistent with full validation results (50299 records 516963444 bytes). Updating counters with new values. 2015-03-02T13:10:42.490-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (49566 records 509433335 bytes) is inconsistent with full validation results (50299 records 516963444 bytes). Updating size storer with new values. 2015-03-02T13:10:42.490-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:10:42.494-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 337ms 2015-03-02T13:10:42.506-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:10:42.514-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 298ms 2015-03-02T13:10:42.527-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:10:42.534-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:10:42.760-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:10:42.768-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:10:42.771-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:10:42.778-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:10:42.780-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 253ms 2015-03-02T13:10:42.786-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 252ms 2015-03-02T13:10:44.296-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:10:44.600-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T13:10:45.441-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9711.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:39356 nscannedObjects:39356 nMatched:19678 nModified:19678 keyUpdates:1 writeConflicts:0 numYields:328 locks:{} 2658ms 2015-03-02T13:10:45.441-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9711.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2658ms 2015-03-02T13:10:45.442-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T13:10:45.444-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:10:45.791-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T13:10:46.137-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (54299 records 558059201 bytes) are inconsistent with full validation results (53299 records 547786201 bytes). Updating counters with new values. 2015-03-02T13:10:46.137-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (54233 records 557381183 bytes) is inconsistent with full validation results (53299 records 547786201 bytes). Updating size storer with new values. 2015-03-02T13:10:46.137-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:10:46.162-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:10:46.182-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 737ms 2015-03-02T13:10:46.493-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:10:46.773-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:10:47.764-0500 I NETWORK [conn1] end connection 10.4.127.218:50129 (2 connections now open) 2015-03-02T13:10:47.804-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50133 #4 (3 connections now open) 2015-03-02T13:10:48.251-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:10:48.985-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T13:10:49.081-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:10:49.479-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:10:49.645-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:10:50.914-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:51.350-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 158ms 2015-03-02T13:10:51.357-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 155ms 2015-03-02T13:10:51.620-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (67299 records 691608201 bytes) are inconsistent with full validation results (66299 records 681335201 bytes). Updating counters with new values. 2015-03-02T13:10:51.620-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (67233 records 690930183 bytes) is inconsistent with full validation results (66299 records 681335201 bytes). Updating size storer with new values. 2015-03-02T13:10:51.620-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:51.649-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:51.674-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 759ms 2015-03-02T13:10:51.695-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:52.629-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (67299 records 691608201 bytes) are inconsistent with full validation results (68299 records 701881201 bytes). Updating counters with new values. 2015-03-02T13:10:52.629-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (67233 records 690930183 bytes) is inconsistent with full validation results (68299 records 701881201 bytes). Updating size storer with new values. 2015-03-02T13:10:52.630-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:52.650-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:52.664-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 969ms 2015-03-02T13:10:52.693-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:53.048-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 158ms 2015-03-02T13:10:53.303-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (69233 records 711476183 bytes) is inconsistent with full validation results (69299 records 712154201 bytes). Updating size storer with new values. 2015-03-02T13:10:53.304-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:53.341-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:53.358-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 664ms 2015-03-02T13:10:53.787-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:10:54.258-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T13:10:54.922-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:10:55.378-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T13:10:56.983-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 2312.0 } } ndeleted:52321 keyUpdates:0 writeConflicts:0 numYields:416 locks:{} 3619ms 2015-03-02T13:10:56.983-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2312.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3619ms 2015-03-02T13:10:56.985-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:57.242-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (21978 records 225779994 bytes) are inconsistent with full validation results (22978 records 236052994 bytes). Updating counters with new values. 2015-03-02T13:10:57.242-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (22365 records 229750436 bytes) is inconsistent with full validation results (22978 records 236052994 bytes). Updating size storer with new values. 2015-03-02T13:10:57.242-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:57.258-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:57.265-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 280ms 2015-03-02T13:10:57.268-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:57.345-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:57.354-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:57.367-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:57.461-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:10:57.485-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23978 records 246325994 bytes) are inconsistent with full validation results (23006 records 236340638 bytes). Updating counters with new values. 2015-03-02T13:10:57.485-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23591 records 242350343 bytes) is inconsistent with full validation results (23006 records 236340638 bytes). Updating size storer with new values. 2015-03-02T13:10:57.485-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:57.489-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:57.492-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 124ms 2015-03-02T13:10:57.495-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:57.643-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23722 records 243696106 bytes) are inconsistent with full validation results (23978 records 246325994 bytes). Updating counters with new values. 2015-03-02T13:10:57.643-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23619 records 242637987 bytes) is inconsistent with full validation results (23978 records 246325994 bytes). Updating size storer with new values. 2015-03-02T13:10:57.643-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:57.653-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:57.658-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 162ms 2015-03-02T13:10:57.683-0500 I NETWORK [conn3] end connection 10.4.127.218:50132 (2 connections now open) 2015-03-02T13:10:57.690-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T13:10:57.737-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50135 #5 (3 connections now open) 2015-03-02T13:10:57.762-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:10:57.893-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (24262 records 249267186 bytes) are inconsistent with full validation results (24978 records 256609472 bytes). Updating counters with new values. 2015-03-02T13:10:57.893-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24262 records 249264495 bytes) is inconsistent with full validation results (24978 records 256609472 bytes). Updating size storer with new values. 2015-03-02T13:10:57.895-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:10:57.903-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:10:57.908-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 146ms 2015-03-02T13:10:57.916-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:10:58.017-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6516.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4968 nscannedObjects:4968 nMatched:2484 nModified:2484 keyUpdates:1 writeConflicts:0 numYields:41 locks:{} 353ms 2015-03-02T13:10:58.017-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6516.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 353ms 2015-03-02T13:10:58.022-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:58.072-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (24978 records 256618104 bytes) are inconsistent with full validation results (24978 records 256624656 bytes). Updating counters with new values. 2015-03-02T13:10:58.072-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24978 records 256609706 bytes) is inconsistent with full validation results (24978 records 256624656 bytes). Updating size storer with new values. 2015-03-02T13:10:58.072-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:10:58.084-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:10:58.085-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 169ms 2015-03-02T13:10:58.130-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (24978 records 256624656 bytes) are inconsistent with full validation results (24978 records 256631286 bytes). Updating counters with new values. 2015-03-02T13:10:58.130-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (24978 records 256624656 bytes) is inconsistent with full validation results (24978 records 256631286 bytes). Updating size storer with new values. 2015-03-02T13:10:58.130-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:58.134-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:58.137-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 114ms 2015-03-02T13:10:58.336-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 2115.0 } } ndeleted:5309 keyUpdates:0 writeConflicts:0 numYields:41 locks:{} 197ms 2015-03-02T13:10:58.336-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2115.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 197ms 2015-03-02T13:10:58.337-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:58.384-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19849 records 203911117 bytes) is inconsistent with full validation results (19669 records 202059637 bytes). Updating size storer with new values. 2015-03-02T13:10:58.384-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:58.387-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:58.391-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:58.425-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:58.428-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:58.443-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:58.487-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:58.489-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:58.493-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:10:58.532-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:10:58.535-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:10:59.122-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T13:11:00.345-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:11:00.809-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:11:00.970-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T13:11:01.097-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25669 records 263697637 bytes) are inconsistent with full validation results (24669 records 253424637 bytes). Updating counters with new values. 2015-03-02T13:11:01.097-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25489 records 261848497 bytes) is inconsistent with full validation results (24669 records 253424637 bytes). Updating size storer with new values. 2015-03-02T13:11:01.099-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:11:01.107-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:11:01.114-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 304ms 2015-03-02T13:11:01.122-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:11:01.195-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (24669 records 253424637 bytes) are inconsistent with full validation results (25669 records 263697637 bytes). Updating counters with new values. 2015-03-02T13:11:01.195-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (24669 records 253424637 bytes) is inconsistent with full validation results (25669 records 263697637 bytes). Updating size storer with new values. 2015-03-02T13:11:01.195-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:11:01.199-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:11:01.204-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:11:01.277-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:11:01.281-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:11:01.608-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:11:02.056-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:11:02.396-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:11:02.754-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 197ms 2015-03-02T13:11:03.313-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:11:03.868-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:02015-03-02T13:11:29.016-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:11:29.033-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:11:29.034-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:11:29.034-0500 I CONTROL [initandlisten] 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:11:29.035-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:11:29.045-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:11:29.104-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:11:29.104-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:11:29.104-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:11:29.178-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:11:32.826-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50142 #1 (1 connection now open) 2015-03-02T13:11:33.705-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 9655.0 } } ndeleted:12229 keyUpdates:0 writeConflicts:0 numYields:95 locks:{} 872ms 2015-03-02T13:11:33.705-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9655.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 873ms 2015-03-02T13:11:33.708-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:11:34.358-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50143 #2 (2 connections now open) 2015-03-02T13:11:34.823-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (25298 records 259879078 bytes) is inconsistent with full validation results (25070 records 257544110 bytes). Updating size storer with new values. 2015-03-02T13:11:34.823-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:11:34.828-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:11:34.831-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 469ms 2015-03-02T13:11:34.832-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1123ms 2015-03-02T13:11:34.840-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:34.842-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:11:34.931-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:34.934-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:11:34.937-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:34.941-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:11:34.948-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:35.039-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (25070 records 257554445 bytes) are inconsistent with full validation results (25070 records 257544630 bytes). Updating counters with new values. 2015-03-02T13:11:35.039-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25070 records 257554146 bytes) is inconsistent with full validation results (25070 records 257544630 bytes). Updating size storer with new values. 2015-03-02T13:11:35.039-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:35.045-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:35.053-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:35.142-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (25070 records 257555381 bytes) are inconsistent with full validation results (25070 records 257555836 bytes). Updating counters with new values. 2015-03-02T13:11:35.142-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25070 records 257544630 bytes) is inconsistent with full validation results (25070 records 257555836 bytes). Updating size storer with new values. 2015-03-02T13:11:35.142-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:35.151-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:35.162-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:35.255-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (25070 records 257568537 bytes) are inconsistent with full validation results (25070 records 257567757 bytes). Updating counters with new values. 2015-03-02T13:11:35.255-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25070 records 257557786 bytes) is inconsistent with full validation results (25070 records 257567757 bytes). Updating size storer with new values. 2015-03-02T13:11:35.255-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:35.261-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:35.278-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:35.340-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7876.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6334 nscannedObjects:6334 nMatched:3167 nModified:3167 keyUpdates:1 writeConflicts:0 numYields:51 locks:{} 394ms 2015-03-02T13:11:35.340-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7876.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 394ms 2015-03-02T13:11:35.344-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:11:35.368-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (25070 records 257575141 bytes) are inconsistent with full validation results (25070 records 257580562 bytes). Updating counters with new values. 2015-03-02T13:11:35.368-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25070 records 257570006 bytes) is inconsistent with full validation results (25070 records 257580562 bytes). Updating size storer with new values. 2015-03-02T13:11:35.368-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:35.374-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:35.379-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T13:11:35.391-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:35.428-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (25070 records 257580562 bytes) are inconsistent with full validation results (25070 records 257585281 bytes). Updating counters with new values. 2015-03-02T13:11:35.428-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (25070 records 257580562 bytes) is inconsistent with full validation results (25070 records 257585281 bytes). Updating size storer with new values. 2015-03-02T13:11:35.428-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:11:35.435-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:11:35.449-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:11:35.479-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:35.482-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:35.497-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:35.537-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:11:35.542-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:11:35.568-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:35.571-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:36.594-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2335.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31072 nscannedObjects:31072 nMatched:15536 nModified:15536 keyUpdates:1 writeConflicts:0 numYields:243 locks:{} 1015ms 2015-03-02T13:11:36.594-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2335.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1015ms 2015-03-02T13:11:36.599-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:36.664-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:36.667-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:36.677-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:36.743-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:36.746-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:36.762-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:36.817-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:36.820-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:36.828-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:36.900-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:36.902-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:37.751-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50145 #3 (3 connections now open) 2015-03-02T13:11:37.771-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:11:37.897-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:11:37.906-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27070 records 278292078 bytes) are inconsistent with full validation results (26070 records 268019078 bytes). Updating counters with new values. 2015-03-02T13:11:37.906-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26139 records 268727915 bytes) is inconsistent with full validation results (26070 records 268019078 bytes). Updating size storer with new values. 2015-03-02T13:11:37.906-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:11:37.909-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:11:37.912-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 141ms 2015-03-02T13:11:37.919-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:11:37.994-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (26070 records 268019078 bytes) are inconsistent with full validation results (27070 records 278292078 bytes). Updating counters with new values. 2015-03-02T13:11:37.994-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26070 records 268019078 bytes) is inconsistent with full validation results (27070 records 278292078 bytes). Updating size storer with new values. 2015-03-02T13:11:37.994-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:11:37.998-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:11:39.944-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:11:45.231-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:11:45.368-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:45.885-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (44139 records 453641915 bytes) is inconsistent with full validation results (45070 records 463206078 bytes). Updating size storer with new values. 2015-03-02T13:11:45.885-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:45.893-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:45.907-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 539ms 2015-03-02T13:11:45.939-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:46.067-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:46.073-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:46.077-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 138ms 2015-03-02T13:11:46.086-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:46.236-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:46.243-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:46.246-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 160ms 2015-03-02T13:11:46.274-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:46.393-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:46.407-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:46.410-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 136ms 2015-03-02T13:11:46.416-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:46.540-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:46.546-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:46.550-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 134ms 2015-03-02T13:11:46.559-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:46.679-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:46.690-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:46.705-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 145ms 2015-03-02T13:11:46.730-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:46.876-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:46.887-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:46.892-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 162ms 2015-03-02T13:11:46.964-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:11:47.792-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:11:47.797-0500 I NETWORK [conn1] end connection 10.4.127.218:50142 (2 connections now open) 2015-03-02T13:11:47.835-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50146 #4 (3 connections now open) 2015-03-02T13:11:48.346-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9521.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32030 nscannedObjects:32030 nMatched:16015 nModified:16015 keyUpdates:1 writeConflicts:0 numYields:256 locks:{} 1445ms 2015-03-02T13:11:48.346-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9521.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1445ms 2015-03-02T13:11:48.353-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:48.535-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:48.548-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:48.553-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 200ms 2015-03-02T13:11:49.497-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 5134.0 } } ndeleted:22134 keyUpdates:0 writeConflicts:0 numYields:173 locks:{} 941ms 2015-03-02T13:11:49.497-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5134.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 942ms 2015-03-02T13:11:49.499-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:49.659-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (26016 records 267263408 bytes) is inconsistent with full validation results (25936 records 266440528 bytes). Updating size storer with new values. 2015-03-02T13:11:49.659-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:49.667-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:49.671-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 172ms 2015-03-02T13:11:49.683-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:49.756-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:49.759-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:49.771-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:49.839-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:49.842-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:49.851-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:49.932-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:49.935-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:50.271-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4193.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7646 nscannedObjects:7646 nMatched:3823 nModified:3823 keyUpdates:1 writeConflicts:0 numYields:60 locks:{} 323ms 2015-03-02T13:11:50.271-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4193.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 324ms 2015-03-02T13:11:50.273-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:50.401-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25936 records 266478488 bytes) is inconsistent with full validation results (25936 records 266490227 bytes). Updating size storer with new values. 2015-03-02T13:11:50.401-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:50.404-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:50.407-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 133ms 2015-03-02T13:11:50.415-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:50.526-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (26936 records 276763227 bytes) are inconsistent with full validation results (25936 records 266490227 bytes). Updating counters with new values. 2015-03-02T13:11:50.526-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (26033 records 267486708 bytes) is inconsistent with full validation results (25936 records 266490227 bytes). Updating size storer with new values. 2015-03-02T13:11:50.526-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:50.530-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:50.532-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T13:11:51.982-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T13:11:52.058-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:11:53.115-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:11:53.119-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:11:53.395-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (32936 records 338401227 bytes) are inconsistent with full validation results (33936 records 348674227 bytes). Updating counters with new values. 2015-03-02T13:11:53.395-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (32033 records 329124708 bytes) is inconsistent with full validation results (33936 records 348674227 bytes). Updating size storer with new values. 2015-03-02T13:11:53.395-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:11:53.410-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:11:53.413-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 294ms 2015-03-02T13:11:55.128-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:11:55.223-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:11:56.284-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:11:57.754-0500 I NETWORK [conn3] end connection 10.4.127.218:50145 (2 connections now open) 2015-03-02T13:11:57.759-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50147 #5 (3 connections now open) 2015-03-02T13:11:57.769-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:11:58.195-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (44033 records 452400708 bytes) is inconsistent with full validation results (44936 records 461677227 bytes). Updating size storer with new values. 2015-03-02T13:11:58.196-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:11:58.213-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:11:58.221-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 452ms 2015-03-02T13:11:58.569-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T13:11:59.331-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:59.690-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (47936 records 492651824 bytes) are inconsistent with full validation results (47936 records 492614046 bytes). Updating counters with new values. 2015-03-02T13:11:59.690-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (47936 records 492640488 bytes) is inconsistent with full validation results (47936 records 492614046 bytes). Updating size storer with new values. 2015-03-02T13:11:59.690-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:59.702-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:11:59.715-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 383ms 2015-03-02T13:11:59.739-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:11:59.980-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (47936 records 492646871 bytes) are inconsistent with full validation results (47936 records 492659208 bytes). Updating counters with new values. 2015-03-02T13:11:59.980-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (47936 records 492641710 bytes) is inconsistent with full validation results (47936 records 492659208 bytes). Updating size storer with new values. 2015-03-02T13:11:59.980-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:11:59.994-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:00.002-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 263ms 2015-03-02T13:12:00.023-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:00.260-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (47936 records 492688822 bytes) are inconsistent with full validation results (47936 records 492690720 bytes). Updating counters with new values. 2015-03-02T13:12:00.260-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (47936 records 492680047 bytes) is inconsistent with full validation results (47936 records 492690720 bytes). Updating size storer with new values. 2015-03-02T13:12:00.260-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:00.274-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:00.282-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 259ms 2015-03-02T13:12:00.919-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:12:01.665-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1647.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:59792 nscannedObjects:59792 nMatched:29896 nModified:29896 keyUpdates:1 writeConflicts:0 numYields:485 locks:{} 3436ms 2015-03-02T13:12:01.666-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1647.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3437ms 2015-03-02T13:12:01.671-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:12:02.054-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (49936 records 513357633 bytes) are inconsistent with full validation results (49936 records 513381176 bytes). Updating counters with new values. 2015-03-02T13:12:02.054-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (49161 records 505396058 bytes) is inconsistent with full validation results (49936 records 513381176 bytes). Updating size storer with new values. 2015-03-02T13:12:02.054-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:12:02.066-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:12:02.097-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 425ms 2015-03-02T13:12:02.116-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:12:02.372-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:12:02.382-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:12:02.389-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 272ms 2015-03-02T13:12:02.406-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:12:02.614-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:12:02.625-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:12:02.629-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 223ms 2015-03-02T13:12:02.652-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:12:02.866-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T13:12:02.883-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T13:12:02.962-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (51936 records 533927176 bytes) are inconsistent with full validation results (49936 records 513381176 bytes). Updating counters with new values. 2015-03-02T13:12:02.962-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (51137 records 525719049 bytes) is inconsistent with full validation results (49936 records 513381176 bytes). Updating size storer with new values. 2015-03-02T13:12:02.962-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:12:02.977-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:12:02.995-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 342ms 2015-03-02T13:12:03.572-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:12:04.356-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50148 #6 (4 connections now open) 2015-03-02T13:12:04.390-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T13:12:04.393-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:12:04.396-0500 I NETWORK [conn2] end connection 10.4.127.218:50143 (3 connections now open) 2015-03-02T13:12:04.721-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (52936 records 544200176 bytes) are inconsistent with full validation results (54581 records 561099261 bytes). Updating counters with new values. 2015-03-02T13:12:04.721-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (52137 records 535992049 bytes) is inconsistent with full validation results (54581 records 561099261 bytes). Updating size storer with new values. 2015-03-02T13:12:04.722-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:12:04.744-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:12:04.749-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 356ms 2015-03-02T13:12:06.434-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T13:12:06.499-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:12:06.504-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:12:31.557-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:12:31.577-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:12:31.577-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:12:31.577-0500 I CONTROL [initandlisten] 2015-03-02T13:12:31.578-0500 I CONTROL [initandlisten] 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:12:31.579-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:12:31.588-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:12:31.664-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:12:31.664-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:12:31.664-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:12:31.749-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:12:32.838-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50155 #1 (1 connection now open) 2015-03-02T13:12:32.848-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:12:34.351-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50156 #2 (2 connections now open) 2015-03-02T13:12:34.763-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:12:34.770-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:12:34.773-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 417ms 2015-03-02T13:12:34.774-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1925ms 2015-03-02T13:12:34.784-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:34.796-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:12:34.934-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:34.938-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:12:34.944-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:34.950-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:12:34.951-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T13:12:34.955-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 158ms 2015-03-02T13:12:34.972-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:35.124-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (34260 records 352097232 bytes) are inconsistent with full validation results (37086 records 381128730 bytes). Updating counters with new values. 2015-03-02T13:12:35.124-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (34298 records 352487606 bytes) is inconsistent with full validation results (37086 records 381128730 bytes). Updating size storer with new values. 2015-03-02T13:12:35.124-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:35.134-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:35.140-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T13:12:35.152-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:35.369-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (34022 records 349639245 bytes) are inconsistent with full validation results (33757 records 346929913 bytes). Updating counters with new values. 2015-03-02T13:12:35.369-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (34124 records 350688417 bytes) is inconsistent with full validation results (33757 records 346929913 bytes). Updating size storer with new values. 2015-03-02T13:12:35.369-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:35.376-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:35.388-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 236ms 2015-03-02T13:12:35.402-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:35.595-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (30934 records 317892535 bytes) are inconsistent with full validation results (30788 records 316411059 bytes). Updating counters with new values. 2015-03-02T13:12:35.595-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (31859 records 327407085 bytes) is inconsistent with full validation results (30788 records 316411059 bytes). Updating size storer with new values. 2015-03-02T13:12:35.595-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:35.608-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:35.617-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 215ms 2015-03-02T13:12:35.626-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:35.783-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (28026 records 288001127 bytes) are inconsistent with full validation results (27813 records 285810209 bytes). Updating counters with new values. 2015-03-02T13:12:35.783-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (28713 records 295067609 bytes) is inconsistent with full validation results (27813 records 285810209 bytes). Updating size storer with new values. 2015-03-02T13:12:35.783-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:35.791-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:35.799-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 173ms 2015-03-02T13:12:36.038-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 7081.0 } } ndeleted:16986 keyUpdates:0 writeConflicts:0 numYields:134 locks:{} 1077ms 2015-03-02T13:12:36.038-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7081.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1078ms 2015-03-02T13:12:36.043-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:12:36.127-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22515 records 231325221 bytes) are inconsistent with full validation results (20313 records 208675449 bytes). Updating counters with new values. 2015-03-02T13:12:36.127-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23500 records 241446691 bytes) is inconsistent with full validation results (20313 records 208675449 bytes). Updating size storer with new values. 2015-03-02T13:12:36.127-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:12:36.137-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:12:36.148-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:12:36.206-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:12:36.209-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:12:37.745-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50191 #3 (3 connections now open) 2015-03-02T13:12:37.763-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:37.838-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20328 records 208829544 bytes) is inconsistent with full validation results (21314 records 218948495 bytes). Updating size storer with new values. 2015-03-02T13:12:37.838-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:37.843-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:37.851-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:37.933-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:37.935-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:37.952-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.066-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (22314 records 229221495 bytes) are inconsistent with full validation results (21330 records 219112863 bytes). Updating counters with new values. 2015-03-02T13:12:38.066-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (21327 records 219082044 bytes) is inconsistent with full validation results (21330 records 219112863 bytes). Updating size storer with new values. 2015-03-02T13:12:38.066-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.069-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.084-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 131ms 2015-03-02T13:12:38.093-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.172-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (21330 records 219112863 bytes) are inconsistent with full validation results (22314 records 229221495 bytes). Updating counters with new values. 2015-03-02T13:12:38.172-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (21330 records 219112863 bytes) is inconsistent with full validation results (22314 records 229221495 bytes). Updating size storer with new values. 2015-03-02T13:12:38.172-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.176-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.191-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.288-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.292-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.295-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 103ms 2015-03-02T13:12:38.300-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.410-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (22314 records 229221495 bytes) is inconsistent with full validation results (22313 records 229221449 bytes). Updating size storer with new values. 2015-03-02T13:12:38.410-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.414-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.416-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T13:12:38.431-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.532-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (22313 records 229221449 bytes) is inconsistent with full validation results (22314 records 229221495 bytes). Updating size storer with new values. 2015-03-02T13:12:38.532-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.536-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.538-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 106ms 2015-03-02T13:12:38.550-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.656-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.661-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.664-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 114ms 2015-03-02T13:12:38.668-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.777-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.782-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.785-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 116ms 2015-03-02T13:12:38.798-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:38.974-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:38.981-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:38.983-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 185ms 2015-03-02T13:12:38.995-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:39.062-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:39.065-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:39.078-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:39.172-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:39.175-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:39.183-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:39.274-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:39.279-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:39.284-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:39.376-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:39.380-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:41.110-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:12:42.339-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:12:47.820-0500 I NETWORK [conn1] end connection 10.4.127.218:50155 (2 connections now open) 2015-03-02T13:12:47.840-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50200 #4 (3 connections now open) 2015-03-02T13:12:47.874-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:12:48.234-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (40323 records 414227952 bytes) is inconsistent with full validation results (41314 records 424408495 bytes). Updating size storer with new values. 2015-03-02T13:12:48.234-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:12:48.244-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:12:48.251-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 377ms 2015-03-02T13:12:48.259-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:12:48.379-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:12:48.384-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:12:48.387-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 127ms 2015-03-02T13:12:48.400-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:12:48.524-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:12:48.530-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:12:48.535-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 134ms 2015-03-02T13:12:48.559-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:12:48.651-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:12:48.657-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:12:48.661-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T13:12:51.014-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T13:12:51.441-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:51.828-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (46323 records 475865952 bytes) is inconsistent with full validation results (47314 records 486046495 bytes). Updating size storer with new values. 2015-03-02T13:12:51.828-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:51.839-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:51.849-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 407ms 2015-03-02T13:12:52.395-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 208ms 2015-03-02T13:12:52.638-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 168ms 2015-03-02T13:12:54.093-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 155ms 2015-03-02T13:12:54.960-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3649.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:46409 nscannedObjects:46409 nMatched:23205 nModified:23205 keyUpdates:1 writeConflicts:0 numYields:386 locks:{} 3105ms 2015-03-02T13:12:54.960-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3649.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3105ms 2015-03-02T13:12:54.963-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:55.122-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:12:55.368-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (51314 records 527440147 bytes) are inconsistent with full validation results (50314 records 517167147 bytes). Updating counters with new values. 2015-03-02T13:12:55.369-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (51118 records 525426639 bytes) is inconsistent with full validation results (50314 records 517167147 bytes). Updating size storer with new values. 2015-03-02T13:12:55.369-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:55.396-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:55.410-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 447ms 2015-03-02T13:12:55.436-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:55.556-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:12:55.716-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (51118 records 525426639 bytes) is inconsistent with full validation results (51314 records 527440147 bytes). Updating size storer with new values. 2015-03-02T13:12:55.716-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:55.729-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:55.735-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 298ms 2015-03-02T13:12:55.741-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:55.924-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (51314 records 527440147 bytes) are inconsistent with full validation results (52314 records 537713147 bytes). Updating counters with new values. 2015-03-02T13:12:55.925-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (51314 records 527440147 bytes) is inconsistent with full validation results (52314 records 537713147 bytes). Updating size storer with new values. 2015-03-02T13:12:55.925-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:55.932-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:55.937-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 195ms 2015-03-02T13:12:55.950-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:56.095-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:56.101-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:56.105-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 154ms 2015-03-02T13:12:57.372-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:12:57.378-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:12:57.763-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50208 #5 (4 connections now open) 2015-03-02T13:12:58.005-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:12:58.013-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:12:58.023-0500 I COMMAND [conn5] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 248ms 2015-03-02T13:12:58.025-0500 I WRITE [conn4] insert test.foo query: { _id: ObjectId('54f4a827c4d7a5a5537ead51'), x: 5000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database: { acquireCount: { w: 1 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 125968 } }, Collection: { acquireCount: { w: 1 } } } 126ms 2015-03-02T13:12:58.031-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 652ms 2015-03-02T13:12:58.031-0500 I NETWORK [conn3] end connection 10.4.127.218:50191 (3 connections now open) 2015-03-02T13:12:58.144-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 249ms 2015-03-02T13:12:59.281-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9825.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:46409 nscannedObjects:46409 nMatched:23205 nModified:23205 keyUpdates:1 writeConflicts:0 numYields:386 locks:{} 3169ms 2015-03-02T13:12:59.282-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9825.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3170ms 2015-03-02T13:12:59.284-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:12:59.699-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:12:59.701-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (55314 records 568532147 bytes) are inconsistent with full validation results (54314 records 558259147 bytes). Updating counters with new values. 2015-03-02T13:12:59.701-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (54913 records 564412674 bytes) is inconsistent with full validation results (54314 records 558259147 bytes). Updating size storer with new values. 2015-03-02T13:12:59.701-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:12:59.709-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:12:59.715-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 430ms 2015-03-02T13:13:00.769-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:13:02.178-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:13:03.172-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:13:03.276-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:13:03.634-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (61913 records 636323674 bytes) is inconsistent with full validation results (62314 records 640443147 bytes). Updating size storer with new values. 2015-03-02T13:13:03.634-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:13:03.643-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:13:03.650-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 478ms 2015-03-02T13:13:04.317-0500 I NETWORK [conn2] end connection 10.4.127.218:50156 (2 connections now open) 2015-03-02T13:13:04.368-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50213 #6 (3 connections now open) 2015-03-02T13:13:04.388-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:13:04.825-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (62314 records 640443147 bytes) are inconsistent with full validation results (63314 records 650716147 bytes). Updating counters with new values. 2015-03-02T13:13:04.825-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (62314 records 640443147 bytes) is inconsistent with full validation results (63314 records 650716147 bytes). Updating size storer with new values. 2015-03-02T13:13:04.825-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:13:04.859-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:13:04.885-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 496ms 2015-03-02T13:13:04.907-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:13:05.508-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (65146 records 669536283 bytes) are inconsistent with full validation results (63733 records 655020534 bytes). Updating counters with new values. 2015-03-02T13:13:05.508-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (64913 records 667142674 bytes) is inconsistent with full validation results (63733 records 655020534 bytes). Updating size storer with new values. 2015-03-02T13:13:05.508-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:13:05.519-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 146ms 2015-03-02T13:13:05.522-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:13:05.528-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 620ms 2015-03-02T13:13:05.546-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:13:05.861-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (63901 records 656746398 bytes) are inconsistent with full validation results (65314 records 671262147 bytes). Updating counters with new values. 2015-03-02T13:13:05.861-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (63733 records 655020534 bytes) is inconsistent with full validation results (65314 records 671262147 bytes). Updating size storer with new values. 2015-03-02T13:13:05.862-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:13:05.872-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:13:05.880-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 334ms 2015-03-02T13:13:07.942-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T13:13:08.025-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:13:09.185-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:13:35.529-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:13:35.541-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:13:35.541-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:13:35.541-0500 I CONTROL [initandlisten] 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:13:35.542-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:13:35.543-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:13:35.550-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:13:35.624-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:13:35.624-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:13:35.624-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:13:35.750-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:13:41.219-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50233 #1 (1 connection now open) 2015-03-02T13:13:41.234-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:13:42.799-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50234 #2 (2 connections now open) 2015-03-02T13:13:42.995-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:13:43.001-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:13:43.004-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 199ms 2015-03-02T13:13:43.005-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1769ms 2015-03-02T13:13:43.014-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:13:43.021-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:13:43.140-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:13:43.143-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:13:43.147-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:13:43.150-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:13:43.152-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 138ms 2015-03-02T13:13:43.154-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 132ms 2015-03-02T13:13:43.169-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:13:43.306-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383333168 bytes) are inconsistent with full validation results (37299 records 383318101 bytes). Updating counters with new values. 2015-03-02T13:13:43.307-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329892 bytes) is inconsistent with full validation results (37299 records 383318101 bytes). Updating size storer with new values. 2015-03-02T13:13:43.307-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:13:43.315-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:13:43.318-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 149ms 2015-03-02T13:13:44.302-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50236 #3 (3 connections now open) 2015-03-02T13:13:44.337-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:13:44.563-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383496279 bytes) are inconsistent with full validation results (37299 records 383498255 bytes). Updating counters with new values. 2015-03-02T13:13:44.563-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383496279 bytes) is inconsistent with full validation results (37299 records 383498255 bytes). Updating size storer with new values. 2015-03-02T13:13:44.563-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:13:44.576-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:13:44.582-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 245ms 2015-03-02T13:13:44.611-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:13:44.868-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383498255 bytes) are inconsistent with full validation results (37299 records 383511346 bytes). Updating counters with new values. 2015-03-02T13:13:44.868-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383498255 bytes) is inconsistent with full validation results (37299 records 383511346 bytes). Updating size storer with new values. 2015-03-02T13:13:44.868-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:13:44.882-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:13:44.888-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 276ms 2015-03-02T13:13:46.775-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 208ms 2015-03-02T13:13:47.529-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2796.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:65609 nscannedObjects:65609 nMatched:26843 nModified:26843 keyUpdates:1 writeConflicts:75 numYields:537 locks:{} 4370ms 2015-03-02T13:13:47.529-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2796.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4370ms 2015-03-02T13:13:47.534-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:13:47.727-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7482.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:55974 nscannedObjects:55974 nMatched:26843 nModified:26843 keyUpdates:1 writeConflicts:93 numYields:466 locks:{} 4401ms 2015-03-02T13:13:47.727-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7482.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4402ms 2015-03-02T13:13:47.732-0500 I NETWORK [conn2] end connection 10.4.127.218:50234 (2 connections now open) 2015-03-02T13:13:47.794-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50238 #4 (3 connections now open) 2015-03-02T13:13:47.941-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:13:47.958-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:13:47.982-0500 I COMMAND [conn4] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 178ms 2015-03-02T13:13:47.982-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 448ms 2015-03-02T13:13:47.996-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:13:48.203-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:13:48.210-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:13:48.214-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 218ms 2015-03-02T13:13:48.867-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T13:13:49.947-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:13:51.063-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5874.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53686 nscannedObjects:53686 nMatched:26843 nModified:26843 keyUpdates:1 writeConflicts:0 numYields:435 locks:{} 2837ms 2015-03-02T13:13:51.067-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5874.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2837ms 2015-03-02T13:13:51.071-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:13:51.105-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T13:13:51.237-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T13:13:51.373-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434876346 bytes) are inconsistent with full validation results (41015 records 421685814 bytes). Updating counters with new values. 2015-03-02T13:13:51.373-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (41771 records 429452202 bytes) is inconsistent with full validation results (41015 records 421685814 bytes). Updating size storer with new values. 2015-03-02T13:13:51.373-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:13:51.378-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:13:51.388-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 317ms 2015-03-02T13:13:55.459-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T13:13:56.663-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:13:56.850-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T13:13:57.383-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (52015 records 534688814 bytes) are inconsistent with full validation results (52299 records 537606346 bytes). Updating counters with new values. 2015-03-02T13:13:57.383-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (51487 records 529264670 bytes) is inconsistent with full validation results (52299 records 537606346 bytes). Updating size storer with new values. 2015-03-02T13:13:57.383-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:13:57.391-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:13:57.397-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 734ms 2015-03-02T13:13:57.659-0500 I NETWORK [conn1] end connection 10.4.127.218:50233 (2 connections now open) 2015-03-02T13:13:57.711-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50239 #5 (3 connections now open) 2015-03-02T13:13:57.754-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:13:57.951-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 202ms 2015-03-02T13:13:58.505-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:13:58.523-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:13:58.538-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 784ms 2015-03-02T13:13:58.563-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:13:59.225-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (53299 records 547900354 bytes) are inconsistent with full validation results (54299 records 558173354 bytes). Updating counters with new values. 2015-03-02T13:13:59.225-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (53299 records 547900354 bytes) is inconsistent with full validation results (54299 records 558173354 bytes). Updating size storer with new values. 2015-03-02T13:13:59.225-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:13:59.242-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:13:59.251-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 687ms 2015-03-02T13:13:59.273-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:13:59.901-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:13:59.922-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:13:59.931-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 658ms 2015-03-02T13:14:00.603-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 202ms 2015-03-02T13:14:02.278-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8384.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:62715 nscannedObjects:62715 nMatched:28459 nModified:28459 keyUpdates:1 writeConflicts:0 numYields:532 locks:{} 4871ms 2015-03-02T13:14:02.278-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8384.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4872ms 2015-03-02T13:14:02.285-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:14:03.133-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:14:03.149-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:14:03.179-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 894ms 2015-03-02T13:14:03.212-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:14:03.257-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:14:03.680-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (56299 records 578761604 bytes) are inconsistent with full validation results (55968 records 575361241 bytes). Updating counters with new values. 2015-03-02T13:14:03.681-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (56299 records 578761604 bytes) is inconsistent with full validation results (55968 records 575361241 bytes). Updating size storer with new values. 2015-03-02T13:14:03.681-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:14:03.703-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:14:03.715-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 503ms 2015-03-02T13:14:04.347-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50241 #6 (4 connections now open) 2015-03-02T13:14:05.993-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 5134.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:64445 nscannedObjects:64445 nMatched:31709 nModified:31709 keyUpdates:1 writeConflicts:0 numYields:567 locks:{} 6053ms 2015-03-02T13:14:05.994-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5134.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6054ms 2015-03-02T13:14:05.997-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:06.579-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (44299 records 455333907 bytes) are inconsistent with full validation results (49630 records 510164270 bytes). Updating counters with new values. 2015-03-02T13:14:06.579-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (45181 records 464406159 bytes) is inconsistent with full validation results (49630 records 510164270 bytes). Updating size storer with new values. 2015-03-02T13:14:06.579-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:06.611-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:06.626-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 628ms 2015-03-02T13:14:06.646-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:06.945-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (45940 records 472208930 bytes) are inconsistent with full validation results (44045 records 452716960 bytes). Updating counters with new values. 2015-03-02T13:14:06.945-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (46512 records 478092522 bytes) is inconsistent with full validation results (44045 records 452716960 bytes). Updating size storer with new values. 2015-03-02T13:14:06.945-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:06.964-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:06.972-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 325ms 2015-03-02T13:14:07.001-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:07.212-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 232ms 2015-03-02T13:14:07.481-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (41656 records 428130706 bytes) are inconsistent with full validation results (40537 records 416633490 bytes). Updating counters with new values. 2015-03-02T13:14:07.481-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (42151 records 433222276 bytes) is inconsistent with full validation results (40537 records 416633490 bytes). Updating size storer with new values. 2015-03-02T13:14:07.481-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:07.499-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:07.504-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 502ms 2015-03-02T13:14:07.532-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:07.802-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (38874 records 399527872 bytes) are inconsistent with full validation results (38113 records 391687408 bytes). Updating counters with new values. 2015-03-02T13:14:07.802-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (39112 records 401975940 bytes) is inconsistent with full validation results (38113 records 391687408 bytes). Updating size storer with new values. 2015-03-02T13:14:07.802-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:07.818-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:07.824-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 291ms 2015-03-02T13:14:09.250-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7041.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:40360 nscannedObjects:40360 nMatched:17157 nModified:17157 keyUpdates:1 writeConflicts:12226 numYields:402 locks:{} 5531ms 2015-03-02T13:14:09.250-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7041.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5531ms 2015-03-02T13:14:09.256-0500 I NETWORK [conn3] end connection 10.4.127.218:50236 (3 connections now open) 2015-03-02T13:14:10.041-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 9523.0 } } ndeleted:15236 keyUpdates:0 writeConflicts:68 numYields:324 locks:{} 5664ms 2015-03-02T13:14:10.041-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9523.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 5664ms 2015-03-02T13:14:10.042-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1448.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22443 nscannedObjects:22443 nMatched:13486 nModified:13486 keyUpdates:1 writeConflicts:151 numYields:195 locks:{} 2208ms 2015-03-02T13:14:10.042-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1448.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2208ms 2015-03-02T13:14:10.044-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:14:10.047-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:10.252-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (22210 records 228294708 bytes) are inconsistent with full validation results (20985 records 215694358 bytes). Updating counters with new values. 2015-03-02T13:14:10.252-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (22863 records 235001226 bytes) is inconsistent with full validation results (20985 records 215694358 bytes). Updating size storer with new values. 2015-03-02T13:14:10.252-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:14:10.254-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:10.267-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:14:10.271-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:10.275-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 227ms 2015-03-02T13:14:10.280-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 235ms 2015-03-02T13:14:10.282-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:10.293-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:14:10.388-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:10.390-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:14:10.396-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:10.398-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 115ms 2015-03-02T13:14:10.400-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:14:10.401-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 108ms 2015-03-02T13:14:10.408-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:10.424-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:14:10.553-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:10.568-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:10.570-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 162ms 2015-03-02T13:14:10.574-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:14:10.578-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:14:10.590-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 165ms 2015-03-02T13:14:10.593-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:10.700-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:14:10.705-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:14:10.709-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 116ms 2015-03-02T13:14:10.859-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T13:14:11.933-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 3221.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20142 nscannedObjects:20142 nMatched:9881 nModified:9881 keyUpdates:1 writeConflicts:0 numYields:164 locks:{} 1335ms 2015-03-02T13:14:11.933-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3221.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1335ms 2015-03-02T13:14:11.935-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:14:12.131-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:14:12.136-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:14:12.152-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 216ms 2015-03-02T13:14:12.475-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 5533.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16087 nscannedObjects:16087 nMatched:6849 nModified:6849 keyUpdates:1 writeConflicts:8349 numYields:151 locks:{} 1756ms 2015-03-02T13:14:12.475-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5533.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1756ms 2015-03-02T13:14:12.482-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:14:12.645-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (16810 records 172750308 bytes) are inconsistent with full validation results (18215 records 187202138 bytes). Updating counters with new values. 2015-03-02T13:14:12.645-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17368 records 178489896 bytes) is inconsistent with full validation results (18215 records 187202138 bytes). Updating size storer with new values. 2015-03-02T13:14:12.647-0500 I INDEX 2015-03-02T13:14:42.977-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:14:43.004-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:14:43.004-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:14:43.004-0500 I CONTROL [initandlisten] 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:14:43.012-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:14:43.017-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:14:43.110-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:14:43.110-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:14:43.110-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:14:43.214-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:14:47.774-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50257 #1 (1 connection now open) 2015-03-02T13:14:47.787-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:14:49.305-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50259 #2 (2 connections now open) 2015-03-02T13:14:49.534-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:14:49.541-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:14:49.545-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 235ms 2015-03-02T13:14:49.545-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1757ms 2015-03-02T13:14:49.560-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:14:49.710-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383332479 bytes) are inconsistent with full validation results (37299 records 383318400 bytes). Updating counters with new values. 2015-03-02T13:14:49.713-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329892 bytes) is inconsistent with full validation results (37299 records 383318400 bytes). Updating size storer with new values. 2015-03-02T13:14:49.713-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:14:49.722-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:14:49.724-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T13:14:51.795-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2518.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:54798 nscannedObjects:54798 nMatched:27399 nModified:27399 keyUpdates:1 writeConflicts:0 numYields:432 locks:{} 2244ms 2015-03-02T13:14:51.795-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2518.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2244ms 2015-03-02T13:14:51.798-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:14:51.877-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383503741 bytes) are inconsistent with full validation results (37299 records 383518574 bytes). Updating counters with new values. 2015-03-02T13:14:51.877-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383503741 bytes) is inconsistent with full validation results (37299 records 383518574 bytes). Updating size storer with new values. 2015-03-02T13:14:51.878-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:14:51.882-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:14:52.712-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50260 #3 (3 connections now open) 2015-03-02T13:14:53.290-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:14:54.450-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9202.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:54798 nscannedObjects:54798 nMatched:27399 nModified:27399 keyUpdates:1 writeConflicts:0 numYields:435 locks:{} 2554ms 2015-03-02T13:14:54.450-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9202.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2555ms 2015-03-02T13:14:54.452-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:14:54.641-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:14:54.859-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (40299 records 414337574 bytes) are inconsistent with full validation results (39299 records 404064574 bytes). Updating counters with new values. 2015-03-02T13:14:54.859-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39502 records 406149993 bytes) is inconsistent with full validation results (39299 records 404064574 bytes). Updating size storer with new values. 2015-03-02T13:14:54.860-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:14:54.868-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:14:54.886-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 434ms 2015-03-02T13:14:54.907-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:14:55.058-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (39299 records 404064574 bytes) are inconsistent with full validation results (40299 records 414337574 bytes). Updating counters with new values. 2015-03-02T13:14:55.058-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (39299 records 404064574 bytes) is inconsistent with full validation results (40299 records 414337574 bytes). Updating size storer with new values. 2015-03-02T13:14:55.059-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:14:55.063-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:14:55.066-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T13:14:55.076-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:14:55.240-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:14:55.245-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:14:55.249-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 172ms 2015-03-02T13:14:55.257-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:14:55.388-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:14:55.392-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:14:55.395-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 138ms 2015-03-02T13:14:56.256-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T13:14:56.784-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 8108.0 } } ndeleted:27399 keyUpdates:0 writeConflicts:0 numYields:216 locks:{} 1386ms 2015-03-02T13:14:56.784-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8108.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1386ms 2015-03-02T13:14:56.786-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:14:56.921-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (15096 records 155073516 bytes) is inconsistent with full validation results (14900 records 153067700 bytes). Updating size storer with new values. 2015-03-02T13:14:56.922-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:14:56.928-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:14:56.930-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 144ms 2015-03-02T13:14:57.243-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2060.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5712 nscannedObjects:5712 nMatched:2856 nModified:2856 keyUpdates:1 writeConflicts:0 numYields:47 locks:{} 304ms 2015-03-02T13:14:57.243-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2060.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 304ms 2015-03-02T13:14:57.244-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:14:57.273-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (14900 records 153104152 bytes) is inconsistent with full validation results (14900 records 153104828 bytes). Updating size storer with new values. 2015-03-02T13:14:57.274-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:14:57.276-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:14:57.669-0500 I NETWORK [conn3] end connection 10.4.127.218:50260 (2 connections now open) 2015-03-02T13:14:57.721-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50261 #4 (3 connections now open) 2015-03-02T13:14:57.729-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:14:57.784-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16848 records 173116632 bytes) is inconsistent with full validation results (16900 records 173650828 bytes). Updating size storer with new values. 2015-03-02T13:14:57.784-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:14:57.789-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:14:57.796-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:14:57.876-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:14:57.880-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:14:57.901-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:14:57.939-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:14:57.942-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:15:00.532-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T13:15:00.575-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:15:00.920-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:15:01.953-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:15:03.144-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:15:03.404-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26848 records 275846632 bytes) is inconsistent with full validation results (26900 records 276380828 bytes). Updating size storer with new values. 2015-03-02T13:15:03.404-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:15:03.408-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:15:03.410-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 265ms 2015-03-02T13:15:04.297-0500 I NETWORK [conn2] end connection 10.4.127.218:50259 (2 connections now open) 2015-03-02T13:15:04.325-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50263 #5 (3 connections now open) 2015-03-02T13:15:04.564-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:15:05.817-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1376.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29560 nscannedObjects:29560 nMatched:14780 nModified:14780 keyUpdates:1 writeConflicts:0 numYields:241 locks:{} 1479ms 2015-03-02T13:15:05.818-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1376.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1480ms 2015-03-02T13:15:05.824-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:15:06.043-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T13:15:06.052-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 157ms 2015-03-02T13:15:06.064-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (30900 records 317627840 bytes) are inconsistent with full validation results (28900 records 297081840 bytes). Updating counters with new values. 2015-03-02T13:15:06.064-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (30068 records 309080704 bytes) is inconsistent with full validation results (28900 records 297081840 bytes). Updating size storer with new values. 2015-03-02T13:15:06.064-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:15:06.071-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:15:06.098-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 273ms 2015-03-02T13:15:06.126-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:15:06.246-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (28900 records 297081840 bytes) are inconsistent with full validation results (30900 records 317627840 bytes). Updating counters with new values. 2015-03-02T13:15:06.246-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (28900 records 297081840 bytes) is inconsistent with full validation results (30900 records 317627840 bytes). Updating size storer with new values. 2015-03-02T13:15:06.247-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:15:06.252-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:15:06.254-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 128ms 2015-03-02T13:15:07.479-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:15:07.997-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 3091.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31378 nscannedObjects:31378 nMatched:15689 nModified:15689 keyUpdates:1 writeConflicts:0 numYields:256 locks:{} 1740ms 2015-03-02T13:15:07.997-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3091.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1740ms 2015-03-02T13:15:08.001-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:15:08.018-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T13:15:08.191-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (32900 records 338185657 bytes) are inconsistent with full validation results (32682 records 335946143 bytes). Updating counters with new values. 2015-03-02T13:15:08.191-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (32379 records 332833424 bytes) is inconsistent with full validation results (32682 records 335946143 bytes). Updating size storer with new values. 2015-03-02T13:15:08.191-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:15:08.199-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:15:08.211-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 210ms 2015-03-02T13:15:14.823-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 196ms 2015-03-02T13:15:15.053-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:15:15.466-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:152015-03-02T13:15:49.394-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:15:49.409-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:15:49.409-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:15:49.409-0500 I CONTROL [initandlisten] 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:15:49.410-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:15:49.420-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:15:49.474-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:15:49.474-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:15:49.474-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:15:49.577-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:15:56.306-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50276 #1 (1 connection now open) 2015-03-02T13:15:56.318-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:15:57.792-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50277 #2 (2 connections now open) 2015-03-02T13:15:57.875-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50278 #3 (3 connections now open) 2015-03-02T13:15:58.035-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:15:58.043-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:15:58.047-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 168ms 2015-03-02T13:15:58.047-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 250ms 2015-03-02T13:15:58.048-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1729ms 2015-03-02T13:15:58.055-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:15:58.056-0500 I NETWORK [conn1] end connection 10.4.127.218:50276 (2 connections now open) 2015-03-02T13:15:58.143-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:15:58.148-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:15:58.158-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:15:58.273-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:15:58.278-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:15:58.280-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T13:15:58.631-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 8345.0 } } ndeleted:14458 keyUpdates:0 writeConflicts:0 numYields:112 locks:{} 346ms 2015-03-02T13:15:58.631-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8345.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 346ms 2015-03-02T13:15:58.635-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:15:58.728-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23298 records 239336055 bytes) is inconsistent with full validation results (22841 records 234645593 bytes). Updating size storer with new values. 2015-03-02T13:15:58.729-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:15:58.733-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:15:58.737-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 102ms 2015-03-02T13:15:59.025-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 5034.0 } } ndeleted:6875 keyUpdates:0 writeConflicts:0 numYields:53 locks:{} 286ms 2015-03-02T13:15:59.026-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5034.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 286ms 2015-03-02T13:15:59.027-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:15:59.064-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (16298 records 167429354 bytes) is inconsistent with full validation results (15966 records 164018718 bytes). Updating size storer with new values. 2015-03-02T13:15:59.064-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:15:59.067-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:15:59.074-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:15:59.107-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:15:59.109-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:15:59.386-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50279 #4 (3 connections now open) 2015-03-02T13:15:59.393-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:15:59.437-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:15:59.440-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:15:59.949-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 323.0 } } ndeleted:14028 keyUpdates:0 writeConflicts:0 numYields:110 locks:{} 503ms 2015-03-02T13:15:59.949-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 323.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 503ms 2015-03-02T13:15:59.954-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:15:59.986-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (2298 records 23607354 bytes) is inconsistent with full validation results (1938 records 19909074 bytes). Updating size storer with new values. 2015-03-02T13:15:59.986-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:15:59.990-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:15:59.997-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:16:00.001-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (1938 records 19909074 bytes) is inconsistent with full validation results (1939 records 19909120 bytes). Updating size storer with new values. 2015-03-02T13:16:00.001-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:16:00.002-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:16:00.004-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:16:00.008-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:16:00.009-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:16:00.011-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:16:00.016-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:16:00.016-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:16:00.020-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:16:00.024-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (1939 records 19909120 bytes) is inconsistent with full validation results (1938 records 19909074 bytes). Updating size storer with new values. 2015-03-02T13:16:00.024-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:16:00.025-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:16:02.056-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:16:04.365-0500 I NETWORK [conn4] end connection 10.4.127.218:50279 (2 connections now open) 2015-03-02T13:16:04.392-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50280 #5 (3 connections now open) 2015-03-02T13:16:04.406-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:04.500-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (9576 records 98374248 bytes) is inconsistent with full validation results (9939 records 102093120 bytes). Updating size storer with new values. 2015-03-02T13:16:04.501-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:04.503-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:04.507-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:04.527-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:04.528-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:06.307-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T13:16:13.721-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:16:14.274-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (30682 records 315185959 bytes) are inconsistent with full validation results (28939 records 297280120 bytes). Updating counters with new values. 2015-03-02T13:16:14.274-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (30575 records 314086748 bytes) is inconsistent with full validation results (28939 records 297280120 bytes). Updating size storer with new values. 2015-03-02T13:16:14.274-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:16:14.283-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:16:14.285-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 563ms 2015-03-02T13:16:14.295-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:16:14.641-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7638.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6173 nscannedObjects:6173 nMatched:3087 nModified:3087 keyUpdates:1 writeConflicts:0 numYields:50 locks:{} 351ms 2015-03-02T13:16:14.641-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7638.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 351ms 2015-03-02T13:16:14.643-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:16:14.803-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (29196 records 299960399 bytes) are inconsistent with full validation results (30939 records 317866238 bytes). Updating counters with new values. 2015-03-02T13:16:14.803-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (29196 records 299954549 bytes) is inconsistent with full validation results (30939 records 317866238 bytes). Updating size storer with new values. 2015-03-02T13:16:14.803-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:16:14.806-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:16:14.808-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T13:16:14.811-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:16:14.946-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:16:14.953-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:16:14.964-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T13:16:15.452-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:16:16.159-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:16:16.605-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 609.0 } } ndeleted:28565 keyUpdates:0 writeConflicts:0 numYields:227 locks:{} 1635ms 2015-03-02T13:16:16.605-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 609.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1635ms 2015-03-02T13:16:16.607-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:16:16.742-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (4578 records 47029794 bytes) are inconsistent with full validation results (4374 records 44934102 bytes). Updating counters with new values. 2015-03-02T13:16:16.742-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4390 records 45088438 bytes) is inconsistent with full validation results (4374 records 44934102 bytes). Updating size storer with new values. 2015-03-02T13:16:16.748-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:16:16.764-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:16:16.777-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 169ms 2015-03-02T13:16:16.797-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:16.823-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (4591 records 47163343 bytes) are inconsistent with full validation results (5095 records 52340935 bytes). Updating counters with new values. 2015-03-02T13:16:16.823-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (4934 records 50686982 bytes) is inconsistent with full validation results (5095 records 52340935 bytes). Updating size storer with new values. 2015-03-02T13:16:16.823-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:16.824-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:16.838-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:16.859-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:16:16.861-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (4674 records 48016002 bytes) are inconsistent with full validation results (4562 records 46865426 bytes). Updating counters with new values. 2015-03-02T13:16:16.862-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (4690 records 48180370 bytes) is inconsistent with full validation results (4562 records 46865426 bytes). Updating size storer with new values. 2015-03-02T13:16:16.862-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:16.862-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:16.872-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:16.883-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (4562 records 46865426 bytes) are inconsistent with full validation results (4374 records 44934102 bytes). Updating counters with new values. 2015-03-02T13:16:16.883-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4562 records 46865426 bytes) is inconsistent with full validation results (4374 records 44934102 bytes). Updating size storer with new values. 2015-03-02T13:16:16.883-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:16:16.884-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:16:16.896-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:16:16.901-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:16.902-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:16.913-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:16.921-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:16:16.922-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:16:16.933-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:16.934-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:16.938-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:16.949-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:16.949-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:16.953-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:16.966-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:16.967-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:16.975-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:16.993-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (4374 records 44934102 bytes) is inconsistent with full validation results (4375 records 44934148 bytes). Updating size storer with new values. 2015-03-02T13:16:16.994-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:16.994-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:17.001-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:17.011-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:17.012-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:17.016-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:17.027-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (4375 records 44934148 bytes) is inconsistent with full validation results (4374 records 44934102 bytes). Updating size storer with new values. 2015-03-02T13:16:17.027-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:17.028-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:17.034-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:17.065-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (4374 records 44934102 bytes) is inconsistent with full validation results (4375 records 44934148 bytes). Updating size storer with new values. 2015-03-02T13:16:17.065-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:17.066-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:17.072-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:16:17.083-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:16:17.084-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:16:17.673-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:17.707-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (5355 records 55001688 bytes) is inconsistent with full validation results (5375 records 55207148 bytes). Updating size storer with new values. 2015-03-02T13:16:17.707-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:17.708-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:17.711-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:17.726-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:17.727-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:17.730-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:17.744-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:17.745-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:17.838-0500 I NETWORK [conn3] end connection 10.4.127.218:50278 (2 connections now open) 2015-03-02T13:16:17.881-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50282 #6 (3 connections now open) 2015-03-02T13:16:17.895-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2698.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2002 nscannedObjects:2002 nMatched:1001 nModified:1001 keyUpdates:1 writeConflicts:0 numYields:17 locks:{} 146ms 2015-03-02T13:16:17.895-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2698.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 147ms 2015-03-02T13:16:17.897-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:17.899-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:17.920-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (5375 records 55219888 bytes) is inconsistent with full validation results (5375 records 55220148 bytes). Updating size storer with new values. 2015-03-02T13:16:17.920-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:17.922-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:17.923-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:17.924-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:18.032-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1122.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2398 nscannedObjects:2398 nMatched:1001 nModified:1001 keyUpdates:1 writeConflicts:13 numYields:18 locks:{} 103ms 2015-03-02T13:16:18.032-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1122.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 103ms 2015-03-02T13:16:18.038-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:18.058-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6806.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2002 nscannedObjects:2002 nMatched:1001 nModified:1001 keyUpdates:1 writeConflicts:23 numYields:17 locks:{} 128ms 2015-03-02T13:16:18.058-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6806.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 128ms 2015-03-02T13:16:18.065-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:18.068-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:18.069-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:18.079-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:18.089-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:18.090-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:18.099-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:18.099-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:18.105-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:18.127-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:18.127-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:18.238-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 7332.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2330 nscannedObjects:2330 nMatched:1001 nModified:1001 keyUpdates:1 writeConflicts:9 numYields:18 locks:{} 142ms 2015-03-02T13:16:18.238-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7332.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 142ms 2015-03-02T13:16:18.247-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:18.279-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:18.280-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:18.287-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4534.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2002 nscannedObjects:2002 nMatched:1001 nModified:1001 keyUpdates:1 writeConflicts:13 numYields:17 locks:{} 154ms 2015-03-02T13:16:18.288-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4534.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 154ms 2015-03-02T13:16:18.289-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:18.291-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:16:18.305-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:18.310-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:18.309-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:16:18.312-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:16:18.315-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:18.325-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:18.326-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:18.358-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:18.368-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (4400 records 45191298 bytes) is inconsistent with full validation results (4374 records 44934102 bytes). Updating size storer with new values. 2015-03-02T13:16:18.369-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:18.369-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:18.372-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:18.381-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:18.382-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:18.385-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:16:18.393-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:16:18.394-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:16:19.565-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:16:22.408-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:16:22.964-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T13:16:22.968-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:16:54.294-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:16:54.310-0500 I CONTROL [initandlisten] MongoDB starting : pid=1274 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:16:54.311-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:16:54.311-0500 I CONTROL [initandlisten] 2015-03-02T13:16:54.311-0500 I CONTROL [initandlisten] 2015-03-02T13:16:54.311-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:16:54.311-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:16:54.311-0500 I CONTROL [initandlisten] 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:16:54.312-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:16:54.319-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:16:54.394-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:16:54.394-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:16:54.394-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:16:54.477-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:16:57.796-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50289 #1 (1 connection now open) 2015-03-02T13:16:57.808-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:16:59.560-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:16:59.567-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:16:59.570-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1762ms 2015-03-02T13:16:59.576-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:16:59.638-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:16:59.643-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:16:59.652-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:16:59.733-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:16:59.738-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:16:59.747-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:16:59.810-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:16:59.814-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:00.507-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50290 #2 (2 connections now open) 2015-03-02T13:17:01.390-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50292 #3 (3 connections now open) 2015-03-02T13:17:02.978-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2662.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:62526 nscannedObjects:62526 nMatched:27111 nModified:27111 keyUpdates:1 writeConflicts:170 numYields:498 locks:{} 3158ms 2015-03-02T13:17:02.978-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2662.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3158ms 2015-03-02T13:17:02.981-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:03.336-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:03.352-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:03.380-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 398ms 2015-03-02T13:17:04.398-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50293 #4 (4 connections now open) 2015-03-02T13:17:05.742-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4210.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53446 nscannedObjects:53446 nMatched:22995 nModified:22995 keyUpdates:1 writeConflicts:6348 numYields:501 locks:{} 5219ms 2015-03-02T13:17:05.742-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4210.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5220ms 2015-03-02T13:17:05.754-0500 I NETWORK [conn2] end connection 10.4.127.218:50290 (3 connections now open) 2015-03-02T13:17:06.245-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7078.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53363 nscannedObjects:53363 nMatched:25334 nModified:25334 keyUpdates:1 writeConflicts:4577 numYields:475 locks:{} 4839ms 2015-03-02T13:17:06.245-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7078.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4839ms 2015-03-02T13:17:06.249-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:17:06.384-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (17845 records 183454952 bytes) are inconsistent with full validation results (19681 records 202340048 bytes). Updating counters with new values. 2015-03-02T13:17:06.384-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (18738 records 192640350 bytes) is inconsistent with full validation results (19681 records 202340048 bytes). Updating size storer with new values. 2015-03-02T13:17:06.384-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:17:06.399-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:17:06.419-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 169ms 2015-03-02T13:17:06.848-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1154.0 } } ndeleted:18728 keyUpdates:0 writeConflicts:110 numYields:237 locks:{} 3464ms 2015-03-02T13:17:06.848-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1154.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3464ms 2015-03-02T13:17:06.855-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:06.914-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (8642 records 88803134 bytes) are inconsistent with full validation results (6806 records 69918038 bytes). Updating counters with new values. 2015-03-02T13:17:06.914-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9574 records 98379446 bytes) is inconsistent with full validation results (6806 records 69918038 bytes). Updating size storer with new values. 2015-03-02T13:17:06.914-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:06.922-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:06.933-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:06.963-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6806 records 69918038 bytes) is inconsistent with full validation results (6807 records 69918084 bytes). Updating size storer with new values. 2015-03-02T13:17:06.963-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:06.966-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:06.970-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:07.011-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:07.017-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:07.021-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:07.051-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:07.053-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:07.059-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:07.074-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:07.076-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:07.080-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:07.100-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (6807 records 69918084 bytes) is inconsistent with full validation results (6806 records 69918038 bytes). Updating size storer with new values. 2015-03-02T13:17:07.100-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:07.101-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:07.109-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:07.162-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:07.167-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:09.684-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T13:17:09.877-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:17:10.827-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T13:17:12.880-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:17:14.743-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T13:17:14.887-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:17:15.496-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T13:17:16.291-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:17:16.529-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:17:16.700-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:17.321-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (31872 records 327421056 bytes) is inconsistent with full validation results (32806 records 337016038 bytes). Updating size storer with new values. 2015-03-02T13:17:17.322-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:17.326-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:17.329-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 629ms 2015-03-02T13:17:17.343-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:17.495-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:17.504-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:17.510-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 166ms 2015-03-02T13:17:17.537-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:17.633-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33057 records 339594561 bytes) are inconsistent with full validation results (32806 records 337016038 bytes). Updating counters with new values. 2015-03-02T13:17:17.634-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32872 records 337694056 bytes) is inconsistent with full validation results (32806 records 337016038 bytes). Updating size storer with new values. 2015-03-02T13:17:17.634-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:17.648-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:17.654-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 116ms 2015-03-02T13:17:17.664-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:17.749-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T13:17:17.851-0500 I NETWORK [conn3] end connection 10.4.127.218:50292 (2 connections now open) 2015-03-02T13:17:17.878-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33555 records 344710515 bytes) are inconsistent with full validation results (33212 records 341186876 bytes). Updating counters with new values. 2015-03-02T13:17:17.878-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (32806 records 337016038 bytes) is inconsistent with full validation results (33212 records 341186876 bytes). Updating size storer with new values. 2015-03-02T13:17:17.878-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:17.887-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:17.888-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50294 #5 (3 connections now open) 2015-03-02T13:17:17.892-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 228ms 2015-03-02T13:17:17.913-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:18.066-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33212 records 341201371 bytes) are inconsistent with full validation results (33806 records 347289415 bytes). Updating counters with new values. 2015-03-02T13:17:18.066-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (33212 records 341200734 bytes) is inconsistent with full validation results (33806 records 347289415 bytes). Updating size storer with new values. 2015-03-02T13:17:18.066-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:18.075-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:18.080-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 166ms 2015-03-02T13:17:18.255-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 8362.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4552 nscannedObjects:4552 nMatched:2276 nModified:2276 keyUpdates:1 writeConflicts:0 numYields:37 locks:{} 353ms 2015-03-02T13:17:18.255-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8362.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 353ms 2015-03-02T13:17:18.259-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:17:18.423-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (30697 records 315365751 bytes) are inconsistent with full validation results (32519 records 334097275 bytes). Updating counters with new values. 2015-03-02T13:17:18.423-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (31016 records 318642838 bytes) is inconsistent with full validation results (32519 records 334097275 bytes). Updating size storer with new values. 2015-03-02T13:17:18.425-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:17:18.440-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:17:18.456-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 197ms 2015-03-02T13:17:19.116-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2769.0 } } ndeleted:18693 keyUpdates:0 writeConflicts:0 numYields:147 locks:{} 1025ms 2015-03-02T13:17:19.116-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2769.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1025ms 2015-03-02T13:17:19.118-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.213-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16935 records 173973255 bytes) are inconsistent with full validation results (15113 records 155255849 bytes). Updating counters with new values. 2015-03-02T13:17:19.213-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17838 records 183261513 bytes) is inconsistent with full validation results (15113 records 155255849 bytes). Updating size storer with new values. 2015-03-02T13:17:19.213-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.232-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.241-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 122ms 2015-03-02T13:17:19.249-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.319-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (15113 records 155255849 bytes) is inconsistent with full validation results (15114 records 155255895 bytes). Updating size storer with new values. 2015-03-02T13:17:19.319-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.325-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.330-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.414-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.416-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.426-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.458-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (15114 records 155255895 bytes) is inconsistent with full validation results (15113 records 155255849 bytes). Updating size storer with new values. 2015-03-02T13:17:19.458-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.460-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.473-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.543-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.549-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.557-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.587-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.589-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.597-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.661-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.663-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.680-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.717-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.720-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.725-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.765-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.767-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:19.771-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:19.802-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:19.804-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:20.031-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:17:20.036-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:17:20.099-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16113 records 165565990 bytes) are inconsistent with full validation results (16113 records 165559360 bytes). Updating counters with new values. 2015-03-02T13:17:20.099-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16023 records 164632684 bytes) is inconsistent with full validation results (16113 records 165559360 bytes). Updating size storer with new values. 2015-03-02T13:17:20.099-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:17:20.104-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:17:20.284-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1473.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9776 nscannedObjects:9776 nMatched:4888 nModified:4888 keyUpdates:1 writeConflicts:0 numYields:77 locks:{} 455ms 2015-03-02T13:17:20.284-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1473.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 455ms 2015-03-02T13:17:20.292-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:20.382-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16506 records 169623052 bytes) are inconsistent with full validation results (16113 records 165592393 bytes). Updating counters with new values. 2015-03-02T13:17:20.382-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16320 records 167712274 bytes) is inconsistent with full validation results (16113 records 165592393 bytes). Updating size storer with new values. 2015-03-02T13:17:20.382-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:20.392-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:20.399-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 107ms 2015-03-02T13:17:20.407-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:20.444-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T13:17:20.475-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16720 records 171828104 bytes) are inconsistent with full validation results (16778 records 172423938 bytes). Updating counters with new values. 2015-03-02T13:17:20.475-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16113 records 165592393 bytes) is inconsistent with full validation results (16778 records 172423938 bytes). Updating size storer with new values. 2015-03-02T13:17:20.475-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:20.482-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:21.118-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2977.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9776 nscannedObjects:9776 nMatched:4888 nModified:4888 keyUpdates:1 writeConflicts:0 numYields:81 locks:{} 626ms 2015-03-02T13:17:21.119-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2977.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 626ms 2015-03-02T13:17:21.123-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:21.192-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16778 records 172423938 bytes) are inconsistent with full validation results (17113 records 175865393 bytes). Updating counters with new values. 2015-03-02T13:17:21.192-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16778 records 172423938 bytes) is inconsistent with full validation results (17113 records 175865393 bytes). Updating size storer with new values. 2015-03-02T13:17:21.192-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:21.202-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:21.574-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:17:21.584-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4773.0 } } ndeleted:4888 keyUpdates:0 writeConflicts:0 numYields:38 locks:{} 355ms 2015-03-02T13:17:21.584-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4773.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 355ms 2015-03-02T13:17:21.589-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:21.741-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (14108 records 144934422 bytes) is inconsistent with full validation results (14225 records 146133425 bytes). Updating size storer with new values. 2015-03-02T13:17:21.742-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:21.750-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:21.757-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 167ms 2015-03-02T13:17:21.771-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:21.822-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:21.824-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:21.830-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:21.868-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:21.871-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:21.886-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:21.965-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:21.971-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:22.741-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:17:23.343-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:17:23.536-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:17:24.623-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T13:17:25.082-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:17:25.287-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:17:25.690-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:17:26.324-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:17:27.432-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T13:17:27.604-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T13:17:27.813-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50295 #6 (4 connections now open) 2015-03-02T13:17:27.828-0500 I NETWORK [conn1] end connection 10.4.127.218:50289 (3 connections now open) 2015-03-02T13:17:27.833-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:17:27.839-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:17:28.288-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (29656 records 304656088 bytes) is inconsistent with full validation results (30225 records 310501425 bytes). Updating size storer with new values. 2015-03-02T13:17:28.288-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:17:28.2992015-03-02T13:17:55.494-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:17:55.507-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:17:55.507-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:17:55.507-0500 I CONTROL [initandlisten] 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:17:55.509-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:17:55.513-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:17:55.513-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:17:55.514-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:17:55.517-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:17:55.590-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:17:55.590-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:17:55.590-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:17:55.684-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:17:57.822-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50301 #1 (1 connection now open) 2015-03-02T13:17:57.833-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:59.556-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:59.562-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:17:59.565-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1731ms 2015-03-02T13:17:59.574-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:17:59.648-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:17:59.654-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:00.756-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7632.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31768 nscannedObjects:31768 nMatched:15884 nModified:15884 keyUpdates:1 writeConflicts:0 numYields:248 locks:{} 1094ms 2015-03-02T13:18:00.756-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7632.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1094ms 2015-03-02T13:18:00.759-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:00.827-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:00.832-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:00.847-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:00.923-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:00.927-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:02.907-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50302 #2 (2 connections now open) 2015-03-02T13:18:02.941-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50303 #3 (3 connections now open) 2015-03-02T13:18:02.972-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:18:03.062-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:18:03.313-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41299 records 424460879 bytes) are inconsistent with full validation results (40342 records 414629618 bytes). Updating counters with new values. 2015-03-02T13:18:03.313-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40416 records 415389820 bytes) is inconsistent with full validation results (40342 records 414629618 bytes). Updating size storer with new values. 2015-03-02T13:18:03.313-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:18:03.326-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:18:03.334-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 362ms 2015-03-02T13:18:03.355-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:18:03.552-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (40342 records 414629618 bytes) are inconsistent with full validation results (41299 records 424460879 bytes). Updating counters with new values. 2015-03-02T13:18:03.552-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40342 records 414629618 bytes) is inconsistent with full validation results (41299 records 424460879 bytes). Updating size storer with new values. 2015-03-02T13:18:03.557-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:18:03.569-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:18:03.575-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 219ms 2015-03-02T13:18:03.595-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:18:03.829-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:18:03.847-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:18:03.857-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 261ms 2015-03-02T13:18:04.226-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 188ms 2015-03-02T13:18:04.228-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T13:18:04.430-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50304 #4 (4 connections now open) 2015-03-02T13:18:05.731-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 256ms 2015-03-02T13:18:05.742-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 266ms 2015-03-02T13:18:05.881-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 8435.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13106 nscannedObjects:13106 nMatched:6552 nModified:6552 keyUpdates:1 writeConflicts:71 numYields:120 locks:{} 1430ms 2015-03-02T13:18:05.882-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8435.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1431ms 2015-03-02T13:18:05.888-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:18:06.073-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 6020.0 } } ndeleted:3558 keyUpdates:0 writeConflicts:62 numYields:148 locks:{} 2210ms 2015-03-02T13:18:06.074-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6020.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2210ms 2015-03-02T13:18:06.075-0500 I NETWORK [conn3] end connection 10.4.127.218:50303 (3 connections now open) 2015-03-02T13:18:06.202-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (26191 records 269060143 bytes) are inconsistent with full validation results (27973 records 287379555 bytes). Updating counters with new values. 2015-03-02T13:18:06.203-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26738 records 274676345 bytes) is inconsistent with full validation results (27973 records 287379555 bytes). Updating size storer with new values. 2015-03-02T13:18:06.203-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:18:06.220-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:18:06.229-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 340ms 2015-03-02T13:18:06.238-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:18:06.346-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (27973 records 287379555 bytes) are inconsistent with full validation results (26191 records 269060143 bytes). Updating counters with new values. 2015-03-02T13:18:06.346-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (27973 records 287379555 bytes) is inconsistent with full validation results (26191 records 269060143 bytes). Updating size storer with new values. 2015-03-02T13:18:06.346-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:18:06.350-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:18:06.358-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 120ms 2015-03-02T13:18:06.363-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:18:06.451-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26191 records 269060143 bytes) is inconsistent with full validation results (26192 records 269060189 bytes). Updating size storer with new values. 2015-03-02T13:18:06.452-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:18:06.458-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:18:07.733-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:18:07.740-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:18:08.641-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T13:18:08.696-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T13:18:09.358-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T13:18:09.724-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:10.059-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34644 records 355887585 bytes) is inconsistent with full validation results (35192 records 361517189 bytes). Updating size storer with new values. 2015-03-02T13:18:10.060-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:10.065-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:10.068-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 344ms 2015-03-02T13:18:10.071-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:10.138-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:10.143-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:10.810-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T13:18:10.937-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:18:12.572-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 151ms 2015-03-02T13:18:12.655-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:18:12.675-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:18:14.290-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 155ms 2015-03-02T13:18:14.294-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:18:14.350-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T13:18:14.743-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (47192 records 484793189 bytes) are inconsistent with full validation results (46732 records 480067609 bytes). Updating counters with new values. 2015-03-02T13:18:14.743-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (46644 records 479163585 bytes) is inconsistent with full validation results (46732 records 480067609 bytes). Updating size storer with new values. 2015-03-02T13:18:14.744-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:18:14.768-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:18:14.776-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 482ms 2015-03-02T13:18:14.794-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:18:14.988-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (46732 records 480067609 bytes) are inconsistent with full validation results (47192 records 484793189 bytes). Updating counters with new values. 2015-03-02T13:18:14.988-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (46732 records 480067609 bytes) is inconsistent with full validation results (47192 records 484793189 bytes). Updating size storer with new values. 2015-03-02T13:18:14.988-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:18:14.999-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:18:15.008-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 214ms 2015-03-02T13:18:15.028-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:18:15.111-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:18:15.284-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (48192 records 495066189 bytes) are inconsistent with full validation results (47557 records 488542834 bytes). Updating counters with new values. 2015-03-02T13:18:15.284-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (47644 records 489436585 bytes) is inconsistent with full validation results (47557 records 488542834 bytes). Updating size storer with new values. 2015-03-02T13:18:15.284-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:18:15.293-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:18:15.305-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 276ms 2015-03-02T13:18:16.052-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:18:16.301-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6254.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:14986 nscannedObjects:14986 nMatched:7493 nModified:7493 keyUpdates:1 writeConflicts:0 numYields:124 locks:{} 991ms 2015-03-02T13:18:16.301-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6254.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 991ms 2015-03-02T13:18:16.303-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:18:16.558-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (48557 records 498913230 bytes) are inconsistent with full validation results (49192 records 505436585 bytes). Updating counters with new values. 2015-03-02T13:18:16.558-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (48557 records 498912710 bytes) is inconsistent with full validation results (49192 records 505436585 bytes). Updating size storer with new values. 2015-03-02T13:18:16.558-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:18:16.569-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:18:16.583-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 274ms 2015-03-02T13:18:16.591-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:18:16.808-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:18:16.818-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:18:16.827-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 235ms 2015-03-02T13:18:16.836-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:18:17.008-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T13:18:17.076-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T13:18:17.117-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (51192 records 525982585 bytes) are inconsistent with full validation results (49192 records 505436585 bytes). Updating counters with new values. 2015-03-02T13:18:17.117-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (51151 records 525561392 bytes) is inconsistent with full validation results (49192 records 505436585 bytes). Updating size storer with new values. 2015-03-02T13:18:17.117-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:18:17.134-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:18:17.142-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 306ms 2015-03-02T13:18:17.172-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:18:17.409-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (49192 records 505436585 bytes) are inconsistent with full validation results (51192 records 525982585 bytes). Updating counters with new values. 2015-03-02T13:18:17.409-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (49192 records 505436585 bytes) is inconsistent with full validation results (51192 records 525982585 bytes). Updating size storer with new values. 2015-03-02T13:18:17.409-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:18:17.422-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:18:17.430-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 258ms 2015-03-02T13:18:17.915-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50308 #5 (4 connections now open) 2015-03-02T13:18:17.922-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:18:17.937-0500 I NETWORK [conn2] end connection 10.4.127.218:50302 (3 connections now open) 2015-03-02T13:18:18.065-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:18:18.164-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (52192 records 536255585 bytes) are inconsistent with full validation results (51192 records 525982585 bytes). Updating counters with new values. 2015-03-02T13:18:18.164-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (52151 records 535834392 bytes) is inconsistent with full validation results (51192 records 525982585 bytes). Updating size storer with new values. 2015-03-02T13:18:18.164-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:18:18.180-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:18:18.198-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 276ms 2015-03-02T13:18:19.001-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 208ms 2015-03-02T13:18:19.099-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 173ms 2015-03-02T13:18:19.103-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:19.505-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (53192 records 546638747 bytes) are inconsistent with full validation results (54192 records 556875438 bytes). Updating counters with new values. 2015-03-02T13:18:19.505-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (53192 records 546632052 bytes) is inconsistent with full validation results (54192 records 556875438 bytes). Updating size storer with new values. 2015-03-02T13:18:19.505-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:19.525-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:19.540-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 436ms 2015-03-02T13:18:21.171-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4896.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:45156 nscannedObjects:45156 nMatched:18305 nModified:18305 keyUpdates:1 writeConflicts:0 numYields:372 locks:{} 2963ms 2015-03-02T13:18:21.172-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4896.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2964ms 2015-03-02T13:18:21.178-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:18:21.668-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 180ms 2015-03-02T13:18:22.082-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (55192 records 567178832 bytes) are inconsistent with full validation results (54192 records 556942141 bytes). Updating counters with new values. 2015-03-02T13:18:22.082-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (55192 records 567178832 bytes) is inconsistent with full validation results (54192 records 556942141 bytes). Updating size storer with new values. 2015-03-02T13:18:22.082-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:18:22.095-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:18:22.116-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 937ms 2015-03-02T13:18:22.639-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7210.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:40147 nscannedObjects:40147 nMatched:18305 nModified:18305 keyUpdates:1 writeConflicts:2056 numYields:342 locks:{} 3096ms 2015-03-02T13:18:22.643-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7210.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3099ms 2015-03-02T13:18:22.644-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:23.084-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (54192 records 556942141 bytes) are inconsistent with full validation results (55192 records 567215141 bytes). Updating counters with new values. 2015-03-02T13:18:23.084-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (54192 records 556942141 bytes) is inconsistent with full validation results (55192 records 567215141 bytes). Updating size storer with new values. 2015-03-02T13:18:23.084-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:23.106-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:23.120-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 475ms 2015-03-02T13:18:23.133-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:23.497-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:23.516-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:23.524-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 390ms 2015-03-02T13:18:23.536-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:18:23.887-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:18:23.902-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:18:23.914-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 377ms 2015-03-02T13:18:24.340-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T13:18:24.708-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 7256.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:36610 nscannedObjects:36610 nMatched:18305 nModified:18305 keyUpdates:1 writeConflicts:0 numYields:301 locks:{} 2589ms 2015-03-02T13:18:24.708-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7256.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2589ms 2015-03-02T13:18:24.711-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:18:24.941-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:18:24.962-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:18:24.976-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 265ms 2015-03-02T13:18:24.996-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:18:25.443-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:18:25.457-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (57192 records 587761141 bytes) are inconsistent with full validation results (56192 records 577488141 bytes). Updating counters with new values. 2015-03-02T13:18:25.457-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (56236 records 577940153 bytes) is inconsistent with full validation results (56192 records 577488141 bytes). Updating size storer with new values. 2015-03-02T13:18:25.457-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:18:25.465-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:18:25.470-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 473ms 2015-03-02T13:18:26.386-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:18:26.608-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 154ms 2015-03-02T13:18:27.334-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 5211.0 } } ndeleted:20845 keyUpdates:0 writeConflicts:0 numYields:171 locks:{} 1851ms 2015-03-02T13:18:27.335-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5211.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1851ms 2015-03-02T13:18:27.339-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:18:27.573-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:402015-03-02T13:18:58.721-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:18:58.736-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:18:58.736-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:18:58.736-0500 I CONTROL [initandlisten] 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:18:58.740-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:18:58.749-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:18:58.841-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:18:58.842-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:18:58.842-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:18:58.935-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:19:02.946-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50317 #1 (1 connection now open) 2015-03-02T13:19:04.444-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50318 #2 (2 connections now open) 2015-03-02T13:19:04.459-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:19:06.615-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (38299 records 393589879 bytes) are inconsistent with full validation results (37299 records 383316879 bytes). Updating counters with new values. 2015-03-02T13:19:06.615-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37300 records 383327152 bytes) is inconsistent with full validation results (37299 records 383316879 bytes). Updating size storer with new values. 2015-03-02T13:19:06.615-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:19:06.619-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:19:06.622-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2163ms 2015-03-02T13:19:06.630-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:19:06.746-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383316879 bytes) are inconsistent with full validation results (38299 records 393589879 bytes). Updating counters with new values. 2015-03-02T13:19:06.746-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383316879 bytes) is inconsistent with full validation results (38299 records 393589879 bytes). Updating size storer with new values. 2015-03-02T13:19:06.746-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:19:06.751-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:19:06.754-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 124ms 2015-03-02T13:19:06.892-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:19:07.726-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9629.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24510 nscannedObjects:24510 nMatched:12255 nModified:12255 keyUpdates:1 writeConflicts:0 numYields:192 locks:{} 966ms 2015-03-02T13:19:07.726-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9629.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 966ms 2015-03-02T13:19:07.730-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:19:07.848-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:19:07.853-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:19:07.858-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 127ms 2015-03-02T13:19:07.864-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:19:07.869-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50319 #3 (3 connections now open) 2015-03-02T13:19:07.972-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:19:07.976-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:19:07.979-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 103ms 2015-03-02T13:19:07.980-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 115ms 2015-03-02T13:19:07.995-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:19:08.010-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:19:08.194-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:19:08.204-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:19:08.206-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:19:08.213-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 218ms 2015-03-02T13:19:08.217-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:19:08.220-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 209ms 2015-03-02T13:19:09.146-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:19:10.069-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:19:10.151-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T13:19:10.998-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:19:12.195-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:19:12.677-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:19:13.373-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T13:19:14.306-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:19:14.536-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:19:14.895-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:19:15.775-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:19:15.917-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:19:17.399-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:19:17.407-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:19:17.436-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:19:17.948-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50320 #4 (4 connections now open) 2015-03-02T13:19:18.158-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (63299 records 650419702 bytes) are inconsistent with full validation results (62967 records 647009066 bytes). Updating counters with new values. 2015-03-02T13:19:18.158-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (63045 records 647810360 bytes) is inconsistent with full validation results (62967 records 647009066 bytes). Updating size storer with new values. 2015-03-02T13:19:18.158-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:19:18.160-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (62967 records 647009066 bytes) are inconsistent with full validation results (63299 records 650419702 bytes). Updating counters with new values. 2015-03-02T13:19:18.160-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (62967 records 647009066 bytes) is inconsistent with full validation results (63299 records 650419702 bytes). Updating size storer with new values. 2015-03-02T13:19:18.161-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:19:18.173-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:19:18.180-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:19:18.189-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 782ms 2015-03-02T13:19:18.199-0500 I NETWORK [conn1] end connection 10.4.127.218:50317 (3 connections now open) 2015-03-02T13:19:18.204-0500 I COMMAND [conn4] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 245ms 2015-03-02T13:19:18.204-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 768ms 2015-03-02T13:19:18.766-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 147ms 2015-03-02T13:19:19.923-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T13:19:20.138-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 8683.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32832 nscannedObjects:32832 nMatched:16416 nModified:16416 keyUpdates:1 writeConflicts:0 numYields:269 locks:{} 1930ms 2015-03-02T13:19:20.138-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8683.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1931ms 2015-03-02T13:19:20.140-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:19:20.457-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:19:20.670-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (66299 records 681292795 bytes) are inconsistent with full validation results (65299 records 671019795 bytes). Updating counters with new values. 2015-03-02T13:19:20.670-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (65629 records 674409885 bytes) is inconsistent with full validation results (65299 records 671019795 bytes). Updating size storer with new values. 2015-03-02T13:19:20.670-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:19:20.696-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:19:20.730-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 590ms 2015-03-02T13:19:21.894-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:19:22.279-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:19:22.283-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:19:22.599-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:19:22.859-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (71160 records 731229848 bytes) are inconsistent with full validation results (70299 records 722384795 bytes). Updating counters with new values. 2015-03-02T13:19:22.859-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (70629 records 725774885 bytes) is inconsistent with full validation results (70299 records 722384795 bytes). Updating size storer with new values. 2015-03-02T13:19:22.859-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:19:22.878-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:19:22.883-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:19:22.894-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 610ms 2015-03-02T13:19:22.925-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:19:23.886-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (70438 records 723812742 bytes) are inconsistent with full validation results (72299 records 742930795 bytes). Updating counters with new values. 2015-03-02T13:19:23.886-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (70299 records 722384795 bytes) is inconsistent with full validation results (72299 records 742930795 bytes). Updating size storer with new values. 2015-03-02T13:19:23.887-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:19:23.903-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:19:23.917-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 991ms 2015-03-02T13:19:24.110-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:19:24.127-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:19:25.153-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:19:25.251-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T13:19:25.398-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 138ms 2015-03-02T13:19:26.610-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:19:27.254-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:19:27.451-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:19:27.833-0500 I NETWORK [conn3] end connection 10.4.127.218:50319 (2 connections now open) 2015-03-02T13:19:27.881-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50321 #5 (3 connections now open) 2015-03-02T13:19:27.914-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:19:28.747-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (84299 records 866206795 bytes) are inconsistent with full validation results (83299 records 855933795 bytes). Updating counters with new values. 2015-03-02T13:19:28.747-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (83629 records 859323885 bytes) is inconsistent with full validation results (83299 records 855933795 bytes). Updating size storer with new values. 2015-03-02T13:19:28.747-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:19:28.780-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:19:28.800-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 886ms 2015-03-02T13:19:28.834-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:19:29.754-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:19:30.170-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (85299 records 876479795 bytes) are inconsistent with full validation results (84299 records 866206795 bytes). Updating counters with new values. 2015-03-02T13:19:30.171-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (84629 records 869596885 bytes) is inconsistent with full validation results (84299 records 866206795 bytes). Updating size storer with new values. 2015-03-02T13:19:30.171-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:19:30.211-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:19:30.230-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 1396ms 2015-03-02T13:19:30.239-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (84299 records 866206795 bytes) are inconsistent with full validation results (86299 records 886752795 bytes). Updating counters with new values. 2015-03-02T13:19:30.239-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (84299 records 866206795 bytes) is inconsistent with full validation results (86299 records 886752795 bytes). Updating size storer with new values. 2015-03-02T13:19:30.239-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:19:30.257-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:19:30.281-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 526ms 2015-03-02T13:19:30.301-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:19:31.017-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T13:19:32.221-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (87299 records 897044957 bytes) are inconsistent with full validation results (86299 records 886755902 bytes). Updating counters with new values. 2015-03-02T13:19:32.221-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (87299 records 897044957 bytes) is inconsistent with full validation results (86299 records 886755902 bytes). Updating size storer with new values. 2015-03-02T13:19:32.221-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:19:32.259-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:19:32.280-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 1979ms 2015-03-02T13:19:32.308-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:19:33.212-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 9263.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:35780 nscannedObjects:35780 nMatched:17890 nModified:17890 keyUpdates:1 writeConflicts:0 numYields:306 locks:{} 2965ms 2015-03-02T13:19:33.212-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9263.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2965ms 2015-03-02T13:19:33.223-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:19:33.262-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T13:19:33.919-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (87299 records 897028902 bytes) are inconsistent with full validation results (87299 records 897044957 bytes). Updating counters with new values. 2015-03-02T13:19:33.919-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in2015-03-02T13:20:00.971-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:20:00.988-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:20:00.988-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:20:00.988-0500 I CONTROL [initandlisten] 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:20:00.994-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:20:00.999-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:20:01.067-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:20:01.067-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:20:01.067-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:20:01.149-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:20:02.961-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50330 #1 (1 connection now open) 2015-03-02T13:20:02.972-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:20:04.459-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50331 #2 (2 connections now open) 2015-03-02T13:20:04.785-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:20:04.791-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:20:04.794-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 330ms 2015-03-02T13:20:04.794-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1821ms 2015-03-02T13:20:04.802-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:20:04.886-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:20:04.892-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:20:04.899-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:20:04.998-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:20:05.007-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:20:05.010-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 111ms 2015-03-02T13:20:06.022-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:20:07.871-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50333 #3 (3 connections now open) 2015-03-02T13:20:11.494-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:20:12.787-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:20:13.228-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T13:20:13.323-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (55299 records 568230879 bytes) are inconsistent with full validation results (54299 records 557957879 bytes). Updating counters with new values. 2015-03-02T13:20:13.323-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (54300 records 557968152 bytes) is inconsistent with full validation results (54299 records 557957879 bytes). Updating size storer with new values. 2015-03-02T13:20:13.324-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:20:13.329-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:20:13.333-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 546ms 2015-03-02T13:20:15.194-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 139ms 2015-03-02T13:20:15.465-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:20:17.708-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1579.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:85080 nscannedObjects:85080 nMatched:42540 nModified:42540 keyUpdates:1 writeConflicts:0 numYields:689 locks:{} 4371ms 2015-03-02T13:20:17.708-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1579.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4371ms 2015-03-02T13:20:17.711-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:20:17.918-0500 I NETWORK [conn1] end connection 10.4.127.218:50330 (2 connections now open) 2015-03-02T13:20:17.961-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50334 #4 (3 connections now open) 2015-03-02T13:20:18.249-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (57992 records 596294596 bytes) are inconsistent with full validation results (57299 records 589175407 bytes). Updating counters with new values. 2015-03-02T13:20:18.249-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (57760 records 593911260 bytes) is inconsistent with full validation results (57299 records 589175407 bytes). Updating size storer with new values. 2015-03-02T13:20:18.250-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:20:18.257-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:20:18.263-0500 I COMMAND [conn4] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 295ms 2015-03-02T13:20:18.263-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f4a9dfe5baa781309d12c9'), x: 4693.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 7 } }, Database: { acquireCount: { w: 7 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 294619 } }, Collection: { acquireCount: { w: 7 } } } 294ms 2015-03-02T13:20:18.270-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 559ms 2015-03-02T13:20:18.291-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 406ms 2015-03-02T13:20:18.297-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:20:18.963-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (57606 records 592390370 bytes) are inconsistent with full validation results (59299 records 609723591 bytes). Updating counters with new values. 2015-03-02T13:20:18.963-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (57606 records 592387211 bytes) is inconsistent with full validation results (59299 records 609723591 bytes). Updating size storer with new values. 2015-03-02T13:20:18.964-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:20:18.976-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:20:18.994-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 696ms 2015-03-02T13:20:22.017-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:20:23.760-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 253ms 2015-03-02T13:20:24.334-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:118436 nscannedObjects:118436 nMatched:59218 nModified:59218 keyUpdates:1 writeConflicts:0 numYields:959 locks:{} 6059ms 2015-03-02T13:20:24.334-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6059ms 2015-03-02T13:20:24.340-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:20:24.466-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:20:24.961-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (63299 records 650971253 bytes) are inconsistent with full validation results (62299 records 640757221 bytes). Updating counters with new values. 2015-03-02T13:20:24.961-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (62542 records 643194592 bytes) is inconsistent with full validation results (62299 records 640757221 bytes). Updating size storer with new values. 2015-03-02T13:20:24.961-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:20:24.989-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:20:25.014-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 674ms 2015-03-02T13:20:25.029-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:20:25.564-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (62299 records 640757221 bytes) are inconsistent with full validation results (63299 records 651030221 bytes). Updating counters with new values. 2015-03-02T13:20:25.565-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (62299 records 640757221 bytes) is inconsistent with full validation results (63299 records 651030221 bytes). Updating size storer with new values. 2015-03-02T13:20:25.565-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:20:25.575-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:20:25.580-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 551ms 2015-03-02T13:20:26.489-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:20:26.977-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:20:27.854-0500 I NETWORK [conn3] end connection 10.4.127.218:50333 (2 connections now open) 2015-03-02T13:20:27.881-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50336 #5 (3 connections now open) 2015-03-02T13:20:29.644-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 199ms 2015-03-02T13:20:32.710-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 217ms 2015-03-02T13:20:34.468-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50337 #6 (4 connections now open) 2015-03-02T13:20:34.537-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:20:34.892-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6134.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:149452 nscannedObjects:149452 nMatched:60084 nModified:60084 keyUpdates:1 writeConflicts:484 numYields:1222 locks:{} 9309ms 2015-03-02T13:20:34.892-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6134.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 9309ms 2015-03-02T13:20:34.893-0500 I NETWORK [conn2] end connection 10.4.127.218:50331 (3 connections now open) 2015-03-02T13:20:35.566-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:20:35.584-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:20:35.610-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11693 locks:{} 1073ms 2015-03-02T13:20:36.194-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T13:20:38.754-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 5854.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:122728 nscannedObjects:122728 nMatched:61364 nModified:61364 keyUpdates:1 writeConflicts:3910 numYields:1063 locks:{} 10860ms 2015-03-02T13:20:38.755-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5854.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 10860ms 2015-03-02T13:20:38.760-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:20:39.380-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (38554 records 396482923 bytes) are inconsistent with full validation res2015-03-02T13:21:04.019-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:21:04.036-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:21:04.036-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:21:04.036-0500 I CONTROL [initandlisten] 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:21:04.037-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:21:04.043-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:21:04.114-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:21:04.114-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:21:04.114-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:21:04.215-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:21:04.454-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50345 #1 (1 connection now open) 2015-03-02T13:21:05.668-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 7699.0 } } ndeleted:15750 keyUpdates:0 writeConflicts:0 numYields:123 locks:{} 1205ms 2015-03-02T13:21:05.668-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7699.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1206ms 2015-03-02T13:21:05.672-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:06.591-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22298 records 229066851 bytes) is inconsistent with full validation results (21549 records 221372877 bytes). Updating size storer with new values. 2015-03-02T13:21:06.591-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:06.595-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:06.598-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 926ms 2015-03-02T13:21:06.756-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 6446.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5012 nscannedObjects:5012 nMatched:2506 nModified:2506 keyUpdates:1 writeConflicts:0 numYields:39 locks:{} 155ms 2015-03-02T13:21:06.756-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6446.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 155ms 2015-03-02T13:21:06.758-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:06.797-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21549 records 221402140 bytes) is inconsistent with full validation results (21549 records 221405455 bytes). Updating size storer with new values. 2015-03-02T13:21:06.797-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:06.801-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:06.806-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:06.848-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:06.851-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:06.997-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7559.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5012 nscannedObjects:5012 nMatched:2506 nModified:2506 keyUpdates:1 writeConflicts:0 numYields:39 locks:{} 142ms 2015-03-02T13:21:06.997-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7559.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 142ms 2015-03-02T13:21:06.999-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:07.038-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:07.041-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:07.867-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1337.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28022 nscannedObjects:28022 nMatched:14011 nModified:14011 keyUpdates:1 writeConflicts:0 numYields:218 locks:{} 822ms 2015-03-02T13:21:07.867-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1337.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 822ms 2015-03-02T13:21:07.868-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:07.912-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:07.915-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:07.926-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:07.969-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:07.973-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:07.981-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:08.024-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:08.026-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:08.033-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:08.075-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:08.078-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:08.085-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:08.135-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:08.140-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:08.150-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:08.217-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:08.222-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:08.230-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:08.276-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:08.279-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:08.285-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:08.330-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:08.333-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:11.390-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50347 #2 (2 connections now open) 2015-03-02T13:21:11.398-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:11.490-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25777 records 264989264 bytes) is inconsistent with full validation results (26549 records 272920020 bytes). Updating size storer with new values. 2015-03-02T13:21:11.491-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:11.494-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:11.509-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:11.604-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (27549 records 283193020 bytes) are inconsistent with full validation results (26549 records 272920020 bytes). Updating counters with new values. 2015-03-02T13:21:11.604-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (26777 records 275262264 bytes) is inconsistent with full validation results (26549 records 272920020 bytes). Updating size storer with new values. 2015-03-02T13:21:11.604-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:11.608-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:11.610-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T13:21:12.978-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50349 #3 (3 connections now open) 2015-03-02T13:21:13.269-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4730.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:30562 nscannedObjects:30562 nMatched:15281 nModified:15281 keyUpdates:1 writeConflicts:0 numYields:246 locks:{} 1652ms 2015-03-02T13:21:13.269-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4730.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1652ms 2015-03-02T13:21:13.274-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:13.425-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (22983 records 236243654 bytes) are inconsistent with full validation results (25835 records 265566326 bytes). Updating counters with new values. 2015-03-02T13:21:13.425-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23602 records 242610688 bytes) is inconsistent with full validation results (25835 records 265566326 bytes). Updating size storer with new values. 2015-03-02T13:21:13.425-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:13.441-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:13.453-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 179ms 2015-03-02T13:21:13.467-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:13.607-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23796 records 244593172 bytes) are inconsistent with full validation results (23530 records 241857096 bytes). Updating counters with new values. 2015-03-02T13:21:13.607-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (24454 records 251361360 bytes) is inconsistent with full validation results (23530 records 241857096 bytes). Updating size storer with new values. 2015-03-02T13:21:13.607-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:13.620-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:13.625-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 158ms 2015-03-02T13:21:13.650-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:13.788-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:21:13.806-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (22547 records 231732958 bytes) are inconsistent with full validation results (21473 records 220698664 bytes). Updating counters with new values. 2015-03-02T13:21:13.806-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (22860 records 234954608 bytes) is inconsistent with full validation results (21473 records 220698664 bytes). Updating size storer with new values. 2015-03-02T13:21:13.807-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:13.815-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:13.823-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 173ms 2015-03-02T13:21:13.842-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:13.969-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19677 records 202225008 bytes) are inconsistent with full validation results (20584 records 211541540 bytes). Updating counters with new values. 2015-03-02T13:21:13.969-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (20114 records 206719990 bytes) is inconsistent with full validation results (20584 records 211541540 bytes). Updating size storer with new values. 2015-03-02T13:21:13.969-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:13.979-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:13.985-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 143ms 2015-03-02T13:21:13.999-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:14.120-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (18809 records 193283890 bytes) are inconsistent with full validation results (18795 records 193139886 bytes). Updating counters with new values. 2015-03-02T13:21:14.120-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19021 records 195464522 bytes) is inconsistent with full validation results (18795 records 193139886 bytes). Updating size storer with new values. 2015-03-02T13:21:14.120-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:14.133-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:14.143-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 143ms 2015-03-02T13:21:14.334-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 9965.0 } } ndeleted:15281 keyUpdates:0 writeConflicts:0 numYields:123 locks:{} 1332ms 2015-03-02T13:21:14.334-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9965.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1332ms 2015-03-02T13:21:14.338-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:21:14.433-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (15673 records 161026994 bytes) are inconsistent with full validation results (14268 records 146575164 bytes). Updating counters with new values. 2015-03-02T13:21:14.433-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (16007 records 164462518 bytes) is inconsistent with full validation results (14268 records 146575164 bytes). Updating size storer with new values. 2015-03-02T13:21:14.433-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:21:14.443-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:21:14.444-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 105ms 2015-03-02T13:21:14.451-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:21:14.510-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:21:14.514-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:21:14.531-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:21:14.609-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:21:14.617-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:21:15.636-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:15.745-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16934 records 173962982 bytes) is inconsistent with full validation results (17268 records 177394164 bytes). Updating size storer with new values. 2015-03-02T13:21:15.745-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:15.747-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:15.748-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T13:21:15.788-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:15.881-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17585 records 180653838 bytes) are inconsistent with full validation results (17268 records 177397297 bytes). Updating counters with new values. 2015-03-02T13:21:15.881-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17268 records 177394164 bytes) is inconsistent with full validation results (17268 records 177397297 bytes). Updating size storer with new values. 2015-03-02T13:21:15.881-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:15.887-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:15.898-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:15.961-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17951 records 184413756 bytes) are inconsistent with full validation results (17914 records 184033655 bytes). Updating counters with new values. 2015-03-02T13:21:15.961-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17376 records 178506781 bytes) is inconsistent with full validation results (17914 records 184033655 bytes). Updating size storer with new values. 2015-03-02T13:21:15.962-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:15.965-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:15.982-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.076-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17914 records 184033655 bytes) are inconsistent with full validation results (18268 records 187670297 bytes). Updating counters with new values. 2015-03-02T13:21:16.076-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17914 records 184033655 bytes) is inconsistent with full validation results (18268 records 187670297 bytes). Updating size storer with new values. 2015-03-02T13:21:16.076-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.078-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.086-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.156-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.164-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.183-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.296-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.300-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.307-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 123ms 2015-03-02T13:21:16.320-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.404-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.412-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.425-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.525-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.528-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.530-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T13:21:16.687-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8681.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2638 nscannedObjects:2638 nMatched:1319 nModified:1319 keyUpdates:1 writeConflicts:0 numYields:21 locks:{} 152ms 2015-03-02T13:21:16.687-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8681.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 152ms 2015-03-02T13:21:16.691-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.744-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18268 records 187675822 bytes) is inconsistent with full validation results (18268 records 187684311 bytes). Updating size storer with new values. 2015-03-02T13:21:16.745-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.747-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.752-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.789-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.792-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.799-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:16.859-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:16.861-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:16.991-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:21:17.126-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 5572.0 } } ndeleted:4000 keyUpdates:0 writeConflicts:0 numYields:32 locks:{} 258ms 2015-03-02T13:21:17.126-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5572.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 258ms 2015-03-02T13:21:17.127-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:17.264-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16162 records 166043848 bytes) is inconsistent with full validation results (15268 records 156848164 bytes). Updating size storer with new values. 2015-03-02T13:21:17.264-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:17.267-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:17.272-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 144ms 2015-03-02T13:21:17.279-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:17.329-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:17.331-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:17.341-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:17.412-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (15580 records 160053340 bytes) are inconsistent with full validation results (15268 records 156848164 bytes). Updating counters with new values. 2015-03-02T13:21:17.412-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (15374 records 157937102 bytes) is inconsistent with full validation results (15268 records 156848164 bytes). Updating size storer with new values. 2015-03-02T13:21:17.412-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:17.414-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:17.930-0500 I NETWORK [conn3] end connection 10.4.127.218:50349 (2 connections now open) 2015-03-02T13:21:17.978-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50350 #4 (3 connections now open) 2015-03-02T13:21:17.987-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:21:18.081-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (15956 records 163915988 bytes) are inconsistent with full validation results (16268 records 167121164 bytes). Updating counters with new values. 2015-03-02T13:21:18.081-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15268 records 156848164 bytes) is inconsistent with full validation results (16268 records 167121164 bytes). Updating size storer with new values. 2015-03-02T13:21:18.081-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:21:18.083-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:21:18.097-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:21:18.197-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16268 records 167121164 bytes) is inconsistent with full validation results (16269 records 167121210 bytes). Updating size storer with new values. 2015-03-02T13:21:18.198-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:21:18.207-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:21:18.210-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 113ms 2015-03-02T13:21:18.221-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:21:18.333-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16559 records 170100380 bytes) are inconsistent with full validation results (16269 records 167121210 bytes). Updating counters with new values. 2015-03-02T13:21:18.333-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16374 records 168199875 bytes) is inconsistent with full validation results (16269 records 167121210 bytes). Updating size storer with new values. 2015-03-02T13:21:18.333-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:21:18.337-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:21:18.342-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 121ms 2015-03-02T13:21:18.386-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:21:19.216-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:21:22.479-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:21:22.892-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:21:23.849-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:21:25.125-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:25.137-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:21:25.586-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 205ms 2015-03-02T13:21:25.676-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (35979 records 369602040 bytes) are inconsistent with full validation results (35161 records 361198726 bytes). Updating counters with new values. 2015-03-02T13:21:25.676-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (35084 records 360407705 bytes) is inconsistent with full validation results (35161 records 361198726 bytes). Updating size storer with new values. 2015-03-02T13:21:25.676-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:25.694-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:25.703-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 577ms 2015-03-02T13:21:25.726-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:25.825-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (35161 records 361198726 bytes) are inconsistent with full validation results (36269 records 372581210 bytes). Updating counters with new values. 2015-03-02T13:21:25.825-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (35161 records 361198726 bytes) is inconsistent with full validation results (36269 records 372581210 bytes). Updating size storer with new values. 2015-03-02T13:21:25.825-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:25.831-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:25.836-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T13:21:25.846-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:25.933-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:25.940-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:27.208-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3751.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:25454 nscannedObjects:25454 nMatched:12727 nModified:12727 keyUpdates:1 writeConflicts:0 numYields:205 locks:{} 1256ms 2015-03-02T13:21:27.208-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3751.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1257ms 2015-03-02T13:21:27.210-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:27.288-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37269 records 383011575 bytes) is inconsistent with full validation results (37269 records 383019648 bytes). Updating size storer with new values. 2015-03-02T13:21:27.288-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:27.292-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:27.303-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:21:27.372-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:21:27.376-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:21:27.889-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50354 #5 (4 connections now open) 2015-03-02T13:21:28.247-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 288ms 2015-03-02T13:21:28.458-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 212ms 2015-03-02T13:21:28.462-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:28.480-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 8139.0 } } ndeleted:12727 keyUpdates:0 writeConflicts:0 numYields:109 locks:{} 1099ms 2015-03-02T13:21:28.480-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8139.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1099ms 2015-03-02T13:21:28.481-0500 I NETWORK [conn2] end connection 10.4.127.218:50347 (3 connections now open) 2015-03-02T13:21:28.686-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (26542 records 272708515 bytes) are inconsistent with full validation results (26717 records 274489667 bytes). Updating counters with new values. 2015-03-02T13:21:28.686-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26568 records 272957963 bytes) is inconsistent with full validation results (26717 records 274489667 bytes). Updating size storer with new values. 2015-03-02T13:21:28.686-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:28.712-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:28.722-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 260ms 2015-03-02T13:21:28.731-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:28.865-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (26717 records 274505540 bytes) are inconsistent with full validation results (26542 records 272711076 bytes). Updating counters with new values. 2015-03-02T13:21:28.865-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26717 records 274494581 bytes) is inconsistent with full validation results (26542 records 272711076 bytes). Updating size storer with new values. 2015-03-02T13:21:28.865-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:28.874-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:28.881-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 150ms 2015-03-02T13:21:28.889-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:29.019-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (26542 records 272727924 bytes) are inconsistent with full validation results (26542 records 272727339 bytes). Updating counters with new values. 2015-03-02T13:21:29.019-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26542 records 272726117 bytes) is inconsistent with full validation results (26542 records 272727339 bytes). Updating size storer with new values. 2015-03-02T13:21:29.019-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:29.028-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:29.034-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 145ms 2015-03-02T13:21:29.043-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:29.192-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 2597.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13232 nscannedObjects:13232 nMatched:6616 nModified:6616 keyUpdates:1 writeConflicts:0 numYields:121 locks:{} 1271ms 2015-03-02T13:21:29.192-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2597.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1271ms 2015-03-02T13:21:29.198-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:21:29.320-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (26542 records 272738077 bytes) are inconsistent with full validation results (26542 records 272744291 bytes). Updating counters with new values. 2015-03-02T13:21:29.320-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (26542 records 272727339 bytes) is inconsistent with full validation results (26542 records 272744291 bytes). Updating size storer with new values. 2015-03-02T13:21:29.320-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:29.329-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:29.334-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 290ms 2015-03-02T13:21:29.343-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (26542 records 272744291 bytes) are inconsistent with full validation results (26542 records 272751974 bytes). Updating counters with new values. 2015-03-02T13:21:29.343-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26542 records 272744291 bytes) is inconsistent with full validation results (26542 records 272751974 bytes). Updating size storer with new values. 2015-03-02T13:21:29.346-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:21:29.347-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:29.354-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:21:29.362-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T13:21:29.368-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:21:29.482-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:29.489-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:29.493-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 146ms 2015-03-02T13:21:29.496-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:21:29.500-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:29.504-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:21:29.512-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 144ms 2015-03-02T13:21:29.524-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:21:29.656-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:29.662-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:29.673-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 173ms 2015-03-02T13:21:29.687-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (26378 records 271065070 bytes) are inconsistent with full validation results (26542 records 272751974 bytes). Updating counters with new values. 2015-03-02T13:21:29.687-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26507 records 272391964 bytes) is inconsistent with full validation results (26542 records 272751974 bytes). Updating size storer with new values. 2015-03-02T13:21:29.687-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:21:29.696-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:21:29.702-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 178ms 2015-03-02T13:21:29.715-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:21:29.845-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (24410 records 250822222 bytes) are inconsistent with full validation results (26073 records 267927840 bytes). Updating counters with new values. 2015-03-02T13:21:29.845-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (24671 records 253506868 bytes) is inconsistent with full validation results (26073 records 267927840 bytes). Updating size storer with new values. 2015-03-02T13:21:29.846-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:21:29.858-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:21:29.866-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 151ms 2015-03-02T13:21:30.051-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4158.0 } } ndeleted:6616 keyUpdates:0 writeConflicts:0 numYields:52 locks:{} 375ms 2015-03-02T13:21:30.051-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4158.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 375ms 2015-03-02T13:21:30.054-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.148-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (21753 records 223492320 bytes) are inconsistent with full validation results (19926 records 204699798 bytes). Updating counters with new values. 2015-03-02T13:21:30.148-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22334 records 229468486 bytes) is inconsistent with full validation results (19926 records 204699798 bytes). Updating size storer with new values. 2015-03-02T13:21:30.149-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.159-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.167-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 113ms 2015-03-02T13:21:30.176-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.265-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.275-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.281-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T13:21:30.286-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.371-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.377-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.389-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.475-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.485-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.494-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.586-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.591-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.599-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.743-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (20905 records 214746838 bytes) are inconsistent with full validation results (19927 records 204699844 bytes). Updating counters with new values. 2015-03-02T13:21:30.743-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20345 records 208993958 bytes) is inconsistent with full validation results (19927 records 204699844 bytes). Updating size storer with new values. 2015-03-02T13:21:30.744-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.746-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:21:30.750-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.755-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 156ms 2015-03-02T13:21:30.761-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.867-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (19949 records 204925850 bytes) are inconsistent with full validation results (20927 records 214972844 bytes). Updating counters with new values. 2015-03-02T13:21:30.868-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19927 records 204699844 bytes) is inconsistent with full validation results (20927 records 214972844 bytes). Updating size storer with new values. 2015-03-02T13:21:30.868-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.885-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.887-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 126ms 2015-03-02T13:21:30.894-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:30.949-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20927 records 214972844 bytes) is inconsistent with full validation results (20926 records 214972798 bytes). Updating size storer with new values. 2015-03-02T13:21:30.949-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:30.952-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:30.963-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:21:31.009-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:21:31.012-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:21:31.350-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:21:32.144-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:21:34.483-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50356 #6 (4 connections now open) 2015-03-02T13:21:34.509-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:21:34.656-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 190ms 2015-03-02T13:21:34.689-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 240ms 2015-03-02T13:21:34.694-0500 I NETWORK [conn1] end connection 10.4.127.218:50345 (3 connections now open) 2015-03-02T13:21:34.949-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (30926 records 317702798 bytes) are inconsistent with full validation results (29639 records 304481447 bytes). Updating counters with new values. 2015-03-02T13:21:34.949-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (30343 records 311713639 bytes) is inconsistent with full validation results (29639 records 304481447 bytes). Updating size storer with new values. 2015-03-02T13:21:34.949-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:21:34.961-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:21:34.979-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 470ms 2015-03-02T13:21:35.000-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:21:35.234-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (29639 records 304481447 bytes) are inconsistent with full validation results (30926 records 317702798 bytes). Updating counters with new values. 2015-03-02T13:21:35.238-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (29639 records 304481447 bytes) is inconsistent with full validation results (30926 records 317702798 bytes). Updating size storer with new values. 2015-03-02T13:21:35.238-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:21:35.251-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:21:35.271-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 270ms 2015-03-02T13:21:35.276-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:21:35.396-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:21:35.408-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:21:35.419-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 142ms 2015-03-02T13:21:35.432-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:21:35.584-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (30926 records 317702798 bytes) is inconsistent with full validation results (30927 records 317702844 bytes). Updating size storer with new values. 2015-03-02T13:21:35.584-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:21:35.591-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:21:35.595-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 162ms 2015-03-02T13:21:35.607-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:21:35.803-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (32260 records 331396753 bytes) are inconsistent with full validation results (31062 records 319089699 bytes). Updating counters with new values. 2015-03-02T13:21:35.803-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (31343 records 321976412 bytes) is inconsistent with full validation results (31062 records 319089699 bytes). Updating size storer with new values. 2015-03-02T13:21:35.803-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:21:35.813-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:21:35.823-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 216ms 2015-03-02T13:21:35.864-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T13:21:38.012-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:21:38.266-0500 W STORAGE [conn4] table:collection-2-2321154500689669932015-03-02T13:22:14.441-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:22:14.454-0500 I CONTROL [initandlisten] MongoDB starting : pid=1282 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:22:14.454-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:22:14.455-0500 I CONTROL [initandlisten] 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:22:14.458-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:22:14.463-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:22:14.524-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:22:14.524-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:22:14.524-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:22:14.616-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:22:18.030-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50368 #1 (1 connection now open) 2015-03-02T13:22:19.383-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9532.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:24704 nscannedObjects:24704 nMatched:12352 nModified:12352 keyUpdates:1 writeConflicts:0 numYields:196 locks:{} 1346ms 2015-03-02T13:22:19.383-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9532.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1346ms 2015-03-02T13:22:19.388-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:22:19.538-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50369 #2 (2 connections now open) 2015-03-02T13:22:20.691-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:22:20.701-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:22:20.706-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1160ms 2015-03-02T13:22:20.707-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1318ms 2015-03-02T13:22:20.722-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:22:20.725-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:22:20.860-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:22:20.872-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:22:20.874-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:22:20.877-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 151ms 2015-03-02T13:22:20.880-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:22:20.886-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T13:22:20.888-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:22:20.968-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:22:20.972-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:22:22.965-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50370 #3 (3 connections now open) 2015-03-02T13:22:22.987-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:23.169-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (39948 records 410536140 bytes) is inconsistent with full validation results (40299 records 414141963 bytes). Updating size storer with new values. 2015-03-02T13:22:23.170-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:23.175-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:23.180-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 193ms 2015-03-02T13:22:23.197-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:23.328-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T13:22:23.397-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41299 records 424414963 bytes) are inconsistent with full validation results (40299 records 414141963 bytes). Updating counters with new values. 2015-03-02T13:22:23.397-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40948 records 420809140 bytes) is inconsistent with full validation results (40299 records 414141963 bytes). Updating size storer with new values. 2015-03-02T13:22:23.397-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:23.411-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:23.420-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 222ms 2015-03-02T13:22:24.112-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 9956.0 } } ndeleted:12352 keyUpdates:0 writeConflicts:0 numYields:98 locks:{} 682ms 2015-03-02T13:22:24.112-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9956.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 682ms 2015-03-02T13:22:24.114-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:24.217-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27947 records 287099531 bytes) are inconsistent with full validation results (28947 records 297372531 bytes). Updating counters with new values. 2015-03-02T13:22:24.217-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (28650 records 294320349 bytes) is inconsistent with full validation results (28947 records 297372531 bytes). Updating size storer with new values. 2015-03-02T13:22:24.217-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:24.224-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:24.227-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 113ms 2015-03-02T13:22:24.542-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:22:24.552-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:22:25.237-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 1480.0 } } ndeleted:18163 keyUpdates:0 writeConflicts:0 numYields:143 locks:{} 1008ms 2015-03-02T13:22:25.237-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1480.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1008ms 2015-03-02T13:22:25.240-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.333-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13650 records 140226450 bytes) is inconsistent with full validation results (12784 records 131330032 bytes). Updating size storer with new values. 2015-03-02T13:22:25.333-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.343-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:25.356-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 115ms 2015-03-02T13:22:25.363-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.422-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.426-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:25.435-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.493-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.495-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:25.508-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.577-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.579-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:25.594-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.688-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (13661 records 140339453 bytes) are inconsistent with full validation results (12811 records 131607403 bytes). Updating counters with new values. 2015-03-02T13:22:25.688-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12918 records 132706614 bytes) is inconsistent with full validation results (12811 records 131607403 bytes). Updating size storer with new values. 2015-03-02T13:22:25.688-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.695-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:25.702-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 107ms 2015-03-02T13:22:25.703-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:22:25.709-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.792-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (12934 records 132870982 bytes) are inconsistent with full validation results (13784 records 141603032 bytes). Updating counters with new values. 2015-03-02T13:22:25.792-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (12811 records 131607403 bytes) is inconsistent with full validation results (13784 records 141603032 bytes). Updating size storer with new values. 2015-03-02T13:22:25.793-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.794-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:25.806-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.879-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.887-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:25.898-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:25.993-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (14318 records 147088814 bytes) are inconsistent with full validation results (13784 records 141603032 bytes). Updating counters with new values. 2015-03-02T13:22:25.993-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13918 records 142979614 bytes) is inconsistent with full validation results (13784 records 141603032 bytes). Updating size storer with new values. 2015-03-02T13:22:25.994-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:25.995-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:26.001-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 103ms 2015-03-02T13:22:26.012-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:26.036-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T13:22:26.092-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (14250 records 146390250 bytes) are inconsistent with full validation results (14587 records 149852251 bytes). Updating counters with new values. 2015-03-02T13:22:26.092-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (13784 records 141603032 bytes) is inconsistent with full validation results (14587 records 149852251 bytes). Updating size storer with new values. 2015-03-02T13:22:26.092-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:26.099-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:26.111-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:22:26.194-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (14587 records 149852251 bytes) are inconsistent with full validation results (14784 records 151876032 bytes). Updating counters with new values. 2015-03-02T13:22:26.198-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (14587 records 149852251 bytes) is inconsistent with full validation results (14784 records 151876032 bytes). Updating size storer with new values. 2015-03-02T13:22:26.198-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:22:26.201-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:22:26.840-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:22:27.133-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:22:27.912-0500 I NETWORK [conn3] end connection 10.4.127.218:50370 (2 connections now open) 2015-03-02T13:22:27.963-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50371 #4 (3 connections now open) 2015-03-02T13:22:27.973-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:28.069-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16918 records 173798614 bytes) is inconsistent with full validation results (17784 records 182695032 bytes). Updating size storer with new values. 2015-03-02T13:22:28.069-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:28.071-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:28.081-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:28.179-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (18555 records 190615515 bytes) are inconsistent with full validation results (17784 records 182695032 bytes). Updating counters with new values. 2015-03-02T13:22:28.179-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17918 records 184071614 bytes) is inconsistent with full validation results (17784 records 182695032 bytes). Updating size storer with new values. 2015-03-02T13:22:28.186-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:28.189-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:28.191-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 110ms 2015-03-02T13:22:28.208-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:28.230-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 144ms 2015-03-02T13:22:28.302-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T13:22:28.338-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19013 records 195320549 bytes) are inconsistent with full validation results (18799 records 193122127 bytes). Updating counters with new values. 2015-03-02T13:22:28.338-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18147 records 186424131 bytes) is inconsistent with full validation results (18799 records 193122127 bytes). Updating size storer with new values. 2015-03-02T13:22:28.338-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:28.344-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:28.350-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 141ms 2015-03-02T13:22:29.171-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3391.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:10436 nscannedObjects:10436 nMatched:5218 nModified:5218 keyUpdates:1 writeConflicts:0 numYields:88 locks:{} 814ms 2015-03-02T13:22:29.171-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3391.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 814ms 2015-03-02T13:22:29.177-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:29.293-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19633 records 201757643 bytes) are inconsistent with full validation results (19784 records 203308866 bytes). Updating counters with new values. 2015-03-02T13:22:29.293-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (18799 records 193188869 bytes) is inconsistent with full validation results (19784 records 203308866 bytes). Updating size storer with new values. 2015-03-02T13:22:29.293-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:29.303-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:29.311-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:22:29.312-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 134ms 2015-03-02T13:22:29.550-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:22:29.700-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 6990.0 } } ndeleted:5228 keyUpdates:0 writeConflicts:0 numYields:42 locks:{} 385ms 2015-03-02T13:22:29.700-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6990.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 385ms 2015-03-02T13:22:29.706-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:29.827-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (15722 records 161512106 bytes) are inconsistent with full validation results (16556 records 170079788 bytes). Updating counters with new values. 2015-03-02T13:22:29.827-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16034 records 164721338 bytes) is inconsistent with full validation results (16556 records 170079788 bytes). Updating size storer with new values. 2015-03-02T13:22:29.827-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:29.851-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:29.854-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 147ms 2015-03-02T13:22:29.866-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:29.934-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:29.936-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.171-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 4116.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3980 nscannedObjects:3980 nMatched:1990 nModified:1990 keyUpdates:1 writeConflicts:0 numYields:32 locks:{} 227ms 2015-03-02T13:22:30.171-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4116.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 227ms 2015-03-02T13:22:30.173-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.225-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16556 records 170101732 bytes) is inconsistent with full validation results (16556 records 170105658 bytes). Updating size storer with new values. 2015-03-02T13:22:30.225-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.227-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.349-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3794.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3980 nscannedObjects:3980 nMatched:1990 nModified:1990 keyUpdates:1 writeConflicts:0 numYields:31 locks:{} 116ms 2015-03-02T13:22:30.349-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3794.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 116ms 2015-03-02T13:22:30.351-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.395-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.400-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.561-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5373.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3980 nscannedObjects:3980 nMatched:1990 nModified:1990 keyUpdates:1 writeConflicts:0 numYields:31 locks:{} 155ms 2015-03-02T13:22:30.561-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5373.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 155ms 2015-03-02T13:22:30.563-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.620-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.622-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.627-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.665-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.668-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.672-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.731-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.734-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.739-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.775-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.777-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.782-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.816-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.819-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.829-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.868-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.870-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:30.881-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:30.916-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:30.918-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:31.109-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 9995.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3980 nscannedObjects:3980 nMatched:1990 nModified:1990 keyUpdates:1 writeConflicts:0 numYields:32 locks:{} 187ms 2015-03-02T13:22:31.109-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9995.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 188ms 2015-03-02T13:22:31.112-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:31.171-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:31.178-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:31.526-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3608.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5980 nscannedObjects:5980 nMatched:2990 nModified:2990 keyUpdates:1 writeConflicts:0 numYields:49 locks:{} 337ms 2015-03-02T13:22:31.526-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3608.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 337ms 2015-03-02T13:22:31.529-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:31.570-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:31.573-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:32.756-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T13:22:33.205-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:22:33.327-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (21294 records 218792132 bytes) is inconsistent with full validation results (21556 records 221483658 bytes). Updating size storer with new values. 2015-03-02T13:22:33.327-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:22:33.334-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:22:33.341-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 135ms 2015-03-02T13:22:33.665-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:22:34.069-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 6671.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:13980 nscannedObjects:13980 nMatched:6990 nModified:6990 keyUpdates:1 writeConflicts:0 numYields:113 locks:{} 724ms 2015-03-02T13:22:34.069-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6671.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 724ms 2015-03-02T13:22:34.076-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:22:34.149-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:22:34.154-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:22:34.353-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:22:34.488-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (18014 records 185076646 bytes) are inconsistent with full validation results (19827 records 203725164 bytes). Updating counters with new values. 2015-03-02T13:22:34.488-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (18808 records 193243730 bytes) is inconsistent with full validation results (19827 records 203725164 bytes). Updating size storer with new values. 2015-03-02T13:22:34.488-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:22:34.508-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:22:34.517-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 163ms 2015-03-02T13:22:34.520-0500 I NETWORK [conn2] end connection 10.4.127.218:50369 (2 connections now open) 2015-03-02T13:22:34.545-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50374 #5 (3 connections now open) 2015-03-02T13:22:34.558-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:22:34.575-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 4064.0 } } ndeleted:6990 keyUpdates:0 writeConflicts:0 numYields:55 locks:{} 409ms 2015-03-02T13:22:34.575-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4064.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 409ms 2015-03-02T13:22:34.578-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:22:34.636-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (18379 records 188831036 bytes) are inconsistent with full validation results (16807 records 172661444 bytes). Updating counters with new values. 2015-03-02T13:22:34.636-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18621 records 191320248 bytes) is inconsistent with full validation results (16807 records 172661444 bytes). Updating size storer with new values. 2015-03-02T13:22:34.636-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:22:34.644-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:22:34.660-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (16807 records 172661444 bytes) are inconsistent with full validation results (16566 records 170182518 bytes). Updating counters with new values. 2015-03-02T13:22:34.660-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (16807 records 172661444 bytes) is inconsistent with full validation results (16566 records 170182518 bytes). Updating size storer with new values. 2015-03-02T13:22:34.660-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:22:34.667-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:22:36.399-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:22:38.404-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:22:38.406-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:22:39.859-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:22:43.369-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:22:45.457-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:22:45.462-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:22:45.872-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:22:46.336-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42566 records 437280518 bytes) are inconsistent with full validation results (41566 records 427007518 bytes). Updating counters with new values. 2015-03-02T13:22:46.337-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42324 records 434794452 bytes) is inconsistent with full validation results (41566 records 427007518 bytes). Updating size storer with new values. 2015-03-02T13:22:46.337-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:22:46.345-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (41566 records 427007518 bytes) are inconsistent with full validation results (42566 records 437280518 bytes). Updating counters with new values. 2015-03-02T13:22:46.345-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (41566 records 427007518 bytes) is inconsistent with full validation results (42566 records 437280518 bytes). Updating size storer with new values. 2015-03-02T13:22:46.345-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:22:46.352-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:22:46.365-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:22:46.370-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 907ms 2015-03-02T13:22:46.375-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 502ms 2015-03-02T13:23:17.641-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:23:17.660-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:23:17.660-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:23:17.660-0500 I CONTROL [initandlisten] 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:23:17.661-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:23:17.668-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:23:17.734-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:23:17.734-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:23:17.734-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:23:17.806-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:23:18.062-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50389 #1 (1 connection now open) 2015-03-02T13:23:18.072-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:19.579-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50390 #2 (2 connections now open) 2015-03-02T13:23:19.741-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:19.747-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:19.750-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 167ms 2015-03-02T13:23:19.751-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1678ms 2015-03-02T13:23:19.759-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:19.837-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:19.843-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:19.855-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:19.959-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:19.963-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:19.966-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 110ms 2015-03-02T13:23:19.972-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:20.045-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:20.049-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:20.063-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:20.138-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:20.142-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:20.153-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:20.217-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:20.221-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:20.228-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:20.320-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:20.330-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:20.335-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 107ms 2015-03-02T13:23:20.342-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:20.409-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:20.413-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:20.424-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:20.511-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:20.516-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:21.510-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 793.0 } } ndeleted:32541 keyUpdates:0 writeConflicts:0 numYields:254 locks:{} 981ms 2015-03-02T13:23:21.510-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 793.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 981ms 2015-03-02T13:23:21.514-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:21.578-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5298 records 54423134 bytes) is inconsistent with full validation results (4758 records 48878934 bytes). Updating size storer with new values. 2015-03-02T13:23:21.578-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:21.584-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:21.590-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:21.599-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:21.600-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:23.717-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50391 #3 (3 connections now open) 2015-03-02T13:23:26.464-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:23:28.003-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50394 #4 (4 connections now open) 2015-03-02T13:23:28.017-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:28.162-0500 I NETWORK [conn3] end connection 10.4.127.218:50391 (3 connections now open) 2015-03-02T13:23:28.187-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T13:23:28.210-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:23:28.366-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (21758 records 223519934 bytes) are inconsistent with full validation results (19758 records 202973934 bytes). Updating counters with new values. 2015-03-02T13:23:28.366-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (21218 records 217972514 bytes) is inconsistent with full validation results (19758 records 202973934 bytes). Updating size storer with new values. 2015-03-02T13:23:28.366-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:28.368-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:28.370-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 353ms 2015-03-02T13:23:28.380-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:28.505-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (19758 records 202973934 bytes) are inconsistent with full validation results (21758 records 223519934 bytes). Updating counters with new values. 2015-03-02T13:23:28.505-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (19758 records 202973934 bytes) is inconsistent with full validation results (21758 records 223519934 bytes). Updating size storer with new values. 2015-03-02T13:23:28.505-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:28.510-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:28.517-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 136ms 2015-03-02T13:23:28.529-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:28.573-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:28.576-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:28.587-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:28.706-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:28.713-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:28.721-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 133ms 2015-03-02T13:23:28.730-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:28.782-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:28.785-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.274-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 2007.0 } } ndeleted:11986 keyUpdates:0 writeConflicts:0 numYields:94 locks:{} 483ms 2015-03-02T13:23:29.274-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2007.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 483ms 2015-03-02T13:23:29.278-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.379-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10298 records 105791354 bytes) is inconsistent with full validation results (9772 records 100387756 bytes). Updating size storer with new values. 2015-03-02T13:23:29.379-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.395-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.403-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 125ms 2015-03-02T13:23:29.409-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.453-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.458-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.471-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.520-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (9772 records 100387756 bytes) is inconsistent with full validation results (9773 records 100387802 bytes). Updating size storer with new values. 2015-03-02T13:23:29.521-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.522-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.529-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.563-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.564-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.573-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.599-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.600-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.605-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.622-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.624-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.627-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.643-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.645-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.676-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.693-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (9773 records 100393925 bytes) is inconsistent with full validation results (9773 records 100395628 bytes). Updating size storer with new values. 2015-03-02T13:23:29.693-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.694-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.726-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.743-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.744-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.747-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.765-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.766-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.798-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.816-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.817-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.836-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.872-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (9661 records 99247453 bytes) are inconsistent with full validation results (9170 records 94203410 bytes). Updating counters with new values. 2015-03-02T13:23:29.872-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (9229 records 94809517 bytes) is inconsistent with full validation results (9170 records 94203410 bytes). Updating size storer with new values. 2015-03-02T13:23:29.872-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.877-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:29.888-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:29.923-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (9679 records 99432367 bytes) are inconsistent with full validation results (9923 records 101938979 bytes). Updating counters with new values. 2015-03-02T13:23:29.923-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (9170 records 94203410 bytes) is inconsistent with full validation results (9923 records 101938979 bytes). Updating size storer with new values. 2015-03-02T13:23:29.923-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:29.928-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:30.070-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.143-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (10923 records 112228983 bytes) are inconsistent with full validation results (11170 records 114762241 bytes). Updating counters with new values. 2015-03-02T13:23:30.144-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10923 records 112225746 bytes) is inconsistent with full validation results (11170 records 114762241 bytes). Updating size storer with new values. 2015-03-02T13:23:30.147-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.155-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.166-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.225-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11170 records 114769716 bytes) are inconsistent with full validation results (11170 records 114768923 bytes). Updating counters with new values. 2015-03-02T13:23:30.225-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11170 records 114762241 bytes) is inconsistent with full validation results (11170 records 114768923 bytes). Updating size storer with new values. 2015-03-02T13:23:30.225-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.229-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.240-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.244-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1868.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4000 nscannedObjects:4000 nMatched:2000 nModified:2000 keyUpdates:1 writeConflicts:0 numYields:34 locks:{} 302ms 2015-03-02T13:23:30.244-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1868.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 302ms 2015-03-02T13:23:30.250-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:30.284-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11170 records 114770444 bytes) are inconsistent with full validation results (11170 records 114775410 bytes). Updating counters with new values. 2015-03-02T13:23:30.284-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11170 records 114768923 bytes) is inconsistent with full validation results (11170 records 114775410 bytes). Updating size storer with new values. 2015-03-02T13:23:30.287-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.289-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.293-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:30.297-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:30.298-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.327-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.329-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.337-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.376-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.381-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.445-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.499-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10111 records 103882536 bytes) is inconsistent with full validation results (9170 records 94203410 bytes). Updating size storer with new values. 2015-03-02T13:23:30.500-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.505-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.673-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 839.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3790 nscannedObjects:3790 nMatched:1895 nModified:1895 keyUpdates:1 writeConflicts:0 numYields:30 locks:{} 161ms 2015-03-02T13:23:30.673-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 839.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 162ms 2015-03-02T13:23:30.677-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.719-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9170 records 94217177 bytes) is inconsistent with full validation results (9170 records 94228045 bytes). Updating size storer with new values. 2015-03-02T13:23:30.719-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.720-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.728-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.745-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.747-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.879-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2503.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:3790 nscannedObjects:3790 nMatched:1895 nModified:1895 keyUpdates:1 writeConflicts:0 numYields:29 locks:{} 130ms 2015-03-02T13:23:30.879-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2503.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 130ms 2015-03-02T13:23:30.881-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.905-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.906-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.912-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.931-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.933-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:30.944-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:30.998-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:30.999-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:31.009-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:31.057-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:31.058-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:31.071-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:31.110-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:31.111-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:31.556-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:23:32.342-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:23:32.347-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:23:32.495-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (14116 records 145038303 bytes) are inconsistent with full validation results (13170 records 135320045 bytes). Updating counters with new values. 2015-03-02T13:23:32.495-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13439 records 138083482 bytes) is inconsistent with full validation results (13170 records 135320045 bytes). Updating size storer with new values. 2015-03-02T13:23:32.495-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:23:32.497-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:23:32.499-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:23:32.503-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 155ms 2015-03-02T13:23:32.510-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:23:32.593-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (13224 records 135874787 bytes) are inconsistent with full validation results (14170 records 145593045 bytes). Updating counters with new values. 2015-03-02T13:23:32.593-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13170 records 135320045 bytes) is inconsistent with full validation results (14170 records 145593045 bytes). Updating size storer with new values. 2015-03-02T13:23:32.593-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:23:32.595-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:23:32.881-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 2753.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7790 nscannedObjects:7790 nMatched:3895 nModified:3895 keyUpdates:1 writeConflicts:0 numYields:61 locks:{} 279ms 2015-03-02T13:23:32.881-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2753.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 279ms 2015-03-02T13:23:32.885-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:23:32.943-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:23:32.948-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:23:32.965-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:23:33.047-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:23:33.052-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:23:33.063-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:23:33.149-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:23:33.156-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:23:33.167-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:23:33.231-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:23:33.233-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:23:33.252-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:23:33.336-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:23:33.338-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:23:33.552-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T13:23:33.694-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:23:34.540-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 33.0 } } ndeleted:15807 keyUpdates:0 writeConflicts:0 numYields:125 locks:{} 1188ms 2015-03-02T13:23:34.540-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 33.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1188ms 2015-03-02T13:23:34.541-0500 I NETWORK [conn2] end connection 10.4.127.218:50390 (2 connections now open) 2015-03-02T13:23:34.577-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50395 #5 (3 connections now open) 2015-03-02T13:23:37.016-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:23:38.216-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:23:38.991-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:39.218-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14363 records 147551099 bytes) are inconsistent with full validation results (13363 records 137278099 bytes). Updating counters with new values. 2015-03-02T13:23:39.218-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13930 records 143102890 bytes) is inconsistent with full validation results (13363 records 137278099 bytes). Updating size storer with new values. 2015-03-02T13:23:39.218-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:39.226-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:39.230-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 239ms 2015-03-02T13:23:39.236-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:39.273-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (13363 records 137278099 bytes) are inconsistent with full validation results (14363 records 147551099 bytes). Updating counters with new values. 2015-03-02T13:23:39.273-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13363 records 137278099 bytes) is inconsistent with full validation results (14363 records 147551099 bytes). Updating size storer with new values. 2015-03-02T13:23:39.273-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:39.275-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:39.285-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:39.320-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:39.322-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:39.327-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:39.379-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:39.381-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:40.434-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3449.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22204 nscannedObjects:22204 nMatched:11102 nModified:11102 keyUpdates:1 writeConflicts:0 numYields:179 locks:{} 1050ms 2015-03-02T13:23:40.434-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3449.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1051ms 2015-03-02T13:23:40.437-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:40.526-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15363 records 157961470 bytes) is inconsistent with full validation results (15363 records 157968425 bytes). Updating size storer with new values. 2015-03-02T13:23:40.526-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:40.529-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:41.710-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:41.873-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (18828 records 193564370 bytes) is inconsistent with full validation results (19363 records 199060425 bytes). Updating size storer with new values. 2015-03-02T13:23:41.877-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:41.879-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:41.883-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 173ms 2015-03-02T13:23:42.015-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:23:42.806-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6460.0 } } ndeleted:13102 keyUpdates:0 writeConflicts:0 numYields:105 locks:{} 916ms 2015-03-02T13:23:42.806-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6460.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 916ms 2015-03-02T13:23:42.810-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:42.950-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (8898 records 91417435 bytes) is inconsistent with full validation results (8261 records 84865253 bytes). Updating size storer with new values. 2015-03-02T13:23:42.950-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:42.957-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:42.964-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 154ms 2015-03-02T13:23:42.975-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:43.009-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (8261 records 84865253 bytes) is inconsistent with full validation results (8262 records 84865299 bytes). Updating size storer with new values. 2015-03-02T13:23:43.009-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:43.010-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:43.026-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:43.065-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:43.069-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:43.080-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:43.116-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:43.118-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:43.136-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:43.177-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:43.179-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:43.196-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:43.237-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:43.239-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:43.256-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:43.297-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:43.298-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:43.309-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:43.354-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:43.360-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:43.519-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:23:43.568-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:23:44.394-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 841.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16451 nscannedObjects:16451 nMatched:8226 nModified:8226 keyUpdates:1 writeConflicts:0 numYields:136 locks:{} 1027ms 2015-03-02T13:23:44.394-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 841.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1027ms 2015-03-02T13:23:44.399-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:44.490-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11262 records 115791224 bytes) are inconsistent with full validation results (11190 records 115051568 bytes). Updating counters with new values. 2015-03-02T13:23:44.490-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10398 records 106915352 bytes) is inconsistent with full validation results (11190 records 115051568 bytes). Updating size storer with new values. 2015-03-02T13:23:44.491-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:44.492-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:44.514-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:44.573-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11190 records 115051568 bytes) are inconsistent with full validation results (11262 records 115791224 bytes). Updating counters with new values. 2015-03-02T13:23:44.573-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11190 records 115051568 bytes) is inconsistent with full validation results (11262 records 115791224 bytes). Updating size storer with new values. 2015-03-02T13:23:44.574-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:44.575-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:45.655-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:23:45.662-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2353.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:18433 nscannedObjects:18433 nMatched:9217 nModified:9217 keyUpdates:1 writeConflicts:0 numYields:150 locks:{} 1080ms 2015-03-02T13:23:45.662-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2353.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1080ms 2015-03-02T13:23:45.663-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:45.757-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (13181 records 135517994 bytes) is inconsistent with full validation results (13262 records 136350107 bytes). Updating size storer with new values. 2015-03-02T13:23:45.757-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:45.761-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:45.768-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T13:23:45.776-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:45.845-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:45.849-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:45.862-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:23:45.936-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:23:45.938-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:23:46.969-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:23:47.196-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 131ms 2015-03-02T13:23:48.049-0500 I NETWORK [conn1] end connection 10.4.127.218:50389 (2 connections now open) 2015-03-02T13:23:48.090-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50399 #6 (3 connections now open) 2015-03-02T13:23:48.136-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:48.302-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (20180 records 207418721 bytes) is inconsistent with full validation results (20262 records 208261107 bytes). Updating size storer with new values. 2015-03-02T13:23:48.302-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:48.311-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:48.313-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 176ms 2015-03-02T13:23:48.322-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:48.366-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:48.372-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:48.385-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:48.430-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:48.434-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:49.035-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:23:49.555-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 6109.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:26215 nscannedObjects:26215 nMatched:13108 nModified:13108 keyUpdates:1 writeConflicts:0 numYields:211 locks:{} 1117ms 2015-03-02T13:23:49.555-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6109.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1117ms 2015-03-02T13:23:49.557-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:49.655-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:49.658-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:49.665-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 108ms 2015-03-02T13:23:49.673-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:49.752-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:49.755-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:50.484-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T13:23:50.911-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 6651.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:26913 nscannedObjects:26913 nMatched:13457 nModified:13457 keyUpdates:1 writeConflicts:0 numYields:213 locks:{} 1152ms 2015-03-02T13:23:50.912-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6651.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1153ms 2015-03-02T13:23:50.913-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:23:51.068-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (23262 records 239135227 bytes) are inconsistent with full validation results (22262 records 228862227 bytes). Updating counters with new values. 2015-03-02T13:23:51.068-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (22615 records 232488596 bytes) is inconsistent with full validation results (22262 records 228862227 bytes). Updating size storer with new values. 2015-03-02T13:23:51.068-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:23:51.069-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:23:51.073-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:23:51.088-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 174ms 2015-03-02T13:23:52.230-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:23:54.377-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:23:54.900-0500 W ST2015-03-02T13:24:21.900-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:24:21.917-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:24:21.917-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:24:21.917-0500 I CONTROL [initandlisten] 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:24:21.918-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:24:21.925-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:24:21.993-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:24:21.993-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:24:21.994-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:24:22.081-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:24:28.004-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50408 #1 (1 connection now open) 2015-03-02T13:24:28.029-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:24:28.108-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50409 #2 (2 connections now open) 2015-03-02T13:24:29.605-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50410 #3 (3 connections now open) 2015-03-02T13:24:29.802-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:24:29.808-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:24:29.812-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 202ms 2015-03-02T13:24:29.812-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1698ms 2015-03-02T13:24:29.812-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1782ms 2015-03-02T13:24:29.824-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:24:29.826-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:24:29.834-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:24:30.033-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:24:30.035-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:24:30.045-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:24:30.047-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:24:30.049-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:24:30.058-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:24:30.059-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 234ms 2015-03-02T13:24:30.061-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 234ms 2015-03-02T13:24:30.067-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 233ms 2015-03-02T13:24:30.073-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:24:30.274-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383333259 bytes) are inconsistent with full validation results (37299 records 383316879 bytes). Updating counters with new values. 2015-03-02T13:24:30.274-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329892 bytes) is inconsistent with full validation results (37299 records 383316879 bytes). Updating size storer with new values. 2015-03-02T13:24:30.274-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:24:30.282-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:24:30.287-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 214ms 2015-03-02T13:24:30.301-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:24:30.431-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383334195 bytes) are inconsistent with full validation results (37299 records 383336587 bytes). Updating counters with new values. 2015-03-02T13:24:30.431-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383326512 bytes) is inconsistent with full validation results (37299 records 383336587 bytes). Updating size storer with new values. 2015-03-02T13:24:30.431-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:24:30.442-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:24:30.448-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 146ms 2015-03-02T13:24:31.775-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 189ms 2015-03-02T13:24:32.313-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:24:33.155-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 200ms 2015-03-02T13:24:33.289-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4403.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:46452 nscannedObjects:46452 nMatched:23226 nModified:23226 keyUpdates:1 writeConflicts:0 numYields:386 locks:{} 3213ms 2015-03-02T13:24:33.289-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4403.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3213ms 2015-03-02T13:24:33.293-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:24:33.467-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (40299 records 414269337 bytes) are inconsistent with full validation results (40299 records 414283325 bytes). Updating counters with new values. 2015-03-02T13:24:33.467-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (40299 records 414269337 bytes) is inconsistent with full validation results (40299 records 414283325 bytes). Updating size storer with new values. 2015-03-02T13:24:33.468-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:24:33.472-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:24:33.478-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 185ms 2015-03-02T13:24:33.793-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 207ms 2015-03-02T13:24:34.585-0500 I NETWORK [conn3] end connection 10.4.127.218:50410 (2 connections now open) 2015-03-02T13:24:34.612-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50411 #4 (3 connections now open) 2015-03-02T13:24:34.661-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:24:34.835-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 204ms 2015-03-02T13:24:35.057-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434878244 bytes) are inconsistent with full validation results (41317 records 424790158 bytes). Updating counters with new values. 2015-03-02T13:24:35.057-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42299 records 434878244 bytes) is inconsistent with full validation results (41317 records 424790158 bytes). Updating size storer with new values. 2015-03-02T13:24:35.057-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:24:35.075-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:24:35.085-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 423ms 2015-03-02T13:24:36.461-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T13:24:36.822-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2723.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:53978 nscannedObjects:53978 nMatched:26989 nModified:26989 keyUpdates:1 writeConflicts:0 numYields:447 locks:{} 3342ms 2015-03-02T13:24:36.822-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2723.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3342ms 2015-03-02T13:24:36.824-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:24:37.056-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (42317 records 435063158 bytes) are inconsistent with full validation results (43299 records 445151244 bytes). Updating counters with new values. 2015-03-02T13:24:37.056-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (42317 records 435063158 bytes) is inconsistent with full validation results (43299 records 445151244 bytes). Updating size storer with new values. 2015-03-02T13:24:37.056-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:24:37.064-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:24:37.074-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 250ms 2015-03-02T13:24:40.364-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:24:41.635-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:24:42.121-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (54085 records 555955822 bytes) is inconsistent with full validation results (54299 records 558154244 bytes). Updating size storer with new values. 2015-03-02T13:24:42.121-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:24:42.128-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:24:42.132-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 497ms 2015-03-02T13:24:42.140-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:24:42.450-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:24:42.474-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:24:42.481-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 341ms 2015-03-02T13:24:42.492-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:24:42.688-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (54725 records 562530542 bytes) are inconsistent with full validation results (54299 records 558154244 bytes). Updating counters with new values. 2015-03-02T13:24:42.691-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:24:42.705-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:24:42.712-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 220ms 2015-03-02T13:24:42.727-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:24:43.019-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T13:24:43.025-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (55873 records 574323946 bytes) are inconsistent with full validation results (55262 records 568047143 bytes). Updating counters with new values. 2015-03-02T13:24:43.025-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (55659 records 572125524 bytes) is inconsistent with full validation results (55262 records 568047143 bytes). Updating size storer with new values. 2015-03-02T13:24:43.025-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:24:43.037-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:24:43.049-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 321ms 2015-03-02T13:24:46.058-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T13:24:48.071-0500 I NETWORK [conn2] end connection 10.4.127.218:50409 (2 connections now open) 2015-03-02T13:24:48.102-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50418 #5 (3 connections now open) 2015-03-02T13:24:49.765-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 4864.0 } } ndeleted:36533 keyUpdates:0 writeConflicts:0 numYields:289 locks:{} 1651ms 2015-03-02T13:24:49.765-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 4864.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1651ms 2015-03-02T13:24:49.769-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:24:50.222-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (32729 records 336225017 bytes) are inconsistent with full validation results (33766 records 346878118 bytes). Updating counters with new values. 2015-03-02T13:24:50.222-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (33476 records 343898419 bytes) is inconsistent with full validation results (33766 records 346878118 bytes). Updating size storer with new values. 2015-03-02T13:24:50.222-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:24:50.232-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:24:50.238-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 469ms 2015-03-02T13:24:50.592-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:24:50.829-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (34019 records 349477187 bytes) is inconsistent with full validation results (34766 records 357151118 bytes). Updating size storer with new values. 2015-03-02T13:24:50.830-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:24:50.835-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:24:50.837-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 244ms 2015-03-02T13:24:50.840-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:24:50.930-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:24:50.935-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:25:27.555-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:25:27.573-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:25:27.573-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:25:27.573-0500 I CONTROL [initandlisten] 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:25:27.575-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:25:27.583-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:25:27.644-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:25:27.645-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:25:27.645-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:25:27.718-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:25:27.967-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50473 #1 (1 connection now open) 2015-03-02T13:25:27.980-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:28.048-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50474 #2 (2 connections now open) 2015-03-02T13:25:29.648-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:29.654-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:29.657-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1604ms 2015-03-02T13:25:29.657-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1677ms 2015-03-02T13:25:30.468-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8039.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:15459 nscannedObjects:15459 nMatched:7715 nModified:7715 keyUpdates:1 writeConflicts:48 numYields:123 locks:{} 804ms 2015-03-02T13:25:30.469-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8039.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 804ms 2015-03-02T13:25:30.474-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:30.519-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 9100.0 } } ndeleted:1068 keyUpdates:0 writeConflicts:27 numYields:109 locks:{} 857ms 2015-03-02T13:25:30.519-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 9100.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 857ms 2015-03-02T13:25:30.522-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:25:30.576-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22229 records 228358517 bytes) are inconsistent with full validation results (23136 records 237677679 bytes). Updating counters with new values. 2015-03-02T13:25:30.576-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23023 records 236515361 bytes) is inconsistent with full validation results (23136 records 237677679 bytes). Updating size storer with new values. 2015-03-02T13:25:30.577-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:30.584-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:30.586-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T13:25:30.592-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:30.599-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23136 records 237677679 bytes) are inconsistent with full validation results (22229 records 228358517 bytes). Updating counters with new values. 2015-03-02T13:25:30.599-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23136 records 237677679 bytes) is inconsistent with full validation results (22229 records 228358517 bytes). Updating size storer with new values. 2015-03-02T13:25:30.599-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:25:30.605-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:25:30.621-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:25:30.667-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:30.674-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:30.686-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:25:30.689-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:25:30.695-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:25:30.734-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:25:30.737-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:25:31.180-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4425.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16180 nscannedObjects:16180 nMatched:8090 nModified:8090 keyUpdates:1 writeConflicts:0 numYields:126 locks:{} 438ms 2015-03-02T13:25:31.180-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4425.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 438ms 2015-03-02T13:25:31.181-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:25:31.227-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (22229 records 228452195 bytes) is inconsistent with full validation results (22229 records 228463687 bytes). Updating size storer with new values. 2015-03-02T13:25:31.228-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:25:31.240-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:25:31.251-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:25:31.306-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:25:31.309-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:25:31.803-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9520.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16180 nscannedObjects:16180 nMatched:8090 nModified:8090 keyUpdates:1 writeConflicts:0 numYields:127 locks:{} 490ms 2015-03-02T13:25:31.804-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9520.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 491ms 2015-03-02T13:25:31.806-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:25:31.871-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:25:31.877-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:25:34.559-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50475 #3 (3 connections now open) 2015-03-02T13:25:34.567-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:34.752-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (28229 records 290101687 bytes) are inconsistent with full validation results (27229 records 279828687 bytes). Updating counters with new values. 2015-03-02T13:25:34.752-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (27255 records 280095785 bytes) is inconsistent with full validation results (27229 records 279828687 bytes). Updating size storer with new values. 2015-03-02T13:25:34.752-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:34.763-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:34.765-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 197ms 2015-03-02T13:25:36.462-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 133ms 2015-03-02T13:25:36.867-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 624.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:46474 nscannedObjects:46474 nMatched:23237 nModified:23237 keyUpdates:1 writeConflicts:0 numYields:372 locks:{} 2093ms 2015-03-02T13:25:36.868-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 624.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2093ms 2015-03-02T13:25:36.874-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:36.976-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (29229 records 300571598 bytes) are inconsistent with full validation results (30229 records 310844598 bytes). Updating counters with new values. 2015-03-02T13:25:36.976-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (29229 records 300571598 bytes) is inconsistent with full validation results (30229 records 310844598 bytes). Updating size storer with new values. 2015-03-02T13:25:36.976-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:36.980-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:36.986-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T13:25:36.994-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:37.120-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:37.135-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:37.141-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 146ms 2015-03-02T13:25:37.153-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:37.240-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:37.247-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:38.035-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T13:25:39.630-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7344.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:46474 nscannedObjects:46474 nMatched:23237 nModified:23237 keyUpdates:1 writeConflicts:0 numYields:374 locks:{} 2368ms 2015-03-02T13:25:39.631-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7344.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2369ms 2015-03-02T13:25:39.633-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:39.841-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (33213 records 341499230 bytes) is inconsistent with full validation results (33229 records 341663598 bytes). Updating size storer with new values. 2015-03-02T13:25:39.841-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:39.850-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:39.876-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 242ms 2015-03-02T13:25:39.884-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:40.074-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:40.078-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:40.081-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 197ms 2015-03-02T13:25:42.201-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:25:42.595-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 3188.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:52474 nscannedObjects:52474 nMatched:26237 nModified:26237 keyUpdates:1 writeConflicts:0 numYields:423 locks:{} 2507ms 2015-03-02T13:25:42.595-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3188.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2507ms 2015-03-02T13:25:42.601-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:42.826-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (36942 records 379846247 bytes) are inconsistent with full validation results (36229 records 372521598 bytes). Updating counters with new values. 2015-03-02T13:25:42.826-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (36544 records 375757593 bytes) is inconsistent with full validation results (36229 records 372521598 bytes). Updating size storer with new values. 2015-03-02T13:25:42.827-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:42.841-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:42.857-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:25:42.861-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:42.868-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 266ms 2015-03-02T13:25:43.064-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (33780 records 347353453 bytes) are inconsistent with full validation results (37229 records 382794598 bytes). Updating counters with new values. 2015-03-02T13:25:43.064-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34201 records 351683859 bytes) is inconsistent with full validation results (37229 records 382794598 bytes). Updating size storer with new values. 2015-03-02T13:25:43.064-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:43.084-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:43.091-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 229ms 2015-03-02T13:25:44.805-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:25:45.288-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 454.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:26653 nscannedObjects:26653 nMatched:10306 nModified:10306 keyUpdates:1 writeConflicts:12032 numYields:224 locks:{} 2192ms 2015-03-02T13:25:45.288-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 454.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2192ms 2015-03-02T13:25:45.289-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:45.442-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (9812 records 100840016 bytes) are inconsistent with full validation results (9333 records 95939022 bytes). Updating counters with new values. 2015-03-02T13:25:45.444-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (9956 records 102321200 bytes) is inconsistent with full validation results (9333 records 95939022 bytes). Updating size storer with new values. 2015-03-02T13:25:45.444-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:45.451-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:45.454-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 164ms 2015-03-02T13:25:45.467-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:45.516-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (8498 records 87350212 bytes) are inconsistent with full validation results (6777 records 69648006 bytes). Updating counters with new values. 2015-03-02T13:25:45.516-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (8526 records 87638220 bytes) is inconsistent with full validation results (6777 records 69648006 bytes). Updating size storer with new values. 2015-03-02T13:25:45.516-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:45.520-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:45.662-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 5254.0 } } ndeleted:10306 keyUpdates:0 writeConflicts:1 numYields:266 locks:{} 2791ms 2015-03-02T13:25:45.662-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5254.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2791ms 2015-03-02T13:25:45.665-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:45.668-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3913.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:2000 nscannedObjects:2000 nMatched:1000 nModified:1000 keyUpdates:1 writeConflicts:0 numYields:16 locks:{} 143ms 2015-03-02T13:25:45.668-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3913.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 143ms 2015-03-02T13:25:45.671-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:45.686-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (5217 records 53614846 bytes) are inconsistent with full validation results (4632 records 47597536 bytes). Updating counters with new values. 2015-03-02T13:25:45.686-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (5516 records 56686603 bytes) is inconsistent with full validation results (4632 records 47597536 bytes). Updating size storer with new values. 2015-03-02T13:25:45.690-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:45.692-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:45.692-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:45.696-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:45.698-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:45.716-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (4464 records 45869488 bytes) are inconsistent with full validation results (4632 records 47597536 bytes). Updating counters with new values. 2015-03-02T13:25:45.718-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:45.720-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:45.762-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:45.767-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:45.780-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (3800 records 39039584 bytes) are inconsistent with full validation results (3632 records 37311536 bytes). Updating counters with new values. 2015-03-02T13:25:45.780-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (4388 records 45087752 bytes) is inconsistent with full validation results (3632 records 37311536 bytes). Updating size storer with new values. 2015-03-02T13:25:45.780-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:45.780-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:45.781-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:45.782-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:45.785-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:45.793-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:45.794-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:48.038-0500 I NETWORK [conn2] end connection 10.4.127.218:50474 (2 connections now open) 2015-03-02T13:25:48.059-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50480 #4 (3 connections now open) 2015-03-02T13:25:48.074-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:25:48.118-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (8044 records 82636012 bytes) is inconsistent with full validation results (8633 records 88676582 bytes). Updating size storer with new values. 2015-03-02T13:25:48.118-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:25:48.119-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:25:49.313-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:25:50.730-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:25:51.497-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:25:51.638-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:25:52.635-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T13:25:53.044-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:25:54.046-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:25:54.209-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:25:54.583-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:25:55.338-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:25:55.659-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:25:55.662-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:56.059-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29044 records 298358785 bytes) is inconsistent with full validation results (29633 records 304409582 bytes). Updating size storer with new values. 2015-03-02T13:25:56.059-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:56.065-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:56.068-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 405ms 2015-03-02T13:25:56.074-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:56.166-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:56.174-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:56.179-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 104ms 2015-03-02T13:25:56.191-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:56.313-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (29975 records 307922948 bytes) are inconsistent with full validation results (29633 records 304409582 bytes). Updating counters with new values. 2015-03-02T13:25:56.313-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:56.323-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:56.327-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 136ms 2015-03-02T13:25:56.336-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:56.452-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (30291 records 311169216 bytes) are inconsistent with full validation results (30287 records 311128124 bytes). Updating counters with new values. 2015-03-02T13:25:56.452-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (29702 records 305118419 bytes) is inconsistent with full validation results (30287 records 311128124 bytes). Updating size storer with new values. 2015-03-02T13:25:56.452-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:56.456-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:56.458-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 121ms 2015-03-02T13:25:56.464-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:56.640-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:25:56.642-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31287 records 321401124 bytes) are inconsistent with full validation results (30633 records 314682582 bytes). Updating counters with new values. 2015-03-02T13:25:56.642-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (30698 records 315350327 bytes) is inconsistent with full validation results (30633 records 314682582 bytes). Updating size storer with new values. 2015-03-02T13:25:56.642-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:56.646-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:56.649-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 184ms 2015-03-02T13:25:57.474-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7205.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:10772 nscannedObjects:10772 nMatched:5386 nModified:5386 keyUpdates:1 writeConflicts:0 numYields:91 locks:{} 823ms 2015-03-02T13:25:57.474-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7205.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 823ms 2015-03-02T13:25:57.478-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:25:57.590-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (30633 records 314752587 bytes) are inconsistent with full validation results (31633 records 325025587 bytes). Updating counters with new values. 2015-03-02T13:25:57.590-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (30633 records 314739925 bytes) is inconsistent with full validation results (31633 records 325025587 bytes). Updating size storer with new values. 2015-03-02T13:25:57.590-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:25:57.594-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:25:57.598-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 120ms 2015-03-02T13:25:57.852-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:57.987-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50482 #5 (4 connections now open) 2015-03-02T13:25:58.024-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (25706 records 264137516 bytes) are inconsistent with full validation results (27217 records 279660019 bytes). Updating counters with new values. 2015-03-02T13:25:58.024-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26608 records 273403762 bytes) is inconsistent with full validation results (27217 records 279660019 bytes). Updating size storer with new values. 2015-03-02T13:25:58.024-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:58.038-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:58.043-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 190ms 2015-03-02T13:25:58.052-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:25:58.059-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:25:58.213-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (25642 records 263480044 bytes) are inconsistent with full validation results (25562 records 262658204 bytes). Updating counters with new values. 2015-03-02T13:25:58.213-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (26119 records 268380265 bytes) is inconsistent with full validation results (25562 records 262658204 bytes). Updating size storer with new values. 2015-03-02T13:25:58.214-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:25:58.220-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (25479 records 261805545 bytes) are inconsistent with full validation results (25545 records 262483563 bytes). Updating counters with new values. 2015-03-02T13:25:58.220-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (25562 records 262658204 bytes) is inconsistent with full validation results (25545 records 262483563 bytes). Updating size storer with new values. 2015-03-02T13:25:58.220-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:25:58.223-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:25:58.229-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:25:58.232-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 179ms 2015-03-02T13:25:58.239-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 179ms 2015-03-02T13:25:58.938-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T13:25:59.890-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 196ms 2015-03-02T13:26:00.357-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1015.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17202 nscannedObjects:17202 nMatched:6972 nModified:6972 keyUpdates:1 writeConflicts:6529 numYields:162 locks:{} 2111ms 2015-03-02T13:26:00.357-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1015.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2112ms 2015-03-02T13:26:00.360-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:26:00.397-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T13:26:00.832-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (9328 records 95818306 bytes) are inconsistent with full validation results (11302 records 116139575 bytes). Updating counters with new values. 2015-03-02T13:26:00.832-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (10077 records 103522520 bytes) is inconsistent with full validation results (11302 records 116139575 bytes). Updating size storer with new values. 2015-03-02T13:26:00.832-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:26:00.849-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2086.0 } } ndeleted:4413 keyUpdates:0 writeConflicts:19 numYields:233 locks:{} 3248ms 2015-03-02T13:26:00.849-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2086.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3249ms 2015-03-02T13:26:00.849-0500 I NETWORK [conn1] end connection 10.4.127.218:50473 (3 connections now open) 2015-03-02T13:26:00.854-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:26:00.857-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 497ms 2015-03-02T13:26:01.533-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:26:01.862-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T13:26:01.863-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T13:26:01.866-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:01.994-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14148 records 145384771 bytes) are inconsistent with full validation results (10677 records 109684821 bytes). Updating counters with new values. 2015-03-02T13:26:01.994-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (13245 records 136108252 bytes) is inconsistent with full validation results (10677 records 109684821 bytes). Updating size storer with new values. 2015-03-02T13:26:01.994-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:01.997-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:01.999-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 133ms 2015-03-02T13:26:02.002-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:02.046-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:02.052-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:03.153-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:26:03.171-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:26:04.529-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:26:04.529-0500 I NETWORK [conn3] end connection 10.4.127.218:50475 (2 connections now open) 2015-03-02T13:26:04.568-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50483 #6 (3 connections now open) 2015-03-02T13:26:04.648-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:26:04.732-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15580 records 160053340 bytes) is inconsistent with full validation results (15067 records 154783291 bytes). Updating size storer with new values. 2015-03-02T13:26:04.732-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:26:04.736-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:26:04.746-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:26:04.820-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:26:04.824-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:26:04.840-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:26:04.956-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15067 records 154783291 bytes) is inconsistent with full validation results (15068 records 154783337 bytes). Updating size storer with new values. 2015-03-02T13:26:04.956-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:26:04.961-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:26:04.963-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 123ms 2015-03-02T13:26:04.972-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:26:05.084-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:26:05.086-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:26:05.091-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 119ms 2015-03-02T13:26:05.102-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:26:05.194-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (15068 records 154783337 bytes) is inconsistent with full validation results (15067 records 154783291 bytes). Updating size storer with new values. 2015-03-02T13:26:05.195-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:26:05.200-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:26:05.206-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 103ms 2015-03-02T13:26:05.347-0500 I WRITE [conn6] remove test.foo query: { x: { $gte: 2509.0 } } ndeleted:1372 keyUpdates:0 writeConflicts:0 numYields:10 locks:{} 136ms 2015-03-02T13:26:05.347-0500 I COMMAND [conn6] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2509.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T13:26:05.349-0500 I COMMAND [conn6] CMD: validate test.foo2015-03-02T13:26:32.847-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:26:32.870-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:26:32.870-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:26:32.870-0500 I CONTROL [initandlisten] 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:26:32.871-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:26:32.880-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:26:32.945-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:26:32.945-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:26:32.945-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:26:33.017-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:26:33.121-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50488 #1 (1 connection now open) 2015-03-02T13:26:33.135-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:34.622-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50489 #2 (2 connections now open) 2015-03-02T13:26:34.814-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:34.820-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:34.823-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 196ms 2015-03-02T13:26:34.823-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1687ms 2015-03-02T13:26:34.833-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:34.835-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:26:34.964-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:26:34.970-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:34.972-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:26:34.974-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 138ms 2015-03-02T13:26:34.977-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:34.980-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 146ms 2015-03-02T13:26:34.992-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:35.126-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (34368 records 353206716 bytes) are inconsistent with full validation results (37018 records 380430166 bytes). Updating counters with new values. 2015-03-02T13:26:35.126-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (35298 records 362760606 bytes) is inconsistent with full validation results (37018 records 380430166 bytes). Updating size storer with new values. 2015-03-02T13:26:35.126-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:35.137-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:35.139-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 146ms 2015-03-02T13:26:35.923-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 1752.0 } } ndeleted:28931 keyUpdates:0 writeConflicts:0 numYields:226 locks:{} 940ms 2015-03-02T13:26:35.923-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1752.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 940ms 2015-03-02T13:26:35.926-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:26:35.980-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (11018 records 113187914 bytes) are inconsistent with full validation results (8368 records 85964464 bytes). Updating counters with new values. 2015-03-02T13:26:35.980-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (11948 records 122743654 bytes) is inconsistent with full validation results (8368 records 85964464 bytes). Updating size storer with new values. 2015-03-02T13:26:35.980-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:26:35.987-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:26:35.993-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:26:36.008-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:26:36.009-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:26:36.013-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:26:36.028-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (8368 records 85964464 bytes) is inconsistent with full validation results (8369 records 85964510 bytes). Updating size storer with new values. 2015-03-02T13:26:36.029-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:26:36.030-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:26:39.988-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50490 #3 (3 connections now open) 2015-03-02T13:26:39.994-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:26:40.085-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (14438 records 148311347 bytes) is inconsistent with full validation results (15369 records 157875510 bytes). Updating size storer with new values. 2015-03-02T13:26:40.086-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:26:40.091-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:26:43.081-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:26:44.192-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:44.370-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23438 records 240768347 bytes) is inconsistent with full validation results (24369 records 250332510 bytes). Updating size storer with new values. 2015-03-02T13:26:44.370-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:44.373-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:44.376-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 183ms 2015-03-02T13:26:44.379-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:44.457-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:44.469-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:44.750-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7149.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5704 nscannedObjects:5704 nMatched:2852 nModified:2852 keyUpdates:1 writeConflicts:0 numYields:45 locks:{} 272ms 2015-03-02T13:26:44.750-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7149.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 272ms 2015-03-02T13:26:44.756-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:44.827-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (25369 records 260632407 bytes) is inconsistent with full validation results (25369 records 260642573 bytes). Updating size storer with new values. 2015-03-02T13:26:44.827-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:44.830-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:44.840-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:44.932-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:44.935-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:45.413-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1278.0 } } ndeleted:14233 keyUpdates:0 writeConflicts:0 numYields:111 locks:{} 473ms 2015-03-02T13:26:45.413-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1278.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 473ms 2015-03-02T13:26:45.414-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:45.451-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11152 records 114554464 bytes) is inconsistent with full validation results (11136 records 114400128 bytes). Updating size storer with new values. 2015-03-02T13:26:45.451-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:45.456-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:45.466-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:45.519-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11445 records 117574485 bytes) are inconsistent with full validation results (11136 records 114400128 bytes). Updating counters with new values. 2015-03-02T13:26:45.520-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:45.524-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:45.537-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:45.571-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11811 records 121334403 bytes) is inconsistent with full validation results (11827 records 121498771 bytes). Updating size storer with new values. 2015-03-02T13:26:45.571-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:45.573-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:45.583-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:45.632-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (11827 records 121498771 bytes) are inconsistent with full validation results (12136 records 124673128 bytes). Updating counters with new values. 2015-03-02T13:26:45.632-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (11827 records 121498771 bytes) is inconsistent with full validation results (12136 records 124673128 bytes). Updating size storer with new values. 2015-03-02T13:26:45.632-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:45.633-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:45.638-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:26:45.686-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:26:45.688-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:26:46.504-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:26:48.081-0500 I NETWORK [conn1] end connection 10.4.127.218:50488 (2 connections now open) 2015-03-02T13:26:48.114-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50494 #4 (3 connections now open) 2015-03-02T13:26:48.120-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.221-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17120 records 175873760 bytes) is inconsistent with full validation results (17136 records 176038128 bytes). Updating size storer with new values. 2015-03-02T13:26:48.221-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.223-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.224-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 104ms 2015-03-02T13:26:48.306-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.350-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15152 records 155656496 bytes) is inconsistent with full validation results (14331 records 147222363 bytes). Updating size storer with new values. 2015-03-02T13:26:48.350-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.353-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.356-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.381-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.383-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.388-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.418-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14331 records 147222363 bytes) is inconsistent with full validation results (14332 records 147222409 bytes). Updating size storer with new values. 2015-03-02T13:26:48.418-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.420-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.426-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.460-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14332 records 147222409 bytes) is inconsistent with full validation results (14331 records 147222363 bytes). Updating size storer with new values. 2015-03-02T13:26:48.460-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.462-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.471-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.505-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14331 records 147222363 bytes) is inconsistent with full validation results (14332 records 147222409 bytes). Updating size storer with new values. 2015-03-02T13:26:48.505-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.507-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.511-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.540-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.542-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.550-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.595-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14358 records 147489507 bytes) are inconsistent with full validation results (14332 records 147222409 bytes). Updating counters with new values. 2015-03-02T13:26:48.595-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.599-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.609-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.663-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (15306 records 157228311 bytes) are inconsistent with full validation results (14618 records 150160487 bytes). Updating counters with new values. 2015-03-02T13:26:48.663-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14482 records 148763359 bytes) is inconsistent with full validation results (14618 records 150160487 bytes). Updating size storer with new values. 2015-03-02T13:26:48.663-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.666-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.680-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.734-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (14618 records 150160487 bytes) are inconsistent with full validation results (15332 records 157495409 bytes). Updating counters with new values. 2015-03-02T13:26:48.734-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (14618 records 150160487 bytes) is inconsistent with full validation results (15332 records 157495409 bytes). Updating size storer with new values. 2015-03-02T13:26:48.734-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.736-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:48.740-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:48.767-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:48.769-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:49.037-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1301.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5789 nscannedObjects:5789 nMatched:2895 nModified:2895 keyUpdates:1 writeConflicts:0 numYields:46 locks:{} 265ms 2015-03-02T13:26:49.038-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1301.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 265ms 2015-03-02T13:26:49.039-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:49.102-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (15332 records 157523684 bytes) is inconsistent with full validation results (15332 records 157533031 bytes). Updating size storer with new values. 2015-03-02T13:26:49.103-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:49.105-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:49.110-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:26:49.144-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:26:49.146-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:26:51.104-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:26:52.805-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:26:53.017-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23612 records 242593471 bytes) is inconsistent with full validation results (24332 records 249990031 bytes). Updating size storer with new values. 2015-03-02T13:26:53.017-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:26:53.020-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:26:53.022-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 216ms 2015-03-02T13:26:53.027-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:26:53.137-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (24897 records 255794276 bytes) are inconsistent with full validation results (24332 records 249990031 bytes). Updating counters with new values. 2015-03-02T13:26:53.137-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (24612 records 252866471 bytes) is inconsistent with full validation results (24332 records 249990031 bytes). Updating size storer with new values. 2015-03-02T13:26:53.138-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:26:53.146-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:26:53.152-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 124ms 2015-03-02T13:26:53.160-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:26:53.315-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:26:53.324-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (25767 records 264731786 bytes) are inconsistent with full validation results (25314 records 260078117 bytes). Updating counters with new values. 2015-03-02T13:26:53.324-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (25047 records 257335226 bytes) is inconsistent with full validation results (25314 records 260078117 bytes). Updating size storer with new values. 2015-03-02T13:26:53.324-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:26:53.331-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:26:53.337-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 176ms 2015-03-02T13:26:54.344-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:26:54.432-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (27314 records 280624117 bytes) are inconsistent with full validation results (28332 records 291082031 bytes). Updating counters with new values. 2015-03-02T13:26:54.432-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (26594 records 273227557 bytes) is inconsistent with full validation results (28332 records 291082031 bytes). Updating size storer with new values. 2015-03-02T13:26:54.433-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:26:54.437-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:26:54.459-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:26:54.558-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:26:54.562-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:26:54.565-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 105ms 2015-03-02T13:26:54.570-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:26:54.652-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:26:54.656-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:26:56.533-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:26:58.015-0500 I NETWORK [conn3] end connection 10.4.127.218:50490 (2 connections now open) 2015-03-02T13:26:58.050-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50497 #5 (3 connections now open) 2015-03-02T13:26:58.269-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 9901.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6185 nscannedObjects:6185 nMatched:3093 nModified:3093 keyUpdates:1 writeConflicts:0 numYields:48 locks:{} 213ms 2015-03-02T13:26:58.269-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9901.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 213ms 2015-03-02T13:26:58.273-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:26:58.632-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (36332 records 373268605 bytes) are inconsistent with full validation results (35332 records 362995605 bytes). Updating counters with new values. 2015-03-02T13:26:58.632-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35519 records 364916656 bytes) is inconsistent with full validation results (35332 records 362995605 bytes). Updating size storer with new values. 2015-03-02T13:26:58.633-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:26:58.653-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:26:58.664-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 391ms 2015-03-02T13:26:58.673-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:26:58.824-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (35332 records 362995605 bytes) are inconsistent with full validation results (36332 records 373268605 bytes). Updating counters with new values. 2015-03-02T13:26:58.824-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (35332 records 362995605 bytes) is inconsistent with full validation results (36332 records 373268605 bytes). Updating size storer with new values. 2015-03-02T13:26:58.824-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:26:58.829-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:26:58.832-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T13:26:58.839-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:26:58.996-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 106ms 2015-03-02T13:26:59.038-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (37332 records 383541605 bytes) are inconsistent with full validation results (36332 records 373268605 bytes). Updating counters with new values. 2015-03-02T13:26:59.038-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (36519 records 375189656 bytes) is inconsistent with full validation results (36332 records 373268605 bytes). Updating size storer with new values. 2015-03-02T13:26:59.038-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:26:59.052-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:26:59.059-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 219ms 2015-03-02T13:26:59.065-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:26:59.198-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (36332 records 373268605 bytes) are inconsistent with full validation results (37332 records 383541605 bytes). Updating counters with new values. 2015-03-02T13:26:59.198-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (36332 records 373268605 bytes) is inconsistent with full validation results (37332 records 383541605 bytes). Updating size storer with new values. 2015-03-02T13:26:59.198-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:26:59.209-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:26:59.217-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T13:26:59.234-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:26:59.323-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:26:59.341-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:26:59.348-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 114ms 2015-03-02T13:27:00.325-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:27:00.544-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (39878 records 409696663 bytes) are inconsistent with full validation results (39332 records 404087605 bytes). Updating counters with new values. 2015-03-02T13:27:00.544-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (39519 records 406008656 bytes) is inconsistent with full validation results (39332 records 404087605 bytes). Updating size storer with new values. 2015-03-02T13:27:00.544-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:27:00.554-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:27:00.561-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 235ms 2015-03-02T13:27:00.579-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:27:03.036-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:27:04.385-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:27:04.628-0500 I NETWORK [conn2] end connection 10.4.127.218:50489 (2 connections now open) 2015-03-02T13:27:04.633-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50499 #6 (3 connections now open) 2015-03-02T13:27:04.644-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:27:05.319-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (49606 records 509632407 bytes) are inconsistent with full validation results (49332 records 506817605 bytes). Updating counters with new values. 2015-03-02T13:27:05.319-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (48973 records 503129598 bytes) is inconsistent with full validation results (49332 records 506817605 bytes). Updating size storer with new values. 2015-03-02T13:27:05.319-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:27:05.335-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:27:05.348-0500 I COMMAND [conn6] command test.$cmd command: validate { v2015-03-02T13:27:44.785-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:27:44.800-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:27:44.800-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:27:44.800-0500 I CONTROL [initandlisten] 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:27:44.801-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:27:44.809-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:27:44.877-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:27:44.877-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:27:44.877-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:27:44.952-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:27:48.129-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50506 #1 (1 connection now open) 2015-03-02T13:27:48.142-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:27:49.635-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50508 #2 (2 connections now open) 2015-03-02T13:27:49.827-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:27:49.833-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:27:49.836-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 197ms 2015-03-02T13:27:49.837-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1693ms 2015-03-02T13:27:51.209-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 5570.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:26202 nscannedObjects:26202 nMatched:13074 nModified:13074 keyUpdates:1 writeConflicts:94 numYields:209 locks:{} 1367ms 2015-03-02T13:27:51.209-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5570.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1368ms 2015-03-02T13:27:51.214-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:27:51.325-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (12384 records 127240786 bytes) are inconsistent with full validation results (13975 records 143605752 bytes). Updating counters with new values. 2015-03-02T13:27:51.325-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (12394 records 127343646 bytes) is inconsistent with full validation results (13975 records 143605752 bytes). Updating size storer with new values. 2015-03-02T13:27:51.325-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:27:51.333-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:27:51.338-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 124ms 2015-03-02T13:27:51.440-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:27:51.443-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2601.0 } } ndeleted:0 keyUpdates:0 writeConflicts:49 numYields:199 locks:{} 1598ms 2015-03-02T13:27:51.443-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2601.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1598ms 2015-03-02T13:27:51.446-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:27:51.477-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (10129 records 104075900 bytes) are inconsistent with full validation results (8538 records 87710874 bytes). Updating counters with new values. 2015-03-02T13:27:51.477-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10985 records 112868396 bytes) is inconsistent with full validation results (8538 records 87710874 bytes). Updating size storer with new values. 2015-03-02T13:27:51.478-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:27:51.479-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:27:51.481-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:27:51.482-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:27:51.486-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:27:51.490-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:27:51.519-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:27:51.519-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:27:51.521-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:27:51.523-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:27:51.528-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:27:51.547-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (8538 records 87710874 bytes) is inconsistent with full validation results (8539 records 87710920 bytes). Updating size storer with new values. 2015-03-02T13:27:51.548-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:27:51.550-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:27:51.554-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:27:51.580-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:27:51.582-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:27:53.063-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50509 #3 (3 connections now open) 2015-03-02T13:27:53.073-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:27:53.119-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (9681 records 99442686 bytes) is inconsistent with full validation results (10539 records 108256920 bytes). Updating size storer with new values. 2015-03-02T13:27:53.119-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:27:53.124-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:27:53.137-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:27:53.205-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (10937 records 112355801 bytes) are inconsistent with full validation results (10538 records 108256874 bytes). Updating counters with new values. 2015-03-02T13:27:53.205-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (10679 records 109705367 bytes) is inconsistent with full validation results (10538 records 108256874 bytes). Updating size storer with new values. 2015-03-02T13:27:53.205-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:27:53.212-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:27:53.259-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:27:55.904-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:27:58.025-0500 I NETWORK [conn3] end connection 10.4.127.218:50509 (2 connections now open) 2015-03-02T13:27:58.069-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50510 #4 (3 connections now open) 2015-03-02T13:27:58.080-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:27:58.338-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25139 records 258252947 bytes) are inconsistent with full validation results (25538 records 262351874 bytes). Updating counters with new values. 2015-03-02T13:27:58.338-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (24280 records 249428440 bytes) is inconsistent with full validation results (25538 records 262351874 bytes). Updating size storer with new values. 2015-03-02T13:27:58.338-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:27:58.342-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:27:58.344-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 263ms 2015-03-02T13:27:58.390-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:27:58.450-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (25397 records 260903381 bytes) is inconsistent with full validation results (24608 records 252797984 bytes). Updating size storer with new values. 2015-03-02T13:27:58.450-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:27:58.453-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:27:58.461-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:27:58.511-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:27:58.514-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:27:58.527-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:27:58.583-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:27:58.586-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:00.182-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T13:28:00.591-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 436.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:45368 nscannedObjects:45368 nMatched:22684 nModified:22684 keyUpdates:1 writeConflicts:0 numYields:363 locks:{} 2000ms 2015-03-02T13:28:00.592-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 436.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2000ms 2015-03-02T13:28:00.594-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:00.712-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26608 records 273632727 bytes) is inconsistent with full validation results (26608 records 273638876 bytes). Updating size storer with new values. 2015-03-02T13:28:00.712-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:00.716-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:00.722-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 128ms 2015-03-02T13:28:00.745-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:00.899-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:00.908-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:00.913-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 167ms 2015-03-02T13:28:00.932-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:01.002-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:01.013-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:01.035-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:01.169-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:28:01.172-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (27608 records 283911876 bytes) are inconsistent with full validation results (26608 records 273638876 bytes). Updating counters with new values. 2015-03-02T13:28:01.172-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (27135 records 279052747 bytes) is inconsistent with full validation results (26608 records 273638876 bytes). Updating size storer with new values. 2015-03-02T13:28:01.172-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:01.177-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:01.180-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 145ms 2015-03-02T13:28:01.192-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:01.319-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (26608 records 273638876 bytes) are inconsistent with full validation results (27608 records 283911876 bytes). Updating counters with new values. 2015-03-02T13:28:01.319-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26608 records 273638876 bytes) is inconsistent with full validation results (27608 records 283911876 bytes). Updating size storer with new values. 2015-03-02T13:28:01.320-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:01.326-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:01.329-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 137ms 2015-03-02T13:28:01.344-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:01.429-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:01.432-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:02.657-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 191ms 2015-03-02T13:28:02.732-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 166ms 2015-03-02T13:28:02.736-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:02.935-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:02.943-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:02.953-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 217ms 2015-03-02T13:28:04.644-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50511 #5 (4 connections now open) 2015-03-02T13:28:04.703-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 6648.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:55063 nscannedObjects:55063 nMatched:25568 nModified:25568 keyUpdates:1 writeConflicts:165 numYields:448 locks:{} 3267ms 2015-03-02T13:28:04.703-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6648.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3267ms 2015-03-02T13:28:04.706-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:28:04.709-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:04.970-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:28:04.971-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:04.982-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:28:04.982-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:04.988-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 278ms 2015-03-02T13:28:04.996-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 289ms 2015-03-02T13:28:05.019-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:05.023-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:28:05.264-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:05.264-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:28:05.273-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:05.274-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:28:05.277-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 254ms 2015-03-02T13:28:05.281-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 262ms 2015-03-02T13:28:05.299-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:28:05.507-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (29608 records 304496876 bytes) are inconsistent with full validation results (29608 records 304496681 bytes). Updating counters with new values. 2015-03-02T13:28:05.507-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (29608 records 304496876 bytes) is inconsistent with full validation results (29608 records 304496681 bytes). Updating size storer with new values. 2015-03-02T13:28:05.507-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:28:05.517-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:28:05.521-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 222ms 2015-03-02T13:28:05.699-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 170ms 2015-03-02T13:28:08.819-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 6116.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:58307 nscannedObjects:58307 nMatched:25684 nModified:25684 keyUpdates:1 writeConflicts:8244 numYields:539 locks:{} 5862ms 2015-03-02T13:28:08.819-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6116.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5862ms 2015-03-02T13:28:08.823-0500 I NETWORK [conn2] end connection 10.4.127.218:50508 (3 connections now open) 2015-03-02T13:28:08.935-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 214ms 2015-03-02T13:28:10.867-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5023.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:57403 nscannedObjects:57403 nMatched:25684 nModified:25684 keyUpdates:1 writeConflicts:6645 numYields:545 locks:{} 5581ms 2015-03-02T13:28:10.867-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5023.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5581ms 2015-03-02T13:28:10.872-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:11.287-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 210ms 2015-03-02T13:28:11.292-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:28:11.306-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (32608 records 335315681 bytes) are inconsistent with full validation results (31608 records 325042876 bytes). Updating counters with new values. 2015-03-02T13:28:11.306-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32341 records 332572790 bytes) is inconsistent with full validation results (31608 records 325042876 bytes). Updating size storer with new values. 2015-03-02T13:28:11.306-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:11.318-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:11.371-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 498ms 2015-03-02T13:28:11.397-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:11.515-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (31608 records 325042876 bytes) are inconsistent with full validation results (32608 records 335315876 bytes). Updating counters with new values. 2015-03-02T13:28:11.515-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (31608 records 325042876 bytes) is inconsistent with full validation results (32608 records 335315876 bytes). Updating size storer with new values. 2015-03-02T13:28:11.516-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:28:11.524-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:28:11.533-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 240ms 2015-03-02T13:28:11.659-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (32608 records 335324508 bytes) are inconsistent with full validation results (32608 records 335315876 bytes). Updating counters with new values. 2015-03-02T13:28:11.659-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32608 records 335323065 bytes) is inconsistent with full validation results (32608 records 335315876 bytes). Updating size storer with new values. 2015-03-02T13:28:11.659-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:11.670-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:11.679-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 281ms 2015-03-02T13:28:11.701-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:11.931-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (32608 records 335326068 bytes) are inconsistent with full validation results (32608 records 335328291 bytes). Updating counters with new values. 2015-03-02T13:28:11.931-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (32608 records 335326068 bytes) is inconsistent with full validation results (32608 records 335328291 bytes). Updating size storer with new values. 2015-03-02T13:28:11.931-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:11.942-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:11.958-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 256ms 2015-03-02T13:28:11.992-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 9528.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:54413 nscannedObjects:54413 nMatched:25684 nModified:25684 keyUpdates:1 writeConflicts:13544 numYields:553 locks:{} 6460ms 2015-03-02T13:28:11.992-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9528.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6460ms 2015-03-02T13:28:11.995-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:28:12.209-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (32608 records 335328291 bytes) are inconsistent with full validation results (32608 records 335334700 bytes). Updating counters with new values. 2015-03-02T13:28:12.209-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (32608 records 335328291 bytes) is inconsistent with full validation results (32608 records 335334700 bytes). Updating size storer with new values. 2015-03-02T13:28:12.209-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:28:12.217-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:28:12.223-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 227ms 2015-03-02T13:28:14.403-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T13:28:15.356-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8552.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:57009 nscannedObjects:57009 nMatched:27132 nModified:27132 keyUpdates:1 writeConflicts:175 numYields:470 locks:{} 3818ms 2015-03-02T13:28:15.356-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8552.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3818ms 2015-03-02T13:28:15.359-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:28:15.670-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:28:15.682-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:28:15.692-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 333ms 2015-03-02T13:28:16.803-0500 I COMMAND [conn42015-03-02T13:28:44.568-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:28:44.576-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:28:44.576-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:28:44.576-0500 I CONTROL [initandlisten] 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:28:44.580-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:28:44.585-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:28:44.644-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:28:44.644-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:28:44.644-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:28:44.736-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:28:48.160-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50519 #1 (1 connection now open) 2015-03-02T13:28:49.666-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50520 #2 (2 connections now open) 2015-03-02T13:28:49.678-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:49.900-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:28:51.724-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (38299 records 393589879 bytes) are inconsistent with full validation results (37299 records 383316879 bytes). Updating counters with new values. 2015-03-02T13:28:51.724-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37300 records 383327152 bytes) is inconsistent with full validation results (37299 records 383316879 bytes). Updating size storer with new values. 2015-03-02T13:28:51.724-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:51.729-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:51.733-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2055ms 2015-03-02T13:28:51.745-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:51.827-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383316879 bytes) are inconsistent with full validation results (38299 records 393589879 bytes). Updating counters with new values. 2015-03-02T13:28:51.827-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383316879 bytes) is inconsistent with full validation results (38299 records 393589879 bytes). Updating size storer with new values. 2015-03-02T13:28:51.827-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:51.831-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.613-0500 I WRITE [conn2] remove test.foo query: { x: { $gte: 3540.0 } } ndeleted:25355 keyUpdates:0 writeConflicts:0 numYields:198 locks:{} 771ms 2015-03-02T13:28:52.613-0500 I COMMAND [conn2] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3540.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 771ms 2015-03-02T13:28:52.616-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.669-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (14298 records 146877716 bytes) is inconsistent with full validation results (13944 records 143246712 bytes). Updating size storer with new values. 2015-03-02T13:28:52.669-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.673-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.685-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.724-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.726-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.731-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.757-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13944 records 143246712 bytes) is inconsistent with full validation results (13945 records 143246758 bytes). Updating size storer with new values. 2015-03-02T13:28:52.757-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.759-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.767-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.795-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.797-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.805-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.844-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (13945 records 143246758 bytes) is inconsistent with full validation results (13944 records 143246712 bytes). Updating size storer with new values. 2015-03-02T13:28:52.844-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.846-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.850-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.881-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.884-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.888-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.916-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.919-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:52.926-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:28:52.967-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:28:52.969-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:28:53.093-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50521 #3 (3 connections now open) 2015-03-02T13:28:53.098-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:28:53.136-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:28:53.138-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:28:56.043-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 119ms 2015-03-02T13:28:56.995-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 121ms 2015-03-02T13:28:57.728-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:28:58.056-0500 I NETWORK [conn3] end connection 10.4.127.218:50521 (2 connections now open) 2015-03-02T13:28:58.095-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50523 #4 (3 connections now open) 2015-03-02T13:28:58.105-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:58.310-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26588 records 273138524 bytes) is inconsistent with full validation results (26944 records 276795712 bytes). Updating size storer with new values. 2015-03-02T13:28:58.310-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:58.321-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:58.323-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 218ms 2015-03-02T13:28:58.331-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:58.460-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:58.472-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:58.477-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 145ms 2015-03-02T13:28:58.486-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:58.596-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:58.599-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:58.601-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 115ms 2015-03-02T13:28:58.844-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 3699.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:7806 nscannedObjects:7806 nMatched:3903 nModified:3903 keyUpdates:1 writeConflicts:0 numYields:61 locks:{} 238ms 2015-03-02T13:28:58.844-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3699.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 238ms 2015-03-02T13:28:58.847-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:58.934-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (26999 records 277411466 bytes) are inconsistent with full validation results (26944 records 276846451 bytes). Updating counters with new values. 2015-03-02T13:28:58.934-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26944 records 276843084 bytes) is inconsistent with full validation results (26944 records 276846451 bytes). Updating size storer with new values. 2015-03-02T13:28:58.934-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:58.941-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:58.948-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 101ms 2015-03-02T13:28:58.953-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:59.083-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (27889 records 286554436 bytes) are inconsistent with full validation results (27255 records 280041354 bytes). Updating counters with new values. 2015-03-02T13:28:59.083-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (27630 records 283893729 bytes) is inconsistent with full validation results (27255 records 280041354 bytes). Updating size storer with new values. 2015-03-02T13:28:59.083-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:59.096-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:28:59.103-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 150ms 2015-03-02T13:28:59.108-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:28:59.177-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (27255 records 280041354 bytes) are inconsistent with full validation results (27944 records 287119451 bytes). Updating counters with new values. 2015-03-02T13:28:59.177-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (27255 records 280041354 bytes) is inconsistent with full validation results (27944 records 287119451 bytes). Updating size storer with new values. 2015-03-02T13:28:59.177-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:28:59.196-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:29:00.253-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T13:29:00.651-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 2008.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:28080 nscannedObjects:28080 nMatched:14040 nModified:14040 keyUpdates:1 writeConflicts:0 numYields:225 locks:{} 1446ms 2015-03-02T13:29:00.651-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2008.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1447ms 2015-03-02T13:29:00.654-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:29:00.744-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:29:00.758-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:29:00.774-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 120ms 2015-03-02T13:29:02.302-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:29:02.302-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:29:02.306-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:02.577-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (34645 records 356090605 bytes) is inconsistent with full validation results (34944 records 359162232 bytes). Updating size storer with new values. 2015-03-02T13:29:02.577-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:02.585-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:02.588-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 281ms 2015-03-02T13:29:03.094-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 127ms 2015-03-02T13:29:03.097-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:03.286-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (35944 records 369511919 bytes) are inconsistent with full validation results (35944 records 369491990 bytes). Updating counters with new values. 2015-03-02T13:29:03.286-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (35944 records 369509345 bytes) is inconsistent with full validation results (35944 records 369491990 bytes). Updating size storer with new values. 2015-03-02T13:29:03.286-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:03.296-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:03.303-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 206ms 2015-03-02T13:29:03.317-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:03.489-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (35944 records 369506303 bytes) are inconsistent with full validation results (35944 records 369515000 bytes). Updating counters with new values. 2015-03-02T13:29:03.489-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (35944 records 369502416 bytes) is inconsistent with full validation results (35944 records 369515000 bytes). Updating size storer with new values. 2015-03-02T13:29:03.489-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:03.495-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:03.501-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 184ms 2015-03-02T13:29:04.431-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 228ms 2015-03-02T13:29:04.673-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50524 #5 (4 connections now open) 2015-03-02T13:29:05.971-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2868.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:54915 nscannedObjects:54915 nMatched:21040 nModified:21040 keyUpdates:1 writeConflicts:136 numYields:447 locks:{} 3381ms 2015-03-02T13:29:05.971-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2868.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3381ms 2015-03-02T13:29:05.975-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:06.306-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (36944 records 379788000 bytes) are inconsistent with full validation results (36944 records 379799232 bytes). Updating counters with new values. 2015-03-02T13:29:06.306-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (36944 records 379788000 bytes) is inconsistent with full validation results (36944 records 379799232 bytes). Updating size storer with new values. 2015-03-02T13:29:06.306-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:06.322-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:06.363-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 387ms 2015-03-02T13:29:06.407-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:06.673-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:06.690-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:06.703-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 296ms 2015-03-02T13:29:06.729-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:06.967-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:06.993-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:07.005-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 275ms 2015-03-02T13:29:07.032-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:07.292-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:07.308-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:07.318-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 285ms 2015-03-02T13:29:07.346-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:07.631-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 206ms 2015-03-02T13:29:07.634-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (37944 records 390072232 bytes) are inconsistent with full validation results (36944 records 379799232 bytes). Updating counters with new values. 2015-03-02T13:29:07.634-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37451 records 385007643 bytes) is inconsistent with full validation results (36944 records 379799232 bytes). Updating size storer with new values. 2015-03-02T13:29:07.634-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:07.644-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:07.654-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 307ms 2015-03-02T13:29:07.687-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:07.710-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 3371.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:51865 nscannedObjects:51865 nMatched:21040 nModified:21040 keyUpdates:1 writeConflicts:1394 numYields:446 locks:{} 4202ms 2015-03-02T13:29:07.710-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3371.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4202ms 2015-03-02T13:29:07.710-0500 I NETWORK [conn2] end connection 10.4.127.218:50520 (3 connections now open) 2015-03-02T13:29:07.913-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (36944 records 379799232 bytes) are inconsistent with full validation results (37944 records 390072232 bytes). Updating counters with new values. 2015-03-02T13:29:07.913-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (36944 records 379799232 bytes) is inconsistent with full validation results (37944 records 390072232 bytes). Updating size storer with new values. 2015-03-02T13:29:07.913-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:07.921-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:07.930-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 242ms 2015-03-02T13:29:08.612-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6267.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:47574 nscannedObjects:47574 nMatched:21040 nModified:21040 keyUpdates:1 writeConflicts:771 numYields:416 locks:{} 3922ms 2015-03-02T13:29:08.612-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6267.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3922ms 2015-03-02T13:29:08.617-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:29:08.807-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:29:08.816-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:29:08.836-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 218ms 2015-03-02T13:29:09.900-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 6465.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:42080 nscannedObjects:42080 nMatched:21040 nModified:21040 keyUpdates:1 writeConflicts:0 numYields:334 locks:{} 1964ms 2015-03-02T13:29:09.900-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6465.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1966ms 2015-03-02T13:29:09.902-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:10.087-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (38944 records 400345232 bytes) are inconsistent with full validation results (38585 records 396657225 bytes). Updating counters with new values. 2015-03-02T13:29:10.087-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (38485 records 395629925 bytes) is inconsistent with full validation results (38585 records 396657225 bytes). Updating size storer with new values. 2015-03-02T13:29:10.087-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:10.092-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:10.098-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 196ms 2015-03-02T13:29:11.313-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:29:14.933-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:29:15.859-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:29:18.040-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:29:18.188-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50528 #6 (4 connections now open) 2015-03-02T13:29:18.660-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (58008 records 596189704 bytes) are inconsistent with full validation results (57944 records 595532232 bytes). Updating counters with new values. 2015-03-02T13:29:18.660-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (57126 records 587128918 bytes) is inconsistent with full validation results (57944 records 595532232 bytes). Updating size storer with new values. 2015-03-02T13:29:18.660-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:29:18.677-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:29:18.683-0500 I COMMAND [conn6] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 489ms 2015-03-02T13:29:18.684-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4abfc76f1f95303f5ec51'), x: 5423.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 5 } }, Database: { acquireCount: { w: 5 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 481417 } }, Collection: { acquireCount: { w: 5 } } } 481ms 2015-03-02T13:29:18.686-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 645ms 2015-03-02T13:29:18.716-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:29:18.777-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 627ms 2015-03-02T13:29:18.778-0500 I NETWORK [conn1] end connection 10.4.127.218:50519 (3 connections now open) 2015-03-02T13:29:19.209-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (58521 records 601504135 bytes) are inconsistent with full validation results (58604 records 602314856 bytes). Updating counters with new values. 2015-03-02T13:29:19.209-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (58521 records 601492786 bytes) is inconsistent with full validation results (58604 records 602314856 bytes). Updating size storer with new values. 2015-03-02T13:29:19.209-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:29:19.226-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:29:19.236-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 519ms 2015-03-02T13:29:19.261-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:29:43.085-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:29:43.102-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:29:43.102-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:29:43.103-0500 I CONTROL [initandlisten] 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:29:43.106-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:29:43.113-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:29:43.189-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:29:43.189-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:29:43.189-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:29:43.291-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:29:48.158-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50542 #1 (1 connection now open) 2015-03-02T13:29:48.170-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:49.669-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50543 #2 (2 connections now open) 2015-03-02T13:29:49.826-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:49.832-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:49.835-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 161ms 2015-03-02T13:29:49.835-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1664ms 2015-03-02T13:29:49.843-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:49.848-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:49.978-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:49.980-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:49.983-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:49.988-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:49.989-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 145ms 2015-03-02T13:29:49.992-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 143ms 2015-03-02T13:29:50.002-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:50.005-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:50.136-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:50.139-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:50.145-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:50.146-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:50.150-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 145ms 2015-03-02T13:29:50.151-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 146ms 2015-03-02T13:29:50.164-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:50.289-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383332128 bytes) are inconsistent with full validation results (37299 records 383318348 bytes). Updating counters with new values. 2015-03-02T13:29:50.289-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329892 bytes) is inconsistent with full validation results (37299 records 383318348 bytes). Updating size storer with new values. 2015-03-02T13:29:50.289-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:50.296-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:50.301-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 137ms 2015-03-02T13:29:50.311-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:29:50.439-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383335768 bytes) are inconsistent with full validation results (37299 records 383334741 bytes). Updating counters with new values. 2015-03-02T13:29:50.439-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383329112 bytes) is inconsistent with full validation results (37299 records 383334741 bytes). Updating size storer with new values. 2015-03-02T13:29:50.439-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:29:50.443-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:29:50.448-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 137ms 2015-03-02T13:29:51.517-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 7821.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31012 nscannedObjects:31012 nMatched:15506 nModified:15506 keyUpdates:1 writeConflicts:0 numYields:247 locks:{} 1362ms 2015-03-02T13:29:51.518-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7821.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1363ms 2015-03-02T13:29:51.521-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:51.618-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383349158 bytes) are inconsistent with full validation results (37299 records 383363965 bytes). Updating counters with new values. 2015-03-02T13:29:51.618-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383349158 bytes) is inconsistent with full validation results (37299 records 383363965 bytes). Updating size storer with new values. 2015-03-02T13:29:51.618-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:51.625-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:51.632-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 110ms 2015-03-02T13:29:52.083-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 109ms 2015-03-02T13:29:53.092-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50544 #3 (3 connections now open) 2015-03-02T13:29:53.106-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 5877.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:38788 nscannedObjects:38788 nMatched:19394 nModified:19394 keyUpdates:1 writeConflicts:0 numYields:305 locks:{} 1472ms 2015-03-02T13:29:53.106-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5877.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1472ms 2015-03-02T13:29:53.111-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:53.255-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (35412 records 363991827 bytes) are inconsistent with full validation results (38057 records 391198297 bytes). Updating counters with new values. 2015-03-02T13:29:53.255-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (36198 records 372076623 bytes) is inconsistent with full validation results (38057 records 391198297 bytes). Updating size storer with new values. 2015-03-02T13:29:53.255-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:53.263-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:53.275-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T13:29:53.436-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T13:29:54.398-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 8991.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20177 nscannedObjects:20177 nMatched:10087 nModified:10087 keyUpdates:1 writeConflicts:102 numYields:164 locks:{} 1118ms 2015-03-02T13:29:54.398-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8991.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1118ms 2015-03-02T13:29:54.403-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:54.572-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (23578 records 242264589 bytes) are inconsistent with full validation results (23252 records 238901067 bytes). Updating counters with new values. 2015-03-02T13:29:54.572-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (23954 records 246121839 bytes) is inconsistent with full validation results (23252 records 238901067 bytes). Updating size storer with new values. 2015-03-02T13:29:54.572-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:54.584-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:54.587-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 183ms 2015-03-02T13:29:54.620-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:29:54.649-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 7720.0 } } ndeleted:606 keyUpdates:0 writeConflicts:62 numYields:136 locks:{} 1545ms 2015-03-02T13:29:54.649-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7720.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1545ms 2015-03-02T13:29:54.652-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:29:54.732-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (22224 records 228327013 bytes) are inconsistent with full validation results (20164 records 207148139 bytes). Updating counters with new values. 2015-03-02T13:29:54.736-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (22830 records 234550089 bytes) is inconsistent with full validation results (20164 records 207148139 bytes). Updating size storer with new values. 2015-03-02T13:29:54.736-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:29:54.743-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:29:54.749-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 128ms 2015-03-02T13:29:54.753-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (20164 records 207148139 bytes) are inconsistent with full validation results (19905 records 204484065 bytes). Updating counters with new values. 2015-03-02T13:29:54.753-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20164 records 207148139 bytes) is inconsistent with full validation results (19905 records 204484065 bytes). Updating size storer with new values. 2015-03-02T13:29:54.753-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:29:54.756-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:29:54.762-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T13:29:55.051-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T13:29:55.631-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2544.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:15906 nscannedObjects:15906 nMatched:7953 nModified:7953 keyUpdates:1 writeConflicts:0 numYields:128 locks:{} 864ms 2015-03-02T13:29:55.631-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2544.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 864ms 2015-03-02T13:29:55.633-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:29:55.741-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (20905 records 214851874 bytes) is inconsistent with full validation results (20905 records 214860454 bytes). Updating size storer with new values. 2015-03-02T13:29:55.741-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:29:55.753-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:29:55.755-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T13:29:56.347-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:29:57.397-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:29:57.599-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 782.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32862 nscannedObjects:32862 nMatched:16431 nModified:16431 keyUpdates:1 writeConflicts:0 numYields:268 locks:{} 1835ms 2015-03-02T13:29:57.599-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 782.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1836ms 2015-03-02T13:29:57.602-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:29:57.673-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:29:57.676-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:29:57.688-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:29:57.737-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:29:57.740-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:29:57.758-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:29:57.864-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24506 records 251963741 bytes) are inconsistent with full validation results (23905 records 245789668 bytes). Updating counters with new values. 2015-03-02T13:29:57.865-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:29:57.873-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:29:57.875-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 117ms 2015-03-02T13:29:57.887-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:29:57.991-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (24304 records 249888595 bytes) are inconsistent with full validation results (24819 records 255179190 bytes). Updating counters with new values. 2015-03-02T13:29:57.991-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (24213 records 248953752 bytes) is inconsistent with full validation results (24819 records 255179190 bytes). Updating size storer with new values. 2015-03-02T13:29:57.991-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:29:57.995-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:29:57.997-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 109ms 2015-03-02T13:29:58.042-0500 I NETWORK [conn3] end connection 10.4.127.218:50544 (2 connections now open) 2015-03-02T13:29:58.094-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50545 #4 (3 connections now open) 2015-03-02T13:29:58.113-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:29:58.166-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (24819 records 255179190 bytes) are inconsistent with full validation results (24905 records 256062668 bytes). Updating counters with new values. 2015-03-02T13:29:58.166-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (24819 records 255179190 bytes) is inconsistent with full validation results (24905 records 256062668 bytes). Updating size storer with new values. 2015-03-02T13:29:58.166-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:29:58.170-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:29:59.128-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 152ms 2015-03-02T13:29:59.131-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 142ms 2015-03-02T13:29:59.908-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 2733.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:34862 nscannedObjects:34862 nMatched:17431 nModified:17431 keyUpdates:1 writeConflicts:0 numYields:281 locks:{} 1726ms 2015-03-02T13:29:59.911-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2733.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1729ms 2015-03-02T13:29:59.915-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:30:00.085-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:30:00.090-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:30:00.106-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 191ms 2015-03-02T13:30:00.592-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 190ms 2015-03-02T13:30:01.169-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 215ms 2015-03-02T13:30:02.385-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 2937.0 } } ndeleted:18494 keyUpdates:0 writeConflicts:0 numYields:169 locks:{} 2271ms 2015-03-02T13:30:02.386-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2937.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 2272ms 2015-03-02T13:30:02.387-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:30:02.462-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10427 records 107116779 bytes) is inconsistent with full validation results (10411 records 106952203 bytes). Updating size storer with new values. 2015-03-02T13:30:02.462-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:30:02.470-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:30:02.477-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:30:02.499-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:30:02.500-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:30:02.850-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1893.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:6088 nscannedObjects:6088 nMatched:3044 nModified:3044 keyUpdates:1 writeConflicts:0 numYields:49 locks:{} 346ms 2015-03-02T13:30:02.850-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1893.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 346ms 2015-03-02T13:30:02.853-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:30:02.892-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (10411 records 106990995 bytes) is inconsistent with full validation results (10411 records 106991775 bytes). Updating size storer with new values. 2015-03-02T13:30:02.892-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:30:02.900-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:30:04.633-0500 I NETWORK [conn2] end connection 10.4.127.218:50543 (2 connections now open) 2015-03-02T13:30:04.671-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50547 #5 (3 connections now open) 2015-03-02T13:30:05.205-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 141ms 2015-03-02T13:30:05.330-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6431.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:10088 nscannedObjects:10088 nMatched:5044 nModified:5044 keyUpdates:1 writeConflicts:0 numYields:83 locks:{} 648ms 2015-03-02T13:30:05.330-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6431.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 648ms 2015-03-02T13:30:05.338-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:30:05.408-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T13:30:05.412-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:05.501-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17307 records 177860383 bytes) is inconsistent with full validation results (17411 records 178928775 bytes). Updating size storer with new values. 2015-03-02T13:30:05.501-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:05.501-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (17411 records 178928775 bytes) are inconsistent with full validation results (17025 records 174963397 bytes). Updating counters with new values. 2015-03-02T13:30:05.501-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17411 records 178928775 bytes) is inconsistent with full validation results (17025 records 174963397 bytes). Updating size storer with new values. 2015-03-02T13:30:05.501-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:30:05.504-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:30:05.511-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:05.515-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 176ms 2015-03-02T13:30:05.517-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 104ms 2015-03-02T13:30:05.523-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:30:05.524-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:05.614-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (17025 records 174963397 bytes) are inconsistent with full validation results (17411 records 178928775 bytes). Updating counters with new values. 2015-03-02T13:30:05.614-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (17025 records 174963397 bytes) is inconsistent with full validation results (17411 records 178928775 bytes). Updating size storer with new values. 2015-03-02T13:30:05.614-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:05.616-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:05.618-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:30:05.620-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:30:05.625-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:05.663-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:05.666-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:05.674-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:05.729-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:05.734-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:06.387-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1602.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:17466 nscannedObjects:17466 nMatched:8733 nModified:8733 keyUpdates:1 writeConflicts:0 numYields:139 locks:{} 638ms 2015-03-02T13:30:06.387-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1602.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 638ms 2015-03-02T13:30:06.391-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:06.461-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:06.472-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:07.918-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T13:30:08.342-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:30:08.926-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T13:30:11.009-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:30:12.209-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:30:14.137-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:30:14.187-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 126ms 2015-03-02T13:30:14.189-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T13:30:14.192-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:30:14.847-0500 W STORAGE [conn4] table:collection-2-2321154500689669932015-03-02T13:30:46.317-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:30:46.331-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:30:46.331-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:30:46.331-0500 I CONTROL [initandlisten] 2015-03-02T13:30:46.336-0500 I CONTROL [initandlisten] 2015-03-02T13:30:46.336-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:30:46.336-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:30:46.337-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:30:46.341-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:30:46.411-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:30:46.411-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:30:46.411-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:30:46.507-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:30:48.202-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50554 #1 (1 connection now open) 2015-03-02T13:30:49.704-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8616.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:27832 nscannedObjects:27832 nMatched:13916 nModified:13916 keyUpdates:1 writeConflicts:0 numYields:221 locks:{} 1495ms 2015-03-02T13:30:49.704-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8616.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1495ms 2015-03-02T13:30:49.706-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50555 #2 (2 connections now open) 2015-03-02T13:30:49.707-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:50.780-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:50.788-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:50.793-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1084ms 2015-03-02T13:30:50.793-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1085ms 2015-03-02T13:30:50.804-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:30:50.950-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383359961 bytes) are inconsistent with full validation results (37299 records 383344036 bytes). Updating counters with new values. 2015-03-02T13:30:50.951-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383357400 bytes) is inconsistent with full validation results (37299 records 383344036 bytes). Updating size storer with new values. 2015-03-02T13:30:50.951-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:30:50.958-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:30:50.960-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 156ms 2015-03-02T13:30:50.975-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:30:51.119-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (37299 records 383344686 bytes) are inconsistent with full validation results (37299 records 383360611 bytes). Updating counters with new values. 2015-03-02T13:30:51.119-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (37299 records 383344686 bytes) is inconsistent with full validation results (37299 records 383360611 bytes). Updating size storer with new values. 2015-03-02T13:30:51.119-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:30:51.126-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:30:51.131-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 156ms 2015-03-02T13:30:52.645-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 7950.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:30496 nscannedObjects:30496 nMatched:15248 nModified:15248 keyUpdates:1 writeConflicts:0 numYields:247 locks:{} 1846ms 2015-03-02T13:30:52.645-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7950.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1846ms 2015-03-02T13:30:52.648-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:52.789-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:52.794-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:52.804-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 155ms 2015-03-02T13:30:52.820-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:52.965-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:52.969-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:52.978-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 158ms 2015-03-02T13:30:52.993-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:53.125-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50559 #3 (3 connections now open) 2015-03-02T13:30:53.133-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:53.137-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:53.146-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T13:30:53.163-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:53.374-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:53.391-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:53.403-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 240ms 2015-03-02T13:30:53.430-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:53.679-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:53.689-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:53.697-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 266ms 2015-03-02T13:30:53.721-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:53.990-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:54.003-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:54.017-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 296ms 2015-03-02T13:30:54.039-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:54.205-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 4164.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:47886 nscannedObjects:47886 nMatched:23943 nModified:23943 keyUpdates:1 writeConflicts:0 numYields:391 locks:{} 3068ms 2015-03-02T13:30:54.205-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4164.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3068ms 2015-03-02T13:30:54.212-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:30:54.333-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:54.344-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:54.352-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 313ms 2015-03-02T13:30:54.378-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:54.476-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:30:54.490-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:30:54.498-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 286ms 2015-03-02T13:30:54.592-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:54.598-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:54.602-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 224ms 2015-03-02T13:30:56.567-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T13:30:56.698-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 8740.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:51306 nscannedObjects:51306 nMatched:23943 nModified:23943 keyUpdates:1 writeConflicts:9 numYields:429 locks:{} 3552ms 2015-03-02T13:30:56.698-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8740.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3552ms 2015-03-02T13:30:56.702-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:30:56.946-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:30:56.960-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:30:56.982-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 280ms 2015-03-02T13:30:57.669-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 8411.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:47886 nscannedObjects:47886 nMatched:23943 nModified:23943 keyUpdates:1 writeConflicts:18 numYields:396 locks:{} 3059ms 2015-03-02T13:30:57.670-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 8411.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3060ms 2015-03-02T13:30:57.676-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:57.871-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (38738 records 398256493 bytes) is inconsistent with full validation results (39299 records 404019646 bytes). Updating size storer with new values. 2015-03-02T13:30:57.875-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:57.883-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:57.896-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 220ms 2015-03-02T13:30:57.921-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:30:58.071-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:30:58.076-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:30:58.080-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 159ms 2015-03-02T13:30:58.121-0500 I NETWORK [conn3] end connection 10.4.127.218:50559 (2 connections now open) 2015-03-02T13:30:58.129-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50563 #4 (3 connections now open) 2015-03-02T13:30:58.167-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:30:58.425-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (39299 records 404051457 bytes) are inconsistent with full validation results (39299 records 404031008 bytes). Updating counters with new values. 2015-03-02T13:30:58.426-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (39299 records 404045750 bytes) is inconsistent with full validation results (39299 records 404031008 bytes). Updating size storer with new values. 2015-03-02T13:30:58.426-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:30:58.444-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:30:58.453-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 286ms 2015-03-02T13:30:58.478-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:30:58.738-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (39776 records 408955292 bytes) are inconsistent with full validation results (39299 records 404055474 bytes). Updating counters with new values. 2015-03-02T13:30:58.738-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (39333 records 404400141 bytes) is inconsistent with full validation results (39299 records 404055474 bytes). Updating size storer with new values. 2015-03-02T13:30:58.738-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:30:58.750-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:30:58.762-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 283ms 2015-03-02T13:30:58.812-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 162ms 2015-03-02T13:31:00.803-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:31:02.101-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 189ms 2015-03-02T13:31:03.619-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 160ms 2015-03-02T13:31:04.289-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 458.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:87840 nscannedObjects:87840 nMatched:37093 nModified:37093 keyUpdates:1 writeConflicts:241 numYields:736 locks:{} 6206ms 2015-03-02T13:31:04.289-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 458.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 6206ms 2015-03-02T13:31:04.294-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:31:04.588-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5941.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:74186 nscannedObjects:74186 nMatched:37093 nModified:37093 keyUpdates:1 writeConflicts:392 numYields:632 locks:{} 5814ms 2015-03-02T13:31:04.589-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5941.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5814ms 2015-03-02T13:31:04.595-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:31:04.681-0500 I NETWORK [conn2] end connection 10.4.127.218:50555 (2 connections now open) 2015-03-02T13:31:04.706-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50565 #5 (3 connections now open) 2015-03-02T13:31:04.916-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (42822 records 440362329 bytes) are inconsistent with full validation results (43299 records 445282596 bytes). Updating counters with new values. 2015-03-02T13:31:04.916-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (42822 records 440362329 bytes) is inconsistent with full validation results (43299 records 445282596 bytes). Updating size storer with new values. 2015-03-02T13:31:04.918-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:31:04.921-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:31:04.927-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:31:04.929-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:31:04.934-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 338ms 2015-03-02T13:31:04.935-0500 I COMMAND [conn5] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 222ms 2015-03-02T13:31:04.936-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 641ms 2015-03-02T13:31:04.957-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:05.300-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:05.316-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:05.330-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 372ms 2015-03-02T13:31:05.357-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:05.674-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:05.692-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:05.699-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 338ms 2015-03-02T13:31:05.722-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:05.977-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:05.988-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:05.994-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 272ms 2015-03-02T13:31:06.015-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:06.231-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:06.243-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:06.252-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 236ms 2015-03-02T13:31:06.271-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:06.594-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:06.603-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:06.617-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 346ms 2015-03-02T13:31:06.852-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T13:31:08.016-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 183ms 2015-03-02T13:31:09.889-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 7837.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:70350 nscannedObjects:70350 nMatched:35186 nModified:35186 keyUpdates:1 writeConflicts:36 numYields:586 locks:{} 4951ms 2015-03-02T13:31:09.889-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7837.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4951ms 2015-03-02T13:31:09.891-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:31:09.927-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T13:31:10.184-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (7243 records 74417561 bytes) are inconsistent with full validation results (10422 records 107121149 bytes). Updating counters with new values. 2015-03-02T13:31:10.184-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (7669 records 78799397 bytes) is inconsistent with full validation results (10422 records 107121149 bytes). Updating size storer with new values. 2015-03-02T13:31:10.185-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:31:10.202-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:31:10.212-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 320ms 2015-03-02T13:31:10.236-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:31:10.308-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (9068 records 93193905 bytes) are inconsistent with full validation results (6709 records 68924837 bytes). Updating counters with new values. 2015-03-02T13:31:10.308-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (9848 records 101216985 bytes) is inconsistent with full validation results (6709 records 68924837 bytes). Updating size storer with new values. 2015-03-02T13:31:10.308-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:31:10.313-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:31:10.319-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 1463.0 } } ndeleted:12009 keyUpdates:0 writeConflicts:27 numYields:322 locks:{} 3694ms 2015-03-02T13:31:10.319-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1463.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3694ms 2015-03-02T13:31:10.321-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:31:10.325-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:10.345-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (6489 records 66672157 bytes) are inconsistent with full validation results (5669 records 58237637 bytes). Updating counters with new values. 2015-03-02T13:31:10.345-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (6489 records 66672157 bytes) is inconsistent with full validation results (5669 records 58237637 bytes). Updating size storer with new values. 2015-03-02T13:31:10.345-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:10.346-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:10.347-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:31:10.347-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:31:10.357-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:10.389-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (5187 records 53275824 bytes) are inconsistent with full validation results (5514 records 56635095 bytes). Updating counters with new values. 2015-03-02T13:31:10.389-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (5669 records 58237637 bytes) is inconsistent with full validation results (5514 records 56635095 bytes). Updating size storer with new values. 2015-03-02T13:31:10.390-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:10.393-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:10.397-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:31:10.405-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:31:10.438-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (5465 records 56141945 bytes) are inconsistent with full validation results (5138 records 52782674 bytes). Updating counters with new values. 2015-03-02T13:31:10.438-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (5514 records 56635095 bytes) is inconsistent with full validation results (5138 records 52782674 bytes). Updating size storer with new values. 2015-03-02T13:31:10.439-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:31:10.440-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:31:10.446-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:31:10.450-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:31:10.453-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:31:10.469-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:31:10.470-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:31:13.066-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:31:13.556-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:31:14.724-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:31:14.725-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 135ms 2015-03-02T13:31:14.969-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:31:18.191-0500 I NETWORK [conn1] end connection 10.4.127.218:50554 (2 connections now open) 2015-03-02T13:31:18.229-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50567 #6 (3 connections now open) 2015-03-02T13:31:18.250-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:31:18.591-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (25138 records 258242674 bytes) are inconsistent with full validation results (25108 records 257934484 bytes). Updating counters with new values. 2015-03-02T13:31:18.591-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (24605 records 252767165 bytes) is inconsistent with full validation results (25108 records 257934484 bytes). Updating size storer with new values. 2015-03-02T13:31:18.591-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:31:18.594-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:31:18.596-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 346ms 2015-03-02T13:31:18.608-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:31:18.694-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (25108 records 257934484 bytes) are inconsistent with full validation results (25138 records 258242674 bytes). Updating counters with new values. 2015-03-02T13:31:18.694-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing data in size storer (25108 records 257934484 bytes) is inconsistent with full validation results (25138 records 258242674 bytes). Updating size storer with new values. 2015-03-02T13:31:18.695-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:31:18.701-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:31:18.717-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:31:18.844-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:31:18.847-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:31:18.849-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 132ms 2015-03-02T13:31:19.412-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 5766.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:11404 nscannedObjects:11404 nMatched:5702 nModified:5702 keyUpdates:1 writeConflicts:0 numYields:92 locks:{} 559ms 2015-03-02T13:31:19.412-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5766.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 559ms 2015-03-02T13:31:19.416-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:31:19.540-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T13:31:19.552-0500 W STORAGE [conn6] table:collection-2-2321154500689669931: Existing record and data size counters (26138 records 268589800 bytes) are inconsistent with full validation results (25138 records 258316800 bytes). Updating counters with new values. 2015-03-02T13:31:2015-03-02T13:31:53.637-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:31:53.651-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:31:53.651-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:31:53.651-0500 I CONTROL [initandlisten] 2015-03-02T13:31:53.653-0500 I CONTROL [initandlisten] 2015-03-02T13:31:53.653-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:31:53.653-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:31:53.653-0500 I CONTROL [initandlisten] 2015-03-02T13:31:53.653-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:31:53.653-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:31:53.653-0500 I CONTROL [initandlisten] 2015-03-02T13:31:53.654-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:31:53.654-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:31:53.654-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:31:53.654-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:31:53.654-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:31:53.662-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:31:53.740-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:31:53.740-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:31:53.740-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:31:53.821-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:31:58.120-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50580 #1 (1 connection now open) 2015-03-02T13:32:00.227-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50581 #2 (2 connections now open) 2015-03-02T13:32:00.236-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:32:01.739-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50583 #3 (3 connections now open) 2015-03-02T13:32:02.781-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (42299 records 434681879 bytes) are inconsistent with full validation results (40299 records 414135879 bytes). Updating counters with new values. 2015-03-02T13:32:02.781-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (41300 records 424419152 bytes) is inconsistent with full validation results (40299 records 414135879 bytes). Updating size storer with new values. 2015-03-02T13:32:02.781-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:32:02.787-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:32:02.791-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4aca164634a9fc477b541'), x: 5000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database: { acquireCount: { w: 1 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 395604 } }, Collection: { acquireCount: { w: 1 } } } 395ms 2015-03-02T13:32:02.792-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1044ms 2015-03-02T13:32:02.793-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 2557ms 2015-03-02T13:32:02.802-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:32:02.891-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 508ms 2015-03-02T13:32:02.976-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (41299 records 424408879 bytes) are inconsistent with full validation results (42329 records 434990069 bytes). Updating counters with new values. 2015-03-02T13:32:02.976-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (40300 records 414146152 bytes) is inconsistent with full validation results (42329 records 434990069 bytes). Updating size storer with new values. 2015-03-02T13:32:02.976-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:32:02.987-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:32:02.993-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 191ms 2015-03-02T13:32:04.198-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 182ms 2015-03-02T13:32:04.671-0500 I NETWORK [conn2] end connection 10.4.127.218:50581 (2 connections now open) 2015-03-02T13:32:04.706-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50584 #4 (3 connections now open) 2015-03-02T13:32:05.806-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 198ms 2015-03-02T13:32:07.243-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 149ms 2015-03-02T13:32:07.894-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 1682.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:83207 nscannedObjects:83207 nMatched:34389 nModified:34389 keyUpdates:1 writeConflicts:115 numYields:674 locks:{} 4891ms 2015-03-02T13:32:07.894-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1682.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4891ms 2015-03-02T13:32:07.900-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:32:08.566-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (46197 records 475018598 bytes) are inconsistent with full validation results (46299 records 476066444 bytes). Updating counters with new values. 2015-03-02T13:32:08.566-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (45703 records 469943736 bytes) is inconsistent with full validation results (46299 records 476066444 bytes). Updating size storer with new values. 2015-03-02T13:32:08.566-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:32:08.577-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 140ms 2015-03-02T13:32:08.580-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:32:08.582-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:08.634-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 734ms 2015-03-02T13:32:08.669-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:32:08.900-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (46431 records 477422480 bytes) are inconsistent with full validation results (47299 records 486339444 bytes). Updating counters with new values. 2015-03-02T13:32:08.900-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (46431 records 477422480 bytes) is inconsistent with full validation results (47299 records 486339444 bytes). Updating size storer with new values. 2015-03-02T13:32:08.900-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:08.919-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:08.931-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 349ms 2015-03-02T13:32:08.954-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:32:08.962-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:08.971-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:32:08.981-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 312ms 2015-03-02T13:32:09.234-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:09.244-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:09.250-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 287ms 2015-03-02T13:32:09.982-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 2018.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:68778 nscannedObjects:68778 nMatched:34389 nModified:34389 keyUpdates:1 writeConflicts:127 numYields:572 locks:{} 5248ms 2015-03-02T13:32:09.982-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2018.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5248ms 2015-03-02T13:32:09.986-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:32:10.403-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:32:10.419-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:32:10.427-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 440ms 2015-03-02T13:32:10.450-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:32:10.762-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:32:10.779-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:32:10.786-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 335ms 2015-03-02T13:32:10.810-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:32:11.053-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:32:11.063-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:32:11.078-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 268ms 2015-03-02T13:32:11.097-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:32:11.413-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:32:11.424-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:32:11.431-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 333ms 2015-03-02T13:32:11.448-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:32:11.682-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:32:11.691-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:32:11.699-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 251ms 2015-03-02T13:32:11.720-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:32:11.921-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 165ms 2015-03-02T13:32:12.124-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (48299 records 496651444 bytes) are inconsistent with full validation results (47299 records 486378444 bytes). Updating counters with new values. 2015-03-02T13:32:12.124-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (48299 records 496651444 bytes) is inconsistent with full validation results (47299 records 486378444 bytes). Updating size storer with new values. 2015-03-02T13:32:12.124-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:32:12.138-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:32:12.145-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 425ms 2015-03-02T13:32:14.015-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 175ms 2015-03-02T13:32:14.667-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4748.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:85989 nscannedObjects:85989 nMatched:37389 nModified:37389 keyUpdates:1 writeConflicts:54 numYields:700 locks:{} 5410ms 2015-03-02T13:32:14.667-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4748.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5411ms 2015-03-02T13:32:14.670-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:15.102-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (48299 records 496651444 bytes) are inconsistent with full validation results (49299 records 506924444 bytes). Updating counters with new values. 2015-03-02T13:32:15.102-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (48299 records 496651444 bytes) is inconsistent with full validation results (49299 records 506924444 bytes). Updating size storer with new values. 2015-03-02T13:32:15.102-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:15.134-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:15.154-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 484ms 2015-03-02T13:32:15.185-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:15.580-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T13:32:15.693-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (50299 records 517197444 bytes) are inconsistent with full validation results (49299 records 506924444 bytes). Updating counters with new values. 2015-03-02T13:32:15.698-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (50299 records 517197444 bytes) is inconsistent with full validation results (49299 records 506924444 bytes). Updating size storer with new values. 2015-03-02T13:32:15.698-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:15.714-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:15.729-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 543ms 2015-03-02T13:32:15.756-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:16.069-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (49299 records 506924444 bytes) are inconsistent with full validation results (50299 records 517197444 bytes). Updating counters with new values. 2015-03-02T13:32:16.072-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (49299 records 506924444 bytes) is inconsistent with full validation results (50299 records 517197444 bytes). Updating size storer with new values. 2015-03-02T13:32:16.072-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:16.082-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:16.090-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 334ms 2015-03-02T13:32:17.250-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 5418.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:74778 nscannedObjects:74778 nMatched:37389 nModified:37389 keyUpdates:1 writeConflicts:41 numYields:618 locks:{} 5100ms 2015-03-02T13:32:17.250-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5418.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 5100ms 2015-03-02T13:32:17.255-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:32:17.587-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 105ms 2015-03-02T13:32:17.617-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (52299 records 537743444 bytes) are inconsistent with full validation results (51299 records 527470444 bytes). Updating counters with new values. 2015-03-02T13:32:17.617-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (51744 records 532041929 bytes) is inconsistent with full validation results (51299 records 527470444 bytes). Updating size storer with new values. 2015-03-02T13:32:17.617-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:32:17.629-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:32:17.654-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 399ms 2015-03-02T13:32:18.204-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T13:32:18.204-0500 I NETWORK [conn3] end connection 10.4.127.218:50583 (2 connections now open) 2015-03-02T13:32:18.232-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50586 #5 (3 connections now open) 2015-03-02T13:32:18.247-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:18.544-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (53299 records 548016444 bytes) are inconsistent with full validation results (54299 records 558289444 bytes). Updating counters with new values. 2015-03-02T13:32:18.544-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (52744 records 542314929 bytes) is inconsistent with full validation results (54299 records 558289444 bytes). Updating size storer with new values. 2015-03-02T13:32:18.544-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:18.550-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:18.554-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 306ms 2015-03-02T13:32:18.567-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:18.825-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:18.839-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:18.842-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 275ms 2015-03-02T13:32:18.859-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:19.068-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:19.080-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:19.096-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 237ms 2015-03-02T13:32:20.970-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 5029.0 } } ndeleted:37389 keyUpdates:0 writeConflicts:0 numYields:295 locks:{} 1870ms 2015-03-02T13:32:20.970-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 5029.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1870ms 2015-03-02T13:32:20.975-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.202-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19854 records 203962174 bytes) is inconsistent with full validation results (18910 records 194262430 bytes). Updating size storer with new values. 2015-03-02T13:32:21.202-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.218-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.224-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 249ms 2015-03-02T13:32:21.227-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.279-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.296-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.301-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.338-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.341-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.345-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.484-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (20196 records 207473508 bytes) are inconsistent with full validation results (18910 records 194262430 bytes). Updating counters with new values. 2015-03-02T13:32:21.484-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19966 records 205110718 bytes) is inconsistent with full validation results (18910 records 194262430 bytes). Updating size storer with new values. 2015-03-02T13:32:21.484-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.487-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.492-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 147ms 2015-03-02T13:32:21.499-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.517-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:32:21.524-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 148ms 2015-03-02T13:32:21.626-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (19625 records 201597398 bytes) are inconsistent with full validation results (20473 records 210308902 bytes). Updating counters with new values. 2015-03-02T13:32:21.626-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (18910 records 194262430 bytes) is inconsistent with full validation results (20473 records 210308902 bytes). Updating size storer with new values. 2015-03-02T13:32:21.626-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.633-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.635-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 136ms 2015-03-02T13:32:21.643-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.713-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (20473 records 210308902 bytes) are inconsistent with full validation results (20911 records 214808476 bytes). Updating counters with new values. 2015-03-02T13:32:21.713-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (20473 records 210308902 bytes) is inconsistent with full validation results (20911 records 214808476 bytes). Updating size storer with new values. 2015-03-02T13:32:21.713-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.716-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.723-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.800-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.809-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.815-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:21.910-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:21.913-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:21.918-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 102ms 2015-03-02T13:32:21.926-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:22.020-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:22.026-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:22.031-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 105ms 2015-03-02T13:32:22.039-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:22.128-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:22.135-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:22.140-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 101ms 2015-03-02T13:32:22.145-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:22.230-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:22.235-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:22.481-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 4353.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:4589 nscannedObjects:4589 nMatched:2295 nModified:2295 keyUpdates:1 writeConflicts:0 numYields:36 locks:{} 237ms 2015-03-02T13:32:22.481-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4353.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 238ms 2015-03-02T13:32:22.486-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:32:22.591-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (21911 records 225108178 bytes) is inconsistent with full validation results (21911 records 225111298 bytes). Updating size storer with new values. 2015-03-02T13:32:22.594-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:32:22.596-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:32:22.604-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 118ms 2015-03-02T13:32:25.468-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:25.648-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (28670 records 294546505 bytes) is inconsistent with full validation results (28911 records 297022298 bytes). Updating size storer with new values. 2015-03-02T13:32:25.648-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:25.657-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:25.659-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 190ms 2015-03-02T13:32:25.662-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:25.729-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:25.736-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:25.748-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:25.846-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:25.851-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:25.854-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 105ms 2015-03-02T13:32:25.865-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:25.941-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:25.945-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:25.964-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:26.082-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:32:26.096-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:32:26.101-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 137ms 2015-03-02T13:32:53.028-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:32:53.048-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:32:53.048-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:32:53.048-0500 I CONTROL [initandlisten] 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:32:53.049-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:32:53.053-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:32:53.106-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:32:53.106-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:32:53.106-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:32:53.226-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:32:58.169-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50595 #1 (1 connection now open) 2015-03-02T13:32:59.483-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 6659.0 } } ndeleted:17830 keyUpdates:0 writeConflicts:0 numYields:140 locks:{} 1308ms 2015-03-02T13:32:59.483-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 6659.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1308ms 2015-03-02T13:32:59.486-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:32:59.754-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50596 #2 (2 connections now open) 2015-03-02T13:33:00.175-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50597 #3 (3 connections now open) 2015-03-02T13:33:00.265-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20298 records 208521891 bytes) is inconsistent with full validation results (19469 records 200005037 bytes). Updating size storer with new values. 2015-03-02T13:33:00.265-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:00.269-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:00.273-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 514ms 2015-03-02T13:33:00.273-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 786ms 2015-03-02T13:33:00.279-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:33:00.281-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:00.287-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:00.380-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:00.380-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:33:00.383-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:00.389-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 108ms 2015-03-02T13:33:00.384-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:33:00.391-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T13:33:00.392-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:00.398-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:33:00.400-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:00.404-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:00.406-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 119ms 2015-03-02T13:33:00.505-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (19469 records 200011706 bytes) are inconsistent with full validation results (19469 records 200005037 bytes). Updating counters with new values. 2015-03-02T13:33:00.505-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (19469 records 200007260 bytes) is inconsistent with full validation results (19469 records 200005037 bytes). Updating size storer with new values. 2015-03-02T13:33:00.510-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:00.514-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19469 records 200005960 bytes) are inconsistent with full validation results (19469 records 200005037 bytes). Updating counters with new values. 2015-03-02T13:33:00.514-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:33:00.516-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:00.518-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 117ms 2015-03-02T13:33:00.521-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:33:00.526-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 128ms 2015-03-02T13:33:00.534-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:33:00.628-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19469 records 200014865 bytes) are inconsistent with full validation results (19469 records 200014449 bytes). Updating counters with new values. 2015-03-02T13:33:00.628-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19469 records 200012668 bytes) is inconsistent with full validation results (19469 records 200014449 bytes). Updating size storer with new values. 2015-03-02T13:33:00.628-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:33:00.635-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:33:00.637-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 103ms 2015-03-02T13:33:00.646-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:33:00.749-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19469 records 200024082 bytes) are inconsistent with full validation results (19469 records 200024420 bytes). Updating counters with new values. 2015-03-02T13:33:00.749-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19469 records 200014449 bytes) is inconsistent with full validation results (19469 records 200024420 bytes). Updating size storer with new values. 2015-03-02T13:33:00.749-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:33:00.755-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:33:00.759-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 112ms 2015-03-02T13:33:00.766-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:33:00.840-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing record and data size counters (19469 records 200033546 bytes) are inconsistent with full validation results (19469 records 200033910 bytes). Updating counters with new values. 2015-03-02T13:33:00.840-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (19469 records 200025590 bytes) is inconsistent with full validation results (19469 records 200033910 bytes). Updating size storer with new values. 2015-03-02T13:33:00.841-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:33:00.846-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:33:01.696-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 3182.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16893 nscannedObjects:16893 nMatched:8241 nModified:8241 keyUpdates:1 writeConflicts:0 numYields:141 locks:{} 1276ms 2015-03-02T13:33:01.697-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 3182.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1276ms 2015-03-02T13:33:01.700-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:01.789-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (19469 records 200104864 bytes) are inconsistent with full validation results (19469 records 200112170 bytes). Updating counters with new values. 2015-03-02T13:33:01.789-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19469 records 200104864 bytes) is inconsistent with full validation results (19469 records 200112170 bytes). Updating size storer with new values. 2015-03-02T13:33:01.789-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:01.794-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:01.815-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:01.918-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:01.927-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:01.928-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 113ms 2015-03-02T13:33:01.940-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:02.032-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:02.038-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:02.088-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 9766.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16482 nscannedObjects:16482 nMatched:8241 nModified:8241 keyUpdates:1 writeConflicts:0 numYields:137 locks:{} 1231ms 2015-03-02T13:33:02.088-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9766.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1231ms 2015-03-02T13:33:02.091-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:33:02.146-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:33:02.151-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:33:04.697-0500 I NETWORK [conn2] end connection 10.4.127.218:50596 (2 connections now open) 2015-03-02T13:33:04.745-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50599 #4 (3 connections now open) 2015-03-02T13:33:04.758-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:04.898-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (24158 records 248282267 bytes) is inconsistent with full validation results (24469 records 251477170 bytes). Updating size storer with new values. 2015-03-02T13:33:04.898-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:04.901-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:04.903-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 145ms 2015-03-02T13:33:04.920-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:04.983-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:04.986-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:05.651-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 9420.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16482 nscannedObjects:16482 nMatched:8241 nModified:8241 keyUpdates:1 writeConflicts:0 numYields:131 locks:{} 650ms 2015-03-02T13:33:05.651-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9420.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 650ms 2015-03-02T13:33:05.656-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:05.730-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 102ms 2015-03-02T13:33:05.758-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (25469 records 261750170 bytes) are inconsistent with full validation results (24541 records 252216826 bytes). Updating counters with new values. 2015-03-02T13:33:05.758-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (24917 records 256079474 bytes) is inconsistent with full validation results (24541 records 252216826 bytes). Updating size storer with new values. 2015-03-02T13:33:05.758-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:05.764-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:05.774-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 118ms 2015-03-02T13:33:06.114-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 8146.0 } } ndeleted:8241 keyUpdates:0 writeConflicts:0 numYields:64 locks:{} 336ms 2015-03-02T13:33:06.114-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8146.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 337ms 2015-03-02T13:33:06.115-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.174-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (16300 records 167449900 bytes) are inconsistent with full validation results (17228 records 176983244 bytes). Updating counters with new values. 2015-03-02T13:33:06.174-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (17093 records 175606698 bytes) is inconsistent with full validation results (17228 records 176983244 bytes). Updating size storer with new values. 2015-03-02T13:33:06.174-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.178-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.192-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.245-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.248-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.259-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.316-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.319-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.324-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.370-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.376-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.852-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 600.0 } } ndeleted:11828 keyUpdates:0 writeConflicts:0 numYields:92 locks:{} 469ms 2015-03-02T13:33:06.852-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 600.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 469ms 2015-03-02T13:33:06.856-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.884-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (6021 records 61853733 bytes) is inconsistent with full validation results (5400 records 55474200 bytes). Updating size storer with new values. 2015-03-02T13:33:06.885-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.890-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.900-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.926-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.928-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.932-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.943-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.944-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.948-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.959-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.960-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.963-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:06.974-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:06.975-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:06.984-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:07.011-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:07.012-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:07.022-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:07.034-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:07.035-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:07.040-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:07.052-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:07.053-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:07.061-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:07.077-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:07.080-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:07.083-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:07.099-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:07.100-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:11.483-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:11.672-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (16400 records 168477200 bytes) are inconsistent with full validation results (15400 records 158204200 bytes). Updating counters with new values. 2015-03-02T13:33:11.672-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (15779 records 162097667 bytes) is inconsistent with full validation results (15400 records 158204200 bytes). Updating size storer with new values. 2015-03-02T13:33:11.673-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:11.675-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:11.676-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 192ms 2015-03-02T13:33:11.682-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:11.716-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (15400 records 158204200 bytes) are inconsistent with full validation results (16400 records 168477200 bytes). Updating counters with new values. 2015-03-02T13:33:11.716-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (15400 records 158204200 bytes) is inconsistent with full validation results (16400 records 168477200 bytes). Updating size storer with new values. 2015-03-02T13:33:11.716-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:11.718-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:12.604-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 721.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:20558 nscannedObjects:20558 nMatched:10279 nModified:10279 keyUpdates:1 writeConflicts:0 numYields:164 locks:{} 877ms 2015-03-02T13:33:12.604-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 721.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 877ms 2015-03-02T13:33:12.606-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:12.646-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (17400 records 178872127 bytes) is inconsistent with full validation results (17400 records 178883827 bytes). Updating size storer with new values. 2015-03-02T13:33:12.646-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:12.648-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:12.669-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:12.732-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:12.734-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:12.740-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:12.777-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:12.784-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:12.803-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:12.848-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:12.851-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:12.861-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:12.924-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:12.927-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:13.372-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 3291.0 } } ndeleted:11279 keyUpdates:0 writeConflicts:0 numYields:88 locks:{} 442ms 2015-03-02T13:33:13.373-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 3291.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 442ms 2015-03-02T13:33:13.374-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:13.421-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6300 records 64722227 bytes) is inconsistent with full validation results (6121 records 62881033 bytes). Updating size storer with new values. 2015-03-02T13:33:13.421-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:13.433-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:13.443-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:13.464-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (6681 records 68633913 bytes) are inconsistent with full validation results (6407 records 65819111 bytes). Updating counters with new values. 2015-03-02T13:33:13.468-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6121 records 62881033 bytes) is inconsistent with full validation results (6407 records 65819111 bytes). Updating size storer with new values. 2015-03-02T13:33:13.468-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:13.469-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:13.475-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:33:13.508-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (6741 records 69250293 bytes) are inconsistent with full validation results (6859 records 70462507 bytes). Updating counters with new values. 2015-03-02T13:33:13.508-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (6562 records 67411426 bytes) is inconsistent with full validation results (6859 records 70462507 bytes). Updating size storer with new values. 2015-03-02T13:33:13.508-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:33:13.509-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:33:18.243-0500 I NETWORK [conn3] end connection 10.4.127.218:50597 (2 connections now open) 2015-03-02T13:33:18.276-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50601 #5 (3 connections now open) 2015-03-02T13:33:18.288-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:33:18.448-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (17859 records 183465507 bytes) are inconsistent with full validation results (18121 records 186157033 bytes). Updating counters with new values. 2015-03-02T13:33:18.448-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (17680 records 181626640 bytes) is inconsistent with full validation results (18121 records 186157033 bytes). Updating size storer with new values. 2015-03-02T13:33:18.448-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:33:18.451-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:33:18.452-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 163ms 2015-03-02T13:33:18.460-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:33:18.537-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:33:18.539-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:33:18.544-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:33:18.580-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:33:18.582-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:33:18.846-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6239.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5522 nscannedObjects:5522 nMatched:2761 nModified:2761 keyUpdates:1 writeConflicts:0 numYields:44 locks:{} 255ms 2015-03-02T13:33:18.846-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6239.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 255ms 2015-03-02T13:33:18.849-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:33:18.911-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (19121 records 196453706 bytes) is inconsistent with full validation results (19121 records 196465926 bytes). Updating size storer with new values. 2015-03-02T13:33:18.911-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:33:18.914-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:33:19.645-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:19.709-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (19181 records 197082306 bytes) is inconsistent with full validation results (20121 records 206738926 bytes). Updating size storer with new values. 2015-03-02T13:33:19.711-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:19.715-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:19.728-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:19.767-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:19.770-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:19.778-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:19.835-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:19.838-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:20.041-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9924.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:5674 nscannedObjects:5674 nMatched:2837 nModified:2837 keyUpdates:1 writeConflicts:0 numYields:45 locks:{} 200ms 2015-03-02T13:33:20.045-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9924.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 203ms 2015-03-02T13:33:20.048-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:20.139-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (21121 records 217012914 bytes) are inconsistent with full validation results (20220 records 207756941 bytes). Updating counters with new values. 2015-03-02T13:33:20.139-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20344 records 209030793 bytes) is inconsistent with full validation results (20220 records 207756941 bytes). Updating size storer with new values. 2015-03-02T13:33:20.140-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:20.146-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:20.159-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 110ms 2015-03-02T13:33:20.171-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:20.227-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (20220 records 207756941 bytes) are inconsistent with full validation results (21121 records 217012914 bytes). Updating counters with new values. 2015-03-02T13:33:20.227-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (20220 records 207756941 bytes) is inconsistent with full validation results (21121 records 217012914 bytes). Updating size storer with new values. 2015-03-02T13:33:20.227-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:20.230-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:20.235-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:20.276-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:20.279-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:20.286-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:20.343-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:20.346-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:21.110-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 2874.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:22504 nscannedObjects:22504 nMatched:11252 nModified:11252 keyUpdates:1 writeConflicts:0 numYields:177 locks:{} 760ms 2015-03-02T13:33:21.110-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2874.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 760ms 2015-03-02T13:33:21.112-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:21.161-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:21.164-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:21.544-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 2933.0 } } ndeleted:11252 keyUpdates:0 writeConflicts:0 numYields:88 locks:{} 374ms 2015-03-02T13:33:21.544-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2933.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 374ms 2015-03-02T13:33:21.548-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:21.587-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (10150 records 104274603 bytes) is inconsistent with full validation results (9869 records 101384237 bytes). Updating size storer with new values. 2015-03-02T13:33:21.588-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:21.592-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:21.602-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:33:21.622-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:33:21.623-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:33:25.054-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:33:25.200-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (16588 records 170408524 bytes) is inconsistent with full validation results (16869 records 173295237 bytes). Updating size storer with new values. 2015-03-02T13:33:25.200-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:33:25.203-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:33:25.204-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 149ms 2015-03-02T13:33:28.174-0500 I NETWORK [conn1] end connection 10.4.127.218:50595 (2 connections now open) 2015-03-02T13:33:28.197-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50604 #6 (3 connections now open) 2015-03-02T13:33:54.600-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:33:54.616-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:33:54.616-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:33:54.616-0500 I CONTROL [initandlisten] 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:33:54.619-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:33:54.625-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:33:54.693-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:33:54.693-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:33:54.693-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:33:54.786-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:33:58.207-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50610 #1 (1 connection now open) 2015-03-02T13:34:01.698-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50611 #2 (2 connections now open) 2015-03-02T13:34:01.714-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:34:01.821-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50612 #3 (3 connections now open) 2015-03-02T13:34:03.681-0500 W STORAGE [conn2] table:collection-2-2321154500689669931: Existing data in size storer (42300 records 434692152 bytes) is inconsistent with full validation results (43299 records 444954879 bytes). Updating size storer with new values. 2015-03-02T13:34:03.682-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:34:03.687-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:34:03.690-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4ad19511c2315a06dc41b'), x: 6000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database: { acquireCount: { w: 1 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 2594213 } }, Collection: { acquireCount: { w: 1 } } } 1094ms 2015-03-02T13:34:03.692-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1861ms 2015-03-02T13:34:03.693-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1979ms 2015-03-02T13:34:03.751-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 1165ms 2015-03-02T13:34:04.697-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T13:34:04.784-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50613 #4 (4 connections now open) 2015-03-02T13:34:04.820-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:34:04.846-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 184ms 2015-03-02T13:34:04.853-0500 I NETWORK [conn2] end connection 10.4.127.218:50611 (3 connections now open) 2015-03-02T13:34:04.864-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 153ms 2015-03-02T13:34:05.100-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486046879 bytes) are inconsistent with full validation results (46760 records 480509732 bytes). Updating counters with new values. 2015-03-02T13:34:05.100-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (46300 records 475784152 bytes) is inconsistent with full validation results (46760 records 480509732 bytes). Updating size storer with new values. 2015-03-02T13:34:05.100-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:34:05.108-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:34:05.111-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 291ms 2015-03-02T13:34:05.117-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:34:05.261-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing record and data size counters (46760 records 480509732 bytes) are inconsistent with full validation results (47299 records 486046879 bytes). Updating counters with new values. 2015-03-02T13:34:05.261-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (46760 records 480509732 bytes) is inconsistent with full validation results (47299 records 486046879 bytes). Updating size storer with new values. 2015-03-02T13:34:05.261-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:34:05.266-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:34:05.270-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 152ms 2015-03-02T13:34:06.821-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:06.977-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (49300 records 506603152 bytes) is inconsistent with full validation results (50299 records 516865879 bytes). Updating size storer with new values. 2015-03-02T13:34:06.977-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:06.983-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:06.986-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 164ms 2015-03-02T13:34:06.992-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:07.101-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:07.107-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:07.114-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 122ms 2015-03-02T13:34:07.127-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:07.338-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:07.359-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:07.369-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 242ms 2015-03-02T13:34:07.562-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 103ms 2015-03-02T13:34:10.552-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T13:34:10.993-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:34:12.397-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 132ms 2015-03-02T13:34:12.473-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T13:34:14.231-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T13:34:15.555-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:16.344-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (73299 records 753144879 bytes) are inconsistent with full validation results (72299 records 742871879 bytes). Updating counters with new values. 2015-03-02T13:34:16.344-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (72300 records 742882152 bytes) is inconsistent with full validation results (72299 records 742871879 bytes). Updating size storer with new values. 2015-03-02T13:34:16.344-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:16.352-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:16.363-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 808ms 2015-03-02T13:34:16.502-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T13:34:16.506-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:34:16.877-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (73299 records 753197230 bytes) are inconsistent with full validation results (74299 records 763433635 bytes). Updating counters with new values. 2015-03-02T13:34:16.877-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (73299 records 753196892 bytes) is inconsistent with full validation results (74299 records 763433635 bytes). Updating size storer with new values. 2015-03-02T13:34:16.880-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:34:16.898-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:34:16.913-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 407ms 2015-03-02T13:34:16.942-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:34:17.357-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (74299 records 763486324 bytes) are inconsistent with full validation results (74299 records 763477731 bytes). Updating counters with new values. 2015-03-02T13:34:17.362-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (74299 records 763485297 bytes) is inconsistent with full validation results (74299 records 763477731 bytes). Updating size storer with new values. 2015-03-02T13:34:17.362-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:34:17.382-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:34:17.392-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 450ms 2015-03-02T13:34:17.436-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:34:17.913-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (74299 records 763532513 bytes) are inconsistent with full validation results (74299 records 763530979 bytes). Updating counters with new values. 2015-03-02T13:34:17.913-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (74299 records 763527664 bytes) is inconsistent with full validation results (74299 records 763530979 bytes). Updating size storer with new values. 2015-03-02T13:34:17.914-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:34:17.928-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:34:17.939-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 503ms 2015-03-02T13:34:17.964-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:34:18.316-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50615 #5 (4 connections now open) 2015-03-02T13:34:18.659-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (74299 records 763569524 bytes) are inconsistent with full validation results (74299 records 763584149 bytes). Updating counters with new values. 2015-03-02T13:34:18.659-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (74299 records 763565130 bytes) is inconsistent with full validation results (74299 records 763584149 bytes). Updating size storer with new values. 2015-03-02T13:34:18.660-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:34:18.669-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:34:18.675-0500 I COMMAND [conn5] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 350ms 2015-03-02T13:34:18.680-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 715ms 2015-03-02T13:34:18.685-0500 I NETWORK [conn3] end connection 10.4.127.218:50612 (3 connections now open) 2015-03-02T13:34:19.023-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 161ms 2015-03-02T13:34:20.275-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 6751.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:54786 nscannedObjects:54786 nMatched:27393 nModified:27393 keyUpdates:1 writeConflicts:0 numYields:450 locks:{} 3910ms 2015-03-02T13:34:20.275-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6751.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 3910ms 2015-03-02T13:34:20.280-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:20.754-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (48615 records 499718221 bytes) are inconsistent with full validation results (54781 records 563111082 bytes). Updating counters with new values. 2015-03-02T13:34:20.754-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (48691 records 500499957 bytes) is inconsistent with full validation results (54781 records 563111082 bytes). Updating size storer with new values. 2015-03-02T13:34:20.754-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:20.771-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:20.788-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 508ms 2015-03-02T13:34:22.047-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 130ms 2015-03-02T13:34:22.707-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 9684.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:16693 nscannedObjects:16693 nMatched:3860 nModified:3860 keyUpdates:1 writeConflicts:17860 numYields:148 locks:{} 1915ms 2015-03-02T13:34:22.710-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9684.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1917ms 2015-03-02T13:34:22.714-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:22.809-0500 I WRITE [conn5] remove test.foo query: { x: { $gte: 2770.0 } } ndeleted:1390 keyUpdates:0 writeConflicts:17 numYields:424 locks:{} 4128ms 2015-03-02T13:34:22.810-0500 I COMMAND [conn5] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2770.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 4129ms 2015-03-02T13:34:22.814-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:34:23.060-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (28650 records 294337856 bytes) are inconsistent with full validation results (22484 records 230978132 bytes). Updating counters with new values. 2015-03-02T13:34:23.060-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (28717 records 295016778 bytes) is inconsistent with full validation results (22484 records 230978132 bytes). Updating size storer with new values. 2015-03-02T13:34:23.060-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:34:23.061-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22484 records 230978132 bytes) are inconsistent with full validation results (23742 records 243907680 bytes). Updating counters with new values. 2015-03-02T13:34:23.061-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (22484 records 230978132 bytes) is inconsistent with full validation results (23742 records 243907680 bytes). Updating size storer with new values. 2015-03-02T13:34:23.061-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:23.076-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:23.078-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:34:23.080-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 265ms 2015-03-02T13:34:23.081-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 367ms 2015-03-02T13:34:23.087-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:23.180-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23743 records 243918672 bytes) are inconsistent with full validation results (22485 records 230979088 bytes). Updating counters with new values. 2015-03-02T13:34:23.180-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23742 records 243907680 bytes) is inconsistent with full validation results (22485 records 230979088 bytes). Updating size storer with new values. 2015-03-02T13:34:23.180-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:23.192-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:23.198-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11685 locks:{} 110ms 2015-03-02T13:34:24.676-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 1681.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:27809 nscannedObjects:27809 nMatched:13509 nModified:13509 keyUpdates:1 writeConflicts:0 numYields:223 locks:{} 1593ms 2015-03-02T13:34:24.676-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1681.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1593ms 2015-03-02T13:34:24.679-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:34:24.796-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (22485 records 231143746 bytes) are inconsistent with full validation results (22485 records 231153782 bytes). Updating counters with new values. 2015-03-02T13:34:24.796-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (22485 records 231143746 bytes) is inconsistent with full validation results (22485 records 231153782 bytes). Updating size storer with new values. 2015-03-02T13:34:24.796-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:34:24.804-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:34:24.811-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 131ms 2015-03-02T13:34:24.825-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:34:24.847-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 816.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:32554 nscannedObjects:32554 nMatched:13509 nModified:13509 keyUpdates:1 writeConflicts:0 numYields:261 locks:{} 1646ms 2015-03-02T13:34:24.847-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 816.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1646ms 2015-03-02T13:34:24.851-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:24.950-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (22998 records 236423831 bytes) are inconsistent with full validation results (22485 records 231153782 bytes). Updating counters with new values. 2015-03-02T13:34:24.950-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:34:24.960-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:34:24.967-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 141ms 2015-03-02T13:34:24.983-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (22781 records 234194590 bytes) are inconsistent with full validation results (22485 records 231153782 bytes). Updating counters with new values. 2015-03-02T13:34:24.983-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:24.986-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:34:24.993-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:24.999-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 147ms 2015-03-02T13:34:25.003-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 124ms 2015-03-02T13:34:25.015-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:25.113-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (22676 records 233115925 bytes) are inconsistent with full validation results (23329 records 239824194 bytes). Updating counters with new values. 2015-03-02T13:34:25.113-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (22590 records 232232447 bytes) is inconsistent with full validation results (23329 records 239824194 bytes). Updating size storer with new values. 2015-03-02T13:34:25.114-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:34:25.119-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:34:25.124-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 137ms 2015-03-02T13:34:25.134-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23329 records 239824194 bytes) are inconsistent with full validation results (23485 records 241426782 bytes). Updating counters with new values. 2015-03-02T13:34:25.134-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing data in size storer (23329 records 239824194 bytes) is inconsistent with full validation results (23485 records 241426782 bytes). Updating size storer with new values. 2015-03-02T13:34:25.134-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:25.138-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:34:25.143-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:25.148-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 133ms 2015-03-02T13:34:25.166-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:34:25.271-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:34:25.279-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:34:25.284-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 146ms 2015-03-02T13:34:25.325-0500 W STORAGE [conn1] table:collection-2-2321154500689669931: Existing record and data size counters (23485 records 241427926 bytes) are inconsistent with full validation results (23485 records 241426782 bytes). Updating counters with new values. 2015-03-02T13:34:25.326-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:34:25.332-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:34:25.336-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 170ms 2015-03-02T13:34:26.429-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 2364.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29018 nscannedObjects:29018 nMatched:14509 nModified:14509 keyUpdates:1 writeConflicts:0 numYields:231 locks:{} 1138ms 2015-03-02T13:34:26.429-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2364.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1138ms 2015-03-02T13:34:26.432-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:34:26.540-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing record and data size counters (23485 records 241438638 bytes) are inconsistent with full validation results (23485 records 241439782 bytes). Updating counters with new values. 2015-03-02T13:34:26.540-0500 W STORAGE [conn5] table:collection-2-2321154500689669931: Existing data in size storer (23485 records 241438638 bytes) is inconsistent with full validation results (23485 records 241439782 bytes). Updating size storer with new values. 2015-03-02T13:34:26.541-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:34:26.544-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:34:26.552-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 120ms 2015-03-02T13:34:27.702-0500 I WRITE [conn5] update test.foo query: { x: { $gte: 6374.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:29018 nscannedObjects:29018 nMatched:14509 nModified:14509 keyUpdates:1 writeConflicts:0 numYields:229 locks:{} 1148ms 2015-03-02T13:34:27.702-0500 I COMMAND [conn5] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6374.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1148ms 2015-03-02T13:34:27.704-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T13:34:27.790-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T13:34:27.794-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T13:34:28.171-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:34:28.218-0500 I NETWORK [conn1] end connection 10.4.127.218:50610 (2 connections now open) 2015-03-02T13:34:28.235-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50617 #6 (3 connections now open) 2015-03-02T13:34:28.268-0500 W STORAGE [conn4] table:collection-2-2321154500689669931: Existing data in size storer (26381 records 271190390 bytes) is inconsistent with full validation results (26485 records 272258782 bytes). Updating size storer with new values. 2015-03-02T13:34:28.268-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T13:34:28.271-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T13:34:28.274-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11689 locks:{} 102ms 2015-03-02T13:34:28.281-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:34:28.373-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:34:28.379-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:34:28.388-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:34:28.482-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:34:28.485-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:34:29.961-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6961.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:31018 nscannedObjects:31018 nMatched:15509 nModified:15509 keyUpdates:1 writeConflicts:0 numYields:254 locks:{} 1470ms 2015-03-02T13:34:29.962-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6961.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1470ms 2015-03-02T13:34:29.965-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:34:30.041-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:34:30.045-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:34:30.070-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:34:30.143-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:34:30.148-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:34:30.171-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T13:34:30.246-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T13:34:30.250-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T13:35:00.925-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:35:00.941-0500 I CONTROL [initandlisten] MongoDB starting : pid=1275 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:35:00.941-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:35:00.941-0500 I CONTROL [initandlisten] 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:35:00.945-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:35:00.952-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:35:01.019-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:35:01.019-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:35:01.019-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:35:01.116-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:35:03.323-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50626 #1 (1 connection now open) 2015-03-02T13:35:03.334-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:35:04.802-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50630 #2 (2 connections now open) 2015-03-02T13:35:05.011-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:35:05.017-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:35:05.021-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 214ms 2015-03-02T13:35:05.021-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1686ms 2015-03-02T13:35:05.029-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:35:05.101-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:35:05.105-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:35:08.252-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50632 #3 (3 connections now open) 2015-03-02T13:35:08.276-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:35:08.558-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:35:08.568-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (45299 records 465500879 bytes) are inconsistent with full validation results (44299 records 455227879 bytes). Updating counters with new values. 2015-03-02T13:35:08.568-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (44300 records 455238152 bytes) is inconsistent with full validation results (44299 records 455227879 bytes). Updating size storer with new values. 2015-03-02T13:35:08.568-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:35:08.574-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:35:08.577-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 301ms 2015-03-02T13:35:09.210-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 159ms 2015-03-02T13:35:10.136-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 129ms 2015-03-02T13:35:10.577-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 143ms 2015-03-02T13:35:10.753-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 6109.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:37860 nscannedObjects:37860 nMatched:18930 nModified:18930 keyUpdates:1 writeConflicts:0 numYields:308 locks:{} 2168ms 2015-03-02T13:35:10.753-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6109.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2168ms 2015-03-02T13:35:10.755-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T13:35:10.920-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing record and data size counters (47299 records 486138477 bytes) are inconsistent with full validation results (48299 records 496411477 bytes). Updating counters with new values. 2015-03-02T13:35:10.920-0500 W STORAGE [conn3] table:collection-2-2321154500689669931: Existing data in size storer (47299 records 486138477 bytes) is inconsistent with full validation results (48299 records 496411477 bytes). Updating size storer with new values. 2015-03-02T13:35:10.920-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T13:35:10.926-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T13:35:10.938-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 182ms 2015-03-02T13:35:11.278-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:278138][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.303-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:303119][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.325-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:325068][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.342-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:342295][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.358-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:358837][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.374-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:374029][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.384-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:384789][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.393-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:393292][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.402-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:402088][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.415-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:415089][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.435-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:435059][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.449-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:449066][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.456-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:456339][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.461-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:460997][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.465-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:465746][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.470-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:470495][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.475-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:475195][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.479-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:479755][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.484-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:484324][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.489-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:489286][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.494-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:494348][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.518-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:518093][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.530-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:530682][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.547-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:547142][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.562-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:562177][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.580-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:580090][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.596-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:596161][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.611-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:611039][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.625-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:625109][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.635-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:635102][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.641-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:641472][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.646-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:646510][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.651-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:651186][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.656-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:656172][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.661-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:661095][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.666-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:666449][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.671-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:671780][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.677-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:677056][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.682-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:682567][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.705-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:705047][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.718-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:718452][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.723-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:723569][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.728-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:728154][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.732-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:732772][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.737-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:737353][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.742-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:742081][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.746-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:746839][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.751-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:751559][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.756-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:756213][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.777-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:777131][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.792-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:792129][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.804-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:804286][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.818-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:818275][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.829-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:829277][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.834-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:834517][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.841-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:841352][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.846-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:846594][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.851-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:851624][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.864-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:864080][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.872-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:872535][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.877-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:877563][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.882-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:882852][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.887-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:887740][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.892-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:892607][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.897-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:897331][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.902-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:902055][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.906-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:906704][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.911-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:911205][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.916-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:916465][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.921-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:921745][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.927-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:927219][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.932-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:932278][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.937-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:937611][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.942-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:942784][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.948-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:948080][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.953-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:953258][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.958-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:958348][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.963-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:963099][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.967-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:967716][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.972-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:972538][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.977-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:977167][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.981-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:981742][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.986-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:986288][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.990-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:990844][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:11.995-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:995434][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.000-0500 E STORAGE [conn1] WiredTiger (28) [1425321311:999993][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.004-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:4463][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.009-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:9012][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.013-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:13568][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.018-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:18098][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.022-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:22660][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.027-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:27283][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.041-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:41345][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.051-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:51466][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.061-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:61586][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.067-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:67730][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.081-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:81968][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.091-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:91967][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.099-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:99367][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.112-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:112070][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.120-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:120501][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.125-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:125209][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.129-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:129803][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.134-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:134842][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.139-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:139853][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.144-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:144601][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.149-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:149135][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.153-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:153819][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.158-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:158309][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.163-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:163479][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.168-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:168767][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.174-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:173994][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.179-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:179872][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.180-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084abb'), x: 4000.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 369ms 2015-03-02T13:35:12.185-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:185423][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.190-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:190493][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.195-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:195884][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.201-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:201096][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.206-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:206261][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.211-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:211349][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.216-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:216307][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.221-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:221432][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.226-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:226314][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.230-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:230865][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.235-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:235971][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.240-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:240793][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.245-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:245499][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.250-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:250092][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.254-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:254701][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.259-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:259236][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.263-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:263774][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.268-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:268324][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.272-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:272885][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.277-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:277488][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.282-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:282407][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.282-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4ad5e15176b70e210c29b'), x: 7132.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 103ms 2015-03-02T13:35:12.287-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:287057][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.291-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:291557][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.296-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:296280][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.301-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:301073][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.305-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:305638][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.310-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:310236][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.314-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:314701][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.319-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:319515][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.324-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:324120][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.329-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:329388][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.334-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:334144][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.338-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:338764][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.343-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:343219][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.347-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:347707][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.352-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:352157][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.357-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:356990][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.361-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:361550][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.366-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:366303][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.371-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:371220][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.376-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:376244][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.381-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:381026][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.385-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:385792][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.390-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:390498][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.395-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:395208][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.399-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:399770][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.404-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:404353][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.409-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:408990][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.413-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:413428][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.418-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:418002][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.422-0500 E STORAGE [conn1] WiredTiger (28) [1425321312:422492][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.427-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:427327][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.427-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084ad0'), x: 4021.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 147ms 2015-03-02T13:35:12.431-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:431922][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.436-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:436636][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.450-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:450055][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.461-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:461098][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.469-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:469080][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.479-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:479442][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.490-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:490055][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.498-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:498251][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.509-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:509295][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.517-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:517615][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.522-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:522503][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.527-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:527079][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.531-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:531726][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.536-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:536679][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.541-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:541701][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.546-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:546403][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.550-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:550940][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.555-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:555417][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.559-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:559964][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.564-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:564466][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.569-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:569149][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.573-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:573851][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.578-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:578516][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.583-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:583273][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.587-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:587880][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.592-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:592588][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.597-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:597326][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.601-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:601821][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.606-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:606398][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.610-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:610951][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.615-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:615626][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.620-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:620330][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.624-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:624811][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.629-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:629474][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.634-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:634082][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.638-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:638818][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.643-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:643456][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.648-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:648525][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.653-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:653259][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.657-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:657772][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.662-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:662375][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.666-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:666934][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.672-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:671995][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.676-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:676659][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.681-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:681324][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.685-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:685868][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.690-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:690520][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.695-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:695095][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.699-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:699647][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.704-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:704171][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.708-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:708725][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.713-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:713348][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.717-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:717797][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.722-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:722434][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.726-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:726975][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.731-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:731562][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.736-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:736067][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.740-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:740698][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.745-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:745877][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.750-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:750432][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.755-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:755149][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.759-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:759723][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.764-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:764416][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.769-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:769340][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.774-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:774086][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.779-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:779652][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.784-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:784277][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.788-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:788844][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.793-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:793416][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.798-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:798067][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.802-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:802635][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.807-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:807266][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.812-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:812043][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.816-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:816784][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.821-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:821414][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.826-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:825996][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.830-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:830552][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.835-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:835166][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.839-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:839750][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.845-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:845146][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.850-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:850138][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.854-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:854708][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.859-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:859300][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.863-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:863821][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.868-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:868775][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.874-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:874740][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.879-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:879822][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.885-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:885003][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.889-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:889753][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.894-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:894509][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.899-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:899212][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.903-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:903854][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.908-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:908644][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.913-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:913275][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.918-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:918148][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.922-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:922942][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.927-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:927683][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.932-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:932365][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.937-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:937009][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.941-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:941709][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.946-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:946554][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.951-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:951424][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.956-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:956666][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.961-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:961369][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.966-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:966005][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.970-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:970769][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.975-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:975786][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.980-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:980596][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.985-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:985236][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.989-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:989967][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.994-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:994678][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:12.999-0500 E STORAGE [conn2] WiredTiger (28) [1425321312:999405][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.004-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:4027][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.008-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:8620][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.013-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:13278][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.017-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:17897][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.022-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:22530][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.027-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:27169][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.031-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:31768][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.037-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:37132][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.043-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:43488][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.048-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:48445][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.053-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:53291][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.058-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:58577][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.063-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:63262][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.068-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:68078][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.072-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:72742][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.077-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:77349][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.081-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:81970][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.086-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:86568][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.091-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:91519][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.096-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:96435][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.101-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:101191][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.105-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:105961][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.110-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:110623][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.115-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:115265][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.119-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:119940][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.124-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:124590][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.129-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:129175][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.133-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:133744][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.139-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:139816][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.144-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:144425][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.149-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:149058][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.153-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:153973][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.158-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:158787][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.163-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:163500][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.168-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:168106][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.173-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:173111][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.178-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:178459][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.184-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:184116][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.190-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:190231][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.195-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:195642][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.200-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:200813][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.206-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:206195][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.212-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:211989][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.212-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f4ad5fa9e1c8ff3d0394f9'), x: 0.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 694ms 2015-03-02T13:35:13.217-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:217489][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.222-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:222757][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.227-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:227926][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.233-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:233157][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.238-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:238278][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.243-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:243522][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.248-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:248910][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.254-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:254483][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.260-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:260368][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.265-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:265657][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.271-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:271290][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.278-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:278300][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.282-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:282917][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.289-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:289325][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.294-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:294923][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.299-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:299792][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.304-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:304807][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.309-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:309568][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.314-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:314213][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.318-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:318971][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.323-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:323769][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.328-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:328503][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.333-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:333239][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.338-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:337995][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.343-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:342990][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.347-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:347477][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.352-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:352150][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.356-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:356823][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.362-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:362106][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.366-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:366675][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.371-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:371547][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.376-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:376358][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.381-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:381183][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.386-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:386030][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.390-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:390839][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.395-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:395658][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.400-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:400432][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.405-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:405092][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.409-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:409708][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.414-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:414329][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.419-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:419031][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.423-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:423630][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.428-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:428325][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.432-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:432917][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.437-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:437439][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.442-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:442199][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.446-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:446960][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.451-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:451820][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.456-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:456626][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.461-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:461284][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.466-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:466382][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.471-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:471130][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.475-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:475652][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.481-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:481124][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.485-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:485725][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.490-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:490203][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.494-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:494836][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.499-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:499423][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.503-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:503972][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.508-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:508563][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.513-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:513128][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.517-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:517720][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.522-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:522225][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.526-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:526774][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.531-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:531251][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.535-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:535768][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.540-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:540381][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.544-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:544868][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.549-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:549556][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.554-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:554202][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.558-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:558804][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.563-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:563319][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.567-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:567910][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.572-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:572643][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.577-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:577375][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.582-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:582218][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.586-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:586861][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.592-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:592861][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.598-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:598569][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.603-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:603505][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.608-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:608365][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.613-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:613070][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.617-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:617707][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.622-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:622379][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.627-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:626970][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.631-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:631626][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.636-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:636221][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.640-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:640747][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.645-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:645342][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.649-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:649821][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.654-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:654466][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.659-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:659002][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.663-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:663712][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.669-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:669010][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.673-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:673700][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.678-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:678269][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.682-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:682802][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.687-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:687409][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.691-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:691920][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.696-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:696551][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.701-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:701428][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.706-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:706170][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.710-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:710845][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.715-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:715476][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.719-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:719961][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.724-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:724550][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.729-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:729144][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.733-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:733639][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.738-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:738163][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.742-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:742679][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.747-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:747204][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.751-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:751668][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.756-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:756165][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.760-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:760675][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.765-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:765247][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.770-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:770629][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.775-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:775786][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.780-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:780440][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.785-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:785132][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.789-0500 E STORAGE [conn3] WiredTiger (28) [1425321313:789592][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.794-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:794490][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.794-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084b6b'), x: 4176.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 585ms 2015-03-02T13:35:13.799-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:799220][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.803-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:803789][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.808-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:808723][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.813-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:813405][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.818-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:817983][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.822-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:822601][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.827-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:827044][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.831-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:831635][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.836-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:836082][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.840-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:840602][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.845-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:845128][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.849-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:849712][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.854-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:854219][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.858-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:858701][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.863-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:863314][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.868-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:868394][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.873-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:873683][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.878-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:878746][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.883-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:883905][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.889-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:889721][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.894-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:894564][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.899-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:899241][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.903-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:903938][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.908-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:908667][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.913-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:913436][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.918-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:918043][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.922-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:922822][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.927-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:927541][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.932-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:932182][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.936-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:936900][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.941-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:941536][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.946-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:946305][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.951-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:951009][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.955-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:955712][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.960-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:960238][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.964-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:964880][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.969-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:969655][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.974-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:974642][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.979-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:979443][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.984-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:984875][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.989-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:989685][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.994-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:994619][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:13.999-0500 E STORAGE [conn2] WiredTiger (28) [1425321313:999288][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.004-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:4030][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.008-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:8850][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.013-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:13492][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.018-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:18052][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.022-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:22670][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.027-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:27301][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.032-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:32198][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.037-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:36981][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.041-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:41678][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.046-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:46376][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.051-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:51049][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.055-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:55632][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.060-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:60359][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.065-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:65006][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.069-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:69881][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.074-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:74848][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.080-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:80257][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.084-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:84928][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.089-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:89932][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.094-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:94809][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.099-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:99536][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.104-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:104175][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.108-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:108789][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.113-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:113546][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.118-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:118288][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.122-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:122940][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.127-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:127740][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.132-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:132417][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.137-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:137101][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.142-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:141983][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.146-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:146633][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.151-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:151282][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.156-0500 E STORAGE [conn2] WiredTiger (28) [1425321314:156012][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.160-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:160834][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.161-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4ad5e15176b70e210c2ba'), x: 7163.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 1734ms 2015-03-02T13:35:14.165-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:165499][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.170-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:170185][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.174-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:174875][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.179-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:179642][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.184-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:184241][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.188-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:188931][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.193-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:193697][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.198-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:198363][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.203-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:203011][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.208-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:208242][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.213-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:213127][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.218-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:218093][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.222-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:222617][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.227-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:227115][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.231-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:231781][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.236-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:236496][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.241-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:241102][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.245-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:245635][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.250-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:250202][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.254-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:254707][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.259-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:259225][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.263-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:263862][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.268-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:268428][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.273-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:273181][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.277-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:277837][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.282-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:282933][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.287-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:287517][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.292-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:292095][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.296-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:296656][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.301-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:301283][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.305-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:305839][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.310-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:310381][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.314-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:314938][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.319-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:319545][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.324-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:324192][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.328-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:328756][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.333-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:333503][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.337-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:337963][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.342-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:342486][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.346-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:346905][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.351-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:351439][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.355-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:355964][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.361-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:361366][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.365-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:365954][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.370-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:370688][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.375-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:375337][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.380-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:380152][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.384-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:384747][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.389-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:389237][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.393-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:393798][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.398-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:398314][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.402-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:402854][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.407-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:407312][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.411-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:411890][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.418-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:418491][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.424-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:424103][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.429-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:429094][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.433-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:433644][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.438-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:438186][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.442-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:442653][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.447-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:447210][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.451-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:451960][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.456-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:456525][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.461-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:461110][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.465-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:465586][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.470-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:470395][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.475-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:475034][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.479-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:479617][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.484-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:484606][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.489-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:489726][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.494-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:494380][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.499-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:499022][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.503-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:503615][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.508-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:508124][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.512-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:512688][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.517-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:517213][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.521-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:521783][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.526-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:526208][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.530-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:530789][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.535-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:535309][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.539-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:539896][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.544-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:544286][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.548-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:548886][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.553-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:553529][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.558-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:558093][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.562-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:562615][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.567-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:567162][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.572-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:572243][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.577-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:577136][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.583-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:583424][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.588-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:588872][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.593-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:593544][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.598-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:598162][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.602-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:602754][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.607-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:607260][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.612-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:612418][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.617-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:617009][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.621-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:621776][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.626-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:626401][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.631-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:631069][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.635-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:635638][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.640-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:640166][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.644-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:644767][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.649-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:649339][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.653-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:653900][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.658-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:658406][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.663-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:663037][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.667-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:667530][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.672-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:672238][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.676-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:676739][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.681-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:681266][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.685-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:685869][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.690-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:690913][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.695-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:695461][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.700-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:699996][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.704-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:704526][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.709-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:709066][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.713-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:713580][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.718-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:718184][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.722-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:722713][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.727-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:727378][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.731-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:731902][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.736-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:736559][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.741-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:741126][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.745-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:745643][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.750-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:750177][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.754-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:754716][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.759-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:759281][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.763-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:763702][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.768-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:768478][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.773-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:773284][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.778-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:778973][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.783-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:783651][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.788-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:788249][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.793-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:793064][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.798-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:798281][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.802-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:802922][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.807-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:807451][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.812-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:812018][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.816-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:816533][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.821-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:821232][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.825-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:825740][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.830-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:830240][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.834-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:834804][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.839-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:839367][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.844-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:843996][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.848-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:848583][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.853-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:853094][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.857-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:857618][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.862-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:862225][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.866-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:866741][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.873-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:873624][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.878-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:878487][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.883-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:883161][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.888-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:888116][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.893-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:893350][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.898-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:898274][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.902-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:902853][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.907-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:907468][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.911-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:911954][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.916-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:916733][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.921-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:921463][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.926-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:926218][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.930-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:930866][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.935-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:935425][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.939-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:939975][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.944-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:944839][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.949-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:949622][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.954-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:954399][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.958-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:958946][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.963-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:963569][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.968-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:968443][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.973-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:973047][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.977-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:977902][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.982-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:982508][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.987-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:987156][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.991-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:991682][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:14.996-0500 E STORAGE [conn1] WiredTiger (28) [1425321314:996253][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.000-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:859][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.005-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:5699][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.010-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:10408][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.015-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:15038][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.019-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:19638][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.024-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:24303][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.028-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:28883][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.033-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:33484][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.038-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:38177][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.042-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:42683][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.047-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:47346][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.051-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:51840][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.056-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:56467][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.061-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:61040][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.066-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:66018][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.071-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:71887][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.077-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:77579][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.082-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:82287][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.088-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:88549][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.093-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:93578][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.098-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:98452][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.103-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:103237][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.107-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:107887][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.112-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:112501][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.117-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:117113][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.121-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:121745][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.126-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:126457][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.131-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:131504][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.136-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:136053][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.140-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:140650][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.145-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:145271][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.150-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:150118][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.154-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:154763][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.159-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:159274][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.163-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:163848][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.168-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:168564][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.173-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:173161][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.178-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:178047][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.182-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:182543][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.187-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:187118][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.191-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:191704][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.196-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:196354][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.201-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:201607][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.206-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:206727][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.211-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:211372][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.216-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:216094][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.220-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:220846][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.225-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:225443][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.230-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:230240][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.235-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:235200][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.239-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:239765][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.244-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:244379][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.248-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:248947][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.253-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:253619][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.258-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:258140][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.262-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:262935][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.267-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:267683][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.272-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:272262][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.276-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:276882][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.281-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:281490][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.286-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:286107][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.290-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:290698][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.295-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:295327][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.299-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:299918][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.305-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:305142][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.309-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:309799][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.314-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:314451][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.319-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:319056][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.323-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:323717][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.328-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:328386][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.333-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:333065][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.337-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:337850][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.342-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:342500][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.347-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:347211][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.351-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:351914][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.356-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:356517][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.362-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:362177][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.367-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:367028][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.371-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:371707][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.376-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:376568][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.381-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:381446][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.386-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:386170][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.390-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:390722][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.395-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:395433][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.400-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:399991][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.404-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:404675][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.409-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:409675][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.414-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:414422][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.419-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:419102][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.423-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:423674][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.428-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:428238][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.432-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:432738][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.437-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:437266][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.441-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:441889][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.446-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:446410][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.450-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:450945][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.455-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:455431][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.459-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:459978][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.464-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:464565][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.469-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:469107][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.473-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:473593][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.478-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:478057][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.482-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:482573][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.487-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:487108][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.491-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:491628][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.496-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:496133][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.500-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:500730][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.505-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:505273][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.510-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:510355][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.515-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:515274][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.519-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:519893][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.524-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:524450][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.529-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:529050][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.533-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:533634][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.538-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:538125][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.542-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:542667][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.547-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:547180][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.551-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:551785][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.556-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:556290][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.560-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:560846][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.565-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:565370][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.570-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:570026][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.574-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:574521][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.579-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:579053][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.583-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:583615][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.588-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:588117][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.592-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:592745][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.597-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:597326][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.602-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:601988][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.606-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:606630][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.611-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:611851][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.616-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:616855][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.621-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:621455][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.626-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:625985][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.632-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:632349][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.639-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:638998][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.643-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:643605][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.648-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:648159][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.652-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:652736][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.657-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:657317][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.661-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:661968][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.666-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:666771][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.671-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:671536][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.676-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:676035][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.680-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:680753][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.685-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:685335][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.689-0500 E STORAGE [conn1] WiredTiger (28) [1425321315:689851][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.694-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:694817][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.694-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084bb8'), x: 4253.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 1538ms 2015-03-02T13:35:15.699-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:699456][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.704-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:704137][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.708-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:708843][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.713-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:713790][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.718-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:718721][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.723-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:723477][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.728-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:727997][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.732-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:732587][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.737-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:737171][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.741-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:741896][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.746-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:746636][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.751-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:751126][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.755-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:755826][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.760-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:760561][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.765-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:765048][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.770-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:770010][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.774-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:774615][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.779-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:779203][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.783-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:783748][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.788-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:788299][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.792-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:792910][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.797-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:797494][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.802-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:802129][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.806-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:806733][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.811-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:811278][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.816-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:816313][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.821-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:821084][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.825-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:825725][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.830-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:830348][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.834-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:834855][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.839-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:839465][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.844-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:843984][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.848-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:848612][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.853-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:853174][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.857-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:857801][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.862-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:862352][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.866-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:866974][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.873-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:873399][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.878-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:878892][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.883-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:883365][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.890-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:890322][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.896-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:896156][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.900-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:900866][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.905-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:905468][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.910-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:910237][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.915-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:915029][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.920-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:920728][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.925-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:925431][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.930-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:930168][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.934-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:934804][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.939-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:939493][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.944-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:944136][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.948-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:948838][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.953-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:953433][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.958-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:958077][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.962-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:962682][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.967-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:967518][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.972-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:972190][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.977-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:977089][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.981-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:981742][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.986-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:986273][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.991-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:991021][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:15.995-0500 E STORAGE [conn2] WiredTiger (28) [1425321315:995675][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.000-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:343][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.005-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:4997][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.009-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:9624][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.014-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:14237][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.018-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:18820][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.024-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:24156][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.028-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:28922][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.033-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:33555][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.038-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:38093][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.042-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:42854][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.047-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:47554][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.052-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:52291][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.056-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:56928][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.061-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:61541][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.066-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:66754][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.071-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:71556][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.076-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:76256][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.081-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:80984][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.085-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:85644][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.090-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:90489][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.095-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:95186][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.099-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:99789][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.104-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:104419][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.109-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:109082][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.113-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:113676][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.118-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:118322][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.123-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:123243][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.128-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:128175][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.133-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:133411][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.138-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:138143][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.142-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:142916][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.147-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:147583][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.152-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:152227][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.156-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:156899][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.161-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:161581][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.166-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:166142][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.170-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:170831][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.175-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:175429][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.180-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:179994][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.184-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:184759][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.189-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:189321][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.194-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:194083][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.198-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:198767][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.203-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:203343][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.208-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:208038][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.212-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:212672][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.217-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:217465][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.222-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:222089][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.227-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:227153][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.231-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:231932][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.237-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:237702][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.242-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:242315][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.247-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:246984][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.253-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:253287][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.258-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:258016][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.262-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:262603][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.267-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:267265][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.271-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:271774][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.276-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:276323][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.280-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:280927][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.287-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:287258][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.292-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:292699][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.297-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:297760][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.302-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:302369][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.307-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:307021][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.311-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:311632][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.316-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:316260][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.321-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:321040][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.325-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:325625][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.330-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:330626][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.335-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:335609][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.340-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:340480][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.340-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4ad5e15176b70e210c400'), x: 7489.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 650ms 2015-03-02T13:35:16.345-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:345126][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.349-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:349612][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.354-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:354132][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.358-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:358858][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.363-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:363435][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.368-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:368346][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.372-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:372942][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.377-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:377765][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.382-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:382764][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.387-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:387314][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.391-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:391909][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.396-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:396447][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.400-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:400961][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.405-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:405452][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.411-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:411684][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.417-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:417150][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.422-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:422074][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.426-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:426693][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.431-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:431639][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.436-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:436548][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.441-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:441191][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.445-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:445832][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.450-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:450331][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.454-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:454889][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.459-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:459342][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.463-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:463919][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.468-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:468456][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.473-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:473138][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.477-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:477740][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.482-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:482226][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.486-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:486763][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.491-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:491267][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.495-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:495934][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.500-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:500542][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.505-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:505060][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.509-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:509631][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.514-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:514122][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.518-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:518670][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.523-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:523106][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.527-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:527680][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.532-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:532201][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.538-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:538709][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.543-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:543508][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.548-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:548102][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.552-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:552631][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.557-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:557278][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.561-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:561886][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.566-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:566376][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.571-0500 E STORAGE [conn1] WiredTiger (28) [1425321316:571143][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.576-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:576187][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.576-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084c3f'), x: 4388.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 240ms 2015-03-02T13:35:16.580-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:580795][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.585-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:585741][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.590-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:590399][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.595-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:595110][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.599-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:599749][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.604-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:604350][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.608-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:608959][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.613-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:613378][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.618-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:618050][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.622-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:622595][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.627-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:627138][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.631-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:631682][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.636-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:636453][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.641-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:641318][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.645-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:645945][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.650-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:650466][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.655-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:655017][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.659-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:659526][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.664-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:664079][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.668-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:668721][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.673-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:673383][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.678-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:678012][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.682-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:682499][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.687-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:687099][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.691-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:691697][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.696-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:696253][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.700-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:700968][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.705-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:705664][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.710-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:710398][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.714-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:714890][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.719-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:719479][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.723-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:723976][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.728-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:728543][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.733-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:733100][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.738-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:738374][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.743-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:743065][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.747-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:747709][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.752-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:752208][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.756-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:756768][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.761-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:761307][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.765-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:765808][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.770-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:770636][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.775-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:775491][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.781-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:781158][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.787-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:787689][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.792-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:792834][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.797-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:797415][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.801-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:801926][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.807-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:807602][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.813-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:813514][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.818-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:818643][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.823-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:823184][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.827-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:827702][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.832-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:832241][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.836-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:836708][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.841-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:841364][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.845-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:845846][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.850-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:850453][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.855-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:855035][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.859-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:859537][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.864-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:864130][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.869-0500 E STORAGE [conn2] WiredTiger (28) [1425321316:869091][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.874-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:874595][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.874-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f4ad5fa9e1c8ff3d039572'), x: 121.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 3085ms 2015-03-02T13:35:16.880-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:880612][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.886-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:886226][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.890-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:890951][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.895-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:895777][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.900-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:900399][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.905-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:905110][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.909-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:909698][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.914-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:914319][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.918-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:918869][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.923-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:923510][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.930-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:930089][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.935-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:935565][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.940-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:940678][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.946-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:946281][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.951-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:951344][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.955-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:955818][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.960-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:960448][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.965-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:965024][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.969-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:969836][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.974-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:974705][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.979-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:979254][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.983-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:983888][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.988-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:988540][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.993-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:993125][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:16.997-0500 E STORAGE [conn3] WiredTiger (28) [1425321316:997889][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.002-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:2437][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.007-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:7427][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.012-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:12010][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.016-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:16485][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.021-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:21025][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.025-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:25563][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.030-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:30132][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.034-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:34864][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.039-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:39488][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.044-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:44889][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.049-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:49483][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.054-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:54063][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.058-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:58648][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.063-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:63213][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.068-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:68110][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.072-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:72926][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.077-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:77624][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.082-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:82316][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.086-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:86792][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.091-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:91621][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.096-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:96261][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.100-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:100796][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.105-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:105334][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.109-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:109928][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.114-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:114738][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.119-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:119334][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.123-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:123921][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.128-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:128639][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.133-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:133969][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.139-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:139264][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.143-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:143899][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.149-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:149474][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.154-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:154154][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.158-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:158781][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.163-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:163363][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.168-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:168343][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.172-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:172908][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.177-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:177554][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.182-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:182547][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.182-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084c7e'), x: 4451.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 310ms 2015-03-02T13:35:17.187-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:187336][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.191-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:191966][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.196-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:196571][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.201-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:201262][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.205-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:205846][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.210-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:210462][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.215-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:215042][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.219-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:219522][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.224-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:224072][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.228-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:228584][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.233-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:233281][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.237-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:237935][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.242-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:242513][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.247-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:247104][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.251-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:251913][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.256-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:256646][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.261-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:261254][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.266-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:265997][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.270-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:270628][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.275-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:275243][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.279-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:279745][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.284-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:284327][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.288-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:288860][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.293-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:293521][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.298-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:298020][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.302-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:302635][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.307-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:307162][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.311-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:311771][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.316-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:316483][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.320-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:320946][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.325-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:325570][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.330-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:330138][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.334-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:334710][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.339-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:339268][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.343-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:343799][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.348-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:348393][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.353-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:353459][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.358-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:358136][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.363-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:363031][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.367-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:367691][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.372-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:372259][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.377-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:377004][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.382-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:382464][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.387-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:387139][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.391-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:391949][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.396-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:396617][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.401-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:401409][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.405-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:405923][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.410-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:410474][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.415-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:415153][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.422-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:422798][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.427-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:427539][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.432-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:432176][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.436-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:436726][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.441-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:441354][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.445-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:445875][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.450-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:450448][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.455-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:455779][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.460-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:460533][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.465-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:465391][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.469-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:469929][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.474-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:474493][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.479-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:478985][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.483-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:483526][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.488-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:488029][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.492-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:492613][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.497-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:497237][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.501-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:501779][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.506-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:506401][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.510-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:510974][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.515-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:515523][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.520-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:520066][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.524-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:524686][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.529-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:529256][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.533-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:533883][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.538-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:538346][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.542-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:542943][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.547-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:547567][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.552-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:552224][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.557-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:557318][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.562-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:562735][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.567-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:567552][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.572-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:572145][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.576-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:576767][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.582-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:582438][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.587-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:587027][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.591-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:591531][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.596-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:596202][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.600-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:600809][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.605-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:605375][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.610-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:609980][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.614-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:614453][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.619-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:619040][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.623-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:623568][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.628-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:628156][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.632-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:632747][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.637-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:637253][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.641-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:641830][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.646-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:646468][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.652-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:652061][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.656-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:656860][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.662-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:661978][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.666-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:666825][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.671-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:671363][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.675-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:675889][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.680-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:680499][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.685-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:685663][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.690-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:690243][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.694-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:694800][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.699-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:699390][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.704-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:704069][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.708-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:708695][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.713-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:713234][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.718-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:718821][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.723-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:723577][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.728-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:728071][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.732-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:732803][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.737-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:737356][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.741-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:741940][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.746-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:746515][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.751-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:751122][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.755-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:755649][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.760-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:760612][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.765-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:765606][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.770-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:770204][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.774-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:774910][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.779-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:779499][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.784-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:784161][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.789-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:789757][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.794-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:794523][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.799-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:799107][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.803-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:803645][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.808-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:808232][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.812-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:812822][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.817-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:817466][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.822-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:822015][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.826-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:826619][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.831-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:831173][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.835-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:835824][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.840-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:840390][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.845-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:845016][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.849-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:849618][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.854-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:854225][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.859-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:859825][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.865-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:865319][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.870-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:870110][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.875-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:874985][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.882-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:882113][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.888-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:888810][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.893-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:893506][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.898-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:898342][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.902-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:902875][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.907-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:907506][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.912-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:912160][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.916-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:916722][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.921-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:921392][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.926-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:926152][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.930-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:930838][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.935-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:935529][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.940-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:940145][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.944-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:944794][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.949-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:949594][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.954-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:954185][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.958-0500 E STORAGE [conn2] WiredTiger (28) [1425321317:958910][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.964-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:964018][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.964-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f4ad5fa9e1c8ff3d0395b2'), x: 185.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 786ms 2015-03-02T13:35:17.968-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:968971][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.974-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:974360][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.979-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:979095][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.983-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:983636][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.988-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:988332][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.993-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:993034][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:17.997-0500 E STORAGE [conn3] WiredTiger (28) [1425321317:997667][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.002-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:2405][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.007-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:7192][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.011-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:11743][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.016-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:16356][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.020-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:20906][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.025-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:25526][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.030-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:30124][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.034-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:34614][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.039-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:39231][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.043-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:43791][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.048-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:48465][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.053-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:53010][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.057-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:57603][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.062-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:62401][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.067-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:67296][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.072-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:72287][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.077-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:76985][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.081-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:81616][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.086-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:86253][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.090-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:90817][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.095-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:95695][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.100-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:100356][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.104-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:104907][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.109-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:109571][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.114-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:114131][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.118-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:118761][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.123-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:123385][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.127-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:127886][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.132-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:132421][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.137-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:137970][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.142-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:142949][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.147-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:147588][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.152-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:152136][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.156-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:156657][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.161-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:161385][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.166-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:166000][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.171-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:171202][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.176-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:176353][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.181-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:181209][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.185-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:185821][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.190-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:190661][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.195-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:195495][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.200-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:200174][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.206-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:206670][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.212-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:212008][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.216-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:216812][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.221-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:221309][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.225-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:225857][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.230-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:230496][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.235-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:235125][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.239-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:239685][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.244-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:244154][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.248-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:248712][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.253-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:253248][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.257-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:257786][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.262-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:262970][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.267-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:267606][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.272-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:272773][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.279-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:279094][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.286-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:286232][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.293-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:293239][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.300-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:300748][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.307-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:307572][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.312-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:312231][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.317-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:317118][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.322-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:322201][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.327-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:327895][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.330-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50633 #4 (4 connections now open) 2015-03-02T13:35:18.335-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:335114][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.345-0500 E STORAGE [conn1] WiredTiger (28) [1425321318:345560][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.345-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4ad5e15176b70e210c432'), x: 7539.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 1774ms 2015-03-02T13:35:18.360-0500 E STORAGE [conn2] WiredTiger (28) [1425321318:360700][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.367-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084d23'), x: 4616.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 408ms 2015-03-02T13:35:18.372-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:372522][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.373-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T13:35:18.385-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:385203][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.395-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:395380][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.405-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:405362][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.415-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:415303][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.422-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:422617][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.432-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:432283][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.442-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:442408][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.452-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:452155][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.460-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:460401][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.470-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:470849][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.479-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:479698][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.490-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:490296][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.499-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:499212][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.510-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:510178][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.519-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:519555][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.529-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:529481][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.537-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:537766][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.544-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:544490][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.549-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:549323][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.554-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:554031][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.559-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:558996][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.563-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:563692][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.568-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:568459][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.572-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:572917][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.577-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:577505][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.582-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:582456][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.587-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:587057][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.591-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:591601][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.596-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:596697][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.601-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:601186][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.605-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:605818][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.610-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:610380][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.615-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:615117][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.619-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:619775][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.624-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:624286][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.628-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:628975][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.633-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:633651][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.638-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:638235][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.642-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:642816][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.647-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:647346][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.651-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:651842][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.656-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:656284][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.661-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:661129][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.665-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:665614][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.670-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:670245][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.676-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:676727][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.681-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:681510][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.686-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:686677][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.691-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:691225][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.695-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:695897][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.700-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:700475][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.705-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:704988][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.709-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:709547][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.714-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:714157][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.718-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:718661][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.723-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:723073][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.727-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:727684][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.732-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:732243][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.736-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:736759][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.741-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:741280][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.745-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:745736][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.750-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:750246][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.754-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:754730][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.759-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:759272][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.763-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:763775][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.768-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:768268][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.772-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:772808][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.778-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:778853][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.784-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:784591][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.789-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:789163][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.793-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:793875][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.798-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:798517][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.803-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:803223][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.807-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:807726][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.812-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:812184][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.816-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:816871][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.821-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:821477][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.826-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:826112][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.830-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:830737][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.837-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:837245][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.842-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:842472][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.847-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:847177][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.851-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:851739][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.856-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:856178][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.860-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:860867][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.865-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:865398][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.872-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:872020][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.876-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:876757][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.881-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:881859][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.888-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:888852][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.894-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:894040][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.898-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:898861][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.903-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:903524][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.908-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:908183][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.912-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:912837][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.917-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:917385][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.921-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:921952][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.926-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:926621][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.931-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:931221][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.935-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:935912][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.940-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:940522][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.945-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:945218][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.949-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:949874][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.954-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:954513][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.959-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:959320][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.964-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:964002][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.968-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:968561][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.973-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:973081][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.977-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:977964][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.982-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:982621][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.987-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:987198][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.992-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:992748][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:18.997-0500 E STORAGE [conn3] WiredTiger (28) [1425321318:997637][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.002-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:2301][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.006-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:6909][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.011-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:11458][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.016-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:16504][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.016-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084d24'), x: 4617.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 648ms 2015-03-02T13:35:19.021-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:21301][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.026-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:26034][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.030-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:30596][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.035-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:35178][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.039-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:39645][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.044-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:44271][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.048-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:48876][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.053-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:53498][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.058-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:58332][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.062-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:62931][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.067-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:67725][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.072-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:72347][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.076-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:76938][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.081-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:81547][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.086-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:86168][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.091-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:91074][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.096-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:96397][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.100-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:100936][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.105-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:105584][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.110-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:110272][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.114-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:114811][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.119-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:119499][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.124-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:123996][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.128-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:128681][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.133-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:133590][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.133-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4ad5e15176b70e210c433'), x: 7540.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 787ms 2015-03-02T13:35:19.138-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:138212][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.143-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:143032][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.147-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:147849][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.152-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:152508][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.157-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:157071][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.161-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:161933][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.168-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:168751][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.174-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:174158][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.179-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:178983][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.183-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:183695][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.188-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:188589][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.193-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:193480][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.198-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:198769][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.203-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:203421][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.208-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:207998][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.212-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:212621][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.217-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:217098][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.221-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:221703][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.226-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:226187][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.230-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:230636][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.235-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:235201][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.239-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:239890][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.245-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:245439][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.251-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:251421][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.256-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:256697][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.261-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:261655][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.266-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:266143][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.270-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:270716][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.275-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:275145][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.281-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:281908][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.286-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:286549][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.291-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:291021][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.295-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:295915][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.300-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:300719][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.305-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:305424][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.309-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:309945][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.314-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:314458][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.319-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:319185][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.323-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:323679][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.328-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:328220][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.332-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:332750][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.337-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:337266][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.341-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:341794][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.346-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:346392][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.350-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:350938][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.355-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:355442][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.360-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:360120][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.364-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:364859][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.369-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:369504][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.374-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:374140][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.378-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:378825][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.383-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:383530][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.388-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:388108][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.392-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:392726][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.397-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:397365][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.402-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:402259][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.407-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:407002][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.411-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:411957][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.416-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:416536][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.421-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:421158][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.425-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:425717][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.430-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:430346][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.435-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:435069][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.439-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:439705][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.444-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:444384][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.448-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:448905][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.453-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:453616][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.458-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:458120][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.462-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:462922][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.467-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:467540][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.472-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:472105][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.476-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:476602][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.481-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:481147][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.485-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:485733][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.490-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:490324][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.494-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:494898][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.499-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:499440][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.504-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:504205][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.508-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:508775][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.513-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:513430][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.517-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:517958][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.522-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:522543][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.527-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:527029][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.531-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:531560][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.536-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:536122][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.540-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:540678][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.545-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:545146][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.549-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:549714][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.554-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:554304][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.558-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:558881][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.563-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:563386][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.568-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:568009][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.572-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:572556][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.577-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:577044][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.581-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:581586][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.586-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:586134][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.590-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:590674][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.595-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:595254][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.599-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:599775][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.604-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:604629][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.609-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:609757][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.614-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:614351][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.619-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:619012][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.623-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:623603][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.628-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:628062][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.632-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:632529][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.637-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:637015][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.641-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:641510][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.645-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:645942][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.650-0500 E STORAGE [conn1] WiredTiger (28) [1425321319:650603][1275:0x7fb36484c700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.655-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:655378][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.655-0500 I WRITE [conn2] insert test.foo query: { _id: ObjectId('54f4ad5e7527cc856d084d3d'), x: 4642.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 523ms 2015-03-02T13:35:19.660-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:660257][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.664-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:664812][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.669-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:669426][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.674-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:674006][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.678-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:678625][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.683-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:683200][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.687-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:687784][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.692-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:692337][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.697-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:696987][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.701-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:701665][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.706-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:706317][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.711-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:711439][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.716-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:716089][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.720-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:720889][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.725-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:725516][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.730-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:730019][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.734-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:734711][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.739-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:739276][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.743-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:743849][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.748-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:748508][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.753-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:753051][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.757-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:757602][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.762-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:762223][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.766-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:766857][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.771-0500 E STORAGE [conn2] WiredTiger (28) [1425321319:771360][1275:0x7fb36474b700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.776-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:776321][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.776-0500 I WRITE [conn3] insert test.foo query: { _id: ObjectId('54f4ad5fa9e1c8ff3d039673'), x: 378.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:0 keyUpdates:0 writeConflicts:0 exception: WiredTigerRecordStore::insertRecord 28: No space left on device code:8 numYields:0 locks:{} 764ms 2015-03-02T13:35:19.780-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:780971][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.785-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:785604][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.790-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:790128][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.794-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:794692][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.799-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:799291][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.803-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:803869][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.808-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:808502][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.813-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:813523][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.818-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:818282][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.822-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:822748][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.827-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:827404][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.831-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:831874][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.838-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:838586][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.844-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:844522][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.849-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:849002][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.853-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:853537][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.858-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:858030][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.862-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:862678][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.867-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:867203][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.872-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:872415][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.877-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:877175][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.881-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:881853][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.888-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:888857][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.894-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:894030][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.898-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:898695][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.903-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:903452][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.908-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:908111][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.913-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:913053][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.917-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:917872][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.922-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:922609][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.927-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:927300][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.932-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:932004][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.936-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:936593][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.941-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:941214][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.946-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:945975][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.950-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:950636][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.955-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:955231][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.959-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:959716][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.964-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:964411][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.969-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:969094][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.973-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:973717][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.978-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:978551][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.983-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:983125][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.987-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:987754][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.992-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:992501][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:19.997-0500 E STORAGE [conn3] WiredTiger (28) [1425321319:997103][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:20.001-0500 E STORAGE [conn3] WiredTiger (28) [1425321320:1703][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:20.006-0500 E STORAGE [conn4] WiredTiger (28) [1425321320:6914][1275:0x7fb364549700], file:collection-2-2321154500689669931.wt, cursor.next: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:20.007-0500 I - [conn4] Invariant failure: ret resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_record_store.cpp 1102 2015-03-02T13:35:20.013-0500 E STORAGE [conn3] WiredTiger (28) [1425321320:13408][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:20.018-0500 E STORAGE [conn3] WiredTiger (28) [1425321320:18363][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:20.024-0500 E STORAGE [conn3] WiredTiger (28) [1425321320:24063][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:20.035-0500 E STORAGE [conn3] WiredTiger (28) [1425321320:35746][1275:0x7fb36464a700], file:collection-2-2321154500689669931.wt, cursor.insert: collection-2-2321154500689669931.wt write error: failed to write 4096 bytes at offset 65961984: No space left on device 2015-03-02T13:35:20.038-0500 I CONTROL [conn4] 0xf42359 0xeec481 0xed245a 0xd5d48c 0xd5d4b2 0xd5fb01 0x8f443d 0x9917d6 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fb3724309d1 0x7fb3715d18fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"95D48C"},{"b":"400000","o":"95D4B2"},{"b":"400000","o":"95FB01"},{"b":"400000","o":"4F443D"},{"b":"400000","o":"5917D6"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FB372429000","o":"79D1"},{"b":"7FB3714E9000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9C0DF000", "elfType" : 3 }, { "b" : "7FB372429000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB372221000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB37201D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB371D17000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FB371A93000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB37187D000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB3714E9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB372646000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo21WiredTigerRecordStore8Iterator8_getNextEv+0xFC) [0xd5d48c] mongod(_ZN5mongo21WiredTigerRecordStore8Iterator7getNextEv+0x12) [0xd5d4b2] mongod(_ZN5mongo21WiredTigerRecordStore8validateEPNS_16OperationContextEbbPNS_15ValidateAdaptorEPNS_15ValidateResultsEPNS_14BSONObjBuilderE+0x1D1) [0xd5fb01] mongod(_ZN5mongo10Collection8validateEPNS_16OperationContextEbbPNS_15ValidateResultsEPNS_14BSONObjBuilderE+0x6D) [0x8f443d] mongod(_ZN5mongo11ValidateCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x246) [0x9917d6] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fb3724309d1] libc.so.6(clone+0x6D) [0x7fb3715d18fd] ----- END BACKTRACE ----- 2015-03-02T13:35:20.038-0500 I - [conn4] ***aborting after invariant() failure 2015-03-02T13:35:58.799-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:35:58.815-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:35:58.815-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:35:58.815-0500 I CONTROL [initandlisten] 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:35:58.817-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:35:58.818-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:35:58.818-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:35:58.818-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:35:58.825-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:35:58.893-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:35:58.893-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:35:58.894-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:36:09.009-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:36:13.393-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50657 #1 (1 connection now open) 2015-03-02T13:36:14.844-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50659 #2 (2 connections now open) 2015-03-02T13:36:14.865-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:36:16.411-0500 E STORAGE [conn1] WiredTiger (28) [1425321376:411082][1276:0x7ff59ec47700], session.commit_transaction: journal/WiredTigerLog.0000000172 write error: failed to write 128 bytes at offset 14958592: No space left on device 2015-03-02T13:36:16.411-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:36:16.431-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7ff5ac82b9d1 0x7ff5ab9cc8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FF5AC824000","o":"79D1"},{"b":"7FF5AB8E4000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF64AFF000", "elfType" : 3 }, { "b" : "7FF5AC824000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF5AC61C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF5AC418000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF5AC112000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FF5ABE8E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF5ABC78000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF5AB8E4000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF5ACA41000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7ff5ac82b9d1] libc.so.6(clone+0x6D) [0x7ff5ab9cc8fd] ----- END BACKTRACE ----- 2015-03-02T13:36:16.431-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:37:02.650-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:37:02.669-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:37:02.669-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:37:02.669-0500 I CONTROL [initandlisten] 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:37:02.670-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:37:02.680-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:37:02.742-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:37:02.742-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:37:02.742-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:37:12.878-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:37:13.423-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50690 #1 (1 connection now open) 2015-03-02T13:37:13.435-0500 E STORAGE [conn1] WiredTiger (28) [1425321433:435368][1278:0x7f41825b9700], session.commit_transaction: journal/WiredTigerLog.0000000173 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:37:13.435-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:37:13.446-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f419019d9d1 0x7f418f33e8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F4190196000","o":"79D1"},{"b":"7F418F256000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7E083000", "elfType" : 3 }, { "b" : "7F4190196000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F418FF8E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F418FD8A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F418FA84000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F418F800000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F418F5EA000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F418F256000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F41903B3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f419019d9d1] libc.so.6(clone+0x6D) [0x7f418f33e8fd] ----- END BACKTRACE ----- 2015-03-02T13:37:13.446-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:38:09.994-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:38:10.013-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:38:10.013-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:38:10.013-0500 I CONTROL [initandlisten] 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:38:10.014-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:38:10.021-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:38:10.088-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:38:10.088-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:38:10.089-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:38:20.224-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:38:23.289-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50725 #1 (1 connection now open) 2015-03-02T13:38:23.302-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:38:24.951-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:38:24.957-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:38:24.960-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1657ms 2015-03-02T13:38:24.965-0500 E STORAGE [conn1] WiredTiger (28) [1425321504:965266][1276:0x7f315df2d700], session.commit_transaction: journal/WiredTigerLog.0000000174 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:38:24.965-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:38:24.976-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f316bb119d1 0x7f316acb28fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F316BB0A000","o":"79D1"},{"b":"7F316ABCA000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9ECFF000", "elfType" : 3 }, { "b" : "7F316BB0A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F316B902000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F316B6FE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F316B3F8000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F316B174000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F316AF5E000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F316ABCA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F316BD27000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f316bb119d1] libc.so.6(clone+0x6D) [0x7f316acb28fd] ----- END BACKTRACE ----- 2015-03-02T13:38:24.976-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:39:14.598-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:39:14.614-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:39:14.614-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:39:14.614-0500 I CONTROL [initandlisten] 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:39:14.615-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:39:14.624-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:39:14.692-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:39:14.692-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:39:14.692-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:39:24.790-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:39:28.384-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50755 #1 (1 connection now open) 2015-03-02T13:39:28.395-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:39:28.453-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50756 #2 (2 connections now open) 2015-03-02T13:39:29.942-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50757 #3 (3 connections now open) 2015-03-02T13:39:30.032-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:39:30.038-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:39:30.042-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1583ms 2015-03-02T13:39:30.042-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1647ms 2015-03-02T13:39:30.049-0500 E STORAGE [conn3] WiredTiger (28) [1425321570:49301][1280:0x7f2aa6b89700], session.commit_transaction: journal/WiredTigerLog.0000000175 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T13:39:30.049-0500 I - [conn3] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:39:30.051-0500 E STORAGE [conn1] WiredTiger (28) [1425321570:51360][1280:0x7f2aa6d8b700], session.commit_transaction: journal/WiredTigerLog.0000000175 write error: failed to write 640 bytes at offset 4224: No space left on device 2015-03-02T13:39:30.051-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:39:30.067-0500 I CONTROL [conn3] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f2ab496f9d1 0x7f2ab3b108fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F2AB4968000","o":"79D1"},{"b":"7F2AB3A28000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6A6DD000", "elfType" : 3 }, { "b" : "7F2AB4968000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2AB4760000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2AB455C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2AB4256000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F2AB3FD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F2AB3DBC000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2AB3A28000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2AB4B85000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f2ab496f9d1] libc.so.6(clone+0x6D) [0x7f2ab3b108fd] ----- END BACKTRACE ----- 2015-03-02T13:39:30.067-0500 I - [conn3] ***aborting after invariant() failure 2015-03-02T13:40:14.615-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:40:14.633-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:40:14.633-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:40:14.633-0500 I CONTROL [initandlisten] 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:40:14.634-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:40:14.643-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current s2015-03-02T13:41:20.406-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:41:20.421-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:41:20.421-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:41:20.421-0500 I CONTROL [initandlisten] 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:41:20.424-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:41:20.429-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:41:20.508-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:41:20.508-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:41:20.508-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:41:30.617-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:41:34.945-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50828 #1 (1 connection now open) 2015-03-02T13:41:34.956-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:41:36.582-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:41:36.588-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:41:36.591-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1634ms 2015-03-02T13:41:36.598-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:41:36.677-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:41:36.681-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:41:37.107-0500 E STORAGE [conn1] WiredTiger (28) [1425321697:107660][1280:0x7feb04867700], session.commit_transaction: journal/WiredTigerLog.0000000177 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:41:37.107-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:41:37.117-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7feb1244b9d1 0x7feb115ec8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FEB12444000","o":"79D1"},{"b":"7FEB11504000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2C6FA000", "elfType" : 3 }, { "b" : "7FEB12444000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FEB1223C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FEB12038000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FEB11D32000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FEB11AAE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FEB11898000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FEB11504000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FEB12661000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7feb1244b9d1] libc.so.6(clone+0x6D) [0x7feb115ec8fd] ----- END BACKTRACE ----- 2015-03-02T13:41:37.117-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:42:24.506-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:42:24.521-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:42:24.521-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:42:24.521-0500 I CONTROL [initandlisten] 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:42:24.523-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:42:24.534-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:42:24.601-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:42:24.601-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:42:24.601-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:42:34.703-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:42:35.003-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50857 #1 (1 connection now open) 2015-03-02T13:42:35.014-0500 E STORAGE [conn1] WiredTiger (28) [1425321755:14695][1280:0x7f612748b700], session.commit_transaction: journal/WiredTigerLog.0000000178 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:42:35.014-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:42:35.025-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f613506f9d1 0x7f61342108fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F6135068000","o":"79D1"},{"b":"7F6134128000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE58E9000", "elfType" : 3 }, { "b" : "7F6135068000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6134E60000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6134C5C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6134956000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F61346D2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F61344BC000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6134128000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6135285000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f613506f9d1] libc.so.6(clone+0x6D) [0x7f61342108fd] ----- END BACKTRACE ----- 2015-03-02T13:42:35.025-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:43:21.891-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:43:21.909-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:43:21.909-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:43:21.909-0500 I CONTROL [initandlisten] 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:43:21.911-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:43:21.921-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:43:21.984-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:43:21.984-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:43:21.984-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:43:32.110-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:43:35.023-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50884 #1 (1 connection now open) 2015-03-02T13:43:35.036-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:43:36.669-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:43:36.675-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:43:36.678-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1641ms 2015-03-02T13:43:36.686-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:43:36.745-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:43:36.749-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:43:37.215-0500 E STORAGE [conn1] WiredTiger (28) [1425321817:215232][1278:0x7fd6e9326700], session.commit_transaction: journal/WiredTigerLog.0000000179 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:43:37.215-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:43:37.225-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fd6f6f0a9d1 0x7fd6f60ab8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FD6F6F03000","o":"79D1"},{"b":"7FD6F5FC3000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF7DEB0000", "elfType" : 3 }, { "b" : "7FD6F6F03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD6F6CFB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD6F6AF7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD6F67F1000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FD6F656D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD6F6357000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD6F5FC3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD6F7120000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fd6f6f0a9d1] libc.so.6(clone+0x6D) [0x7fd6f60ab8fd] ----- END BACKTRACE ----- 2015-03-02T13:43:37.225-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:44:27.837-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:44:27.856-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:44:27.856-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:44:27.856-0500 I CONTROL [initandlisten] 2015-03-02T13:44:27.857-0500 I CONTROL [initandlisten] 2015-03-02T13:44:27.857-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:44:27.858-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:44:27.865-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:44:27.934-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:44:27.934-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:44:27.934-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:44:38.048-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:44:38.460-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50912 #1 (1 connection now open) 2015-03-02T13:44:38.469-0500 E STORAGE [conn1] WiredTiger (28) [1425321878:469889][1279:0x7fa6ae32d700], session.commit_transaction: journal/WiredTigerLog.0000000180 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:44:38.469-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:44:38.481-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fa6bbf119d1 0x7fa6bb0b28fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FA6BBF0A000","o":"79D1"},{"b":"7FA6BAFCA000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF5539D000", "elfType" : 3 }, { "b" : "7FA6BBF0A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA6BBD02000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA6BBAFE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA6BB7F8000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FA6BB574000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA6BB35E000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA6BAFCA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA6BC127000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fa6bbf119d1] libc.so.6(clone+0x6D) [0x7fa6bb0b28fd] ----- END BACKTRACE ----- 2015-03-02T13:44:38.481-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:45:30.120-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:45:30.135-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:45:30.135-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:45:30.135-0500 I CONTROL [initandlisten] 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:45:30.138-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:45:30.146-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:45:30.210-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:45:30.210-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:45:30.210-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:45:40.326-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:45:43.537-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50948 #1 (1 connection now open) 2015-03-02T13:45:43.546-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:45:44.991-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50949 #2 (2 connections now open) 2015-03-02T13:45:45.228-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:45:45.237-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:45:45.242-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 247ms 2015-03-02T13:45:45.243-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1695ms 2015-03-02T13:45:45.250-0500 E STORAGE [conn2] WiredTiger (28) [1425321945:250294][1278:0x7f40617b1700], session.commit_transaction: journal/WiredTigerLog.0000000181 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:45:45.250-0500 I - [conn2] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:45:45.252-0500 E STORAGE [conn1] WiredTiger (28) [1425321945:252678][1278:0x7f40618b2700], session.commit_transaction: journal/WiredTigerLog.0000000181 write error: failed to write 128 bytes at offset 4480: No space left on device 2015-03-02T13:45:45.252-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:45:45.268-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f406f4969d1 0x7f406e6378fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F406F48F000","o":"79D1"},{"b":"7F406E54F000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF01AFF000", "elfType" : 3 }, { "b" : "7F406F48F000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F406F287000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F406F083000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F406ED7D000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F406EAF9000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F406E8E3000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F406E54F000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F406F6AC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f406f4969d1] libc.so.6(clone+0x6D) [0x7f406e6378fd] ----- END BACKTRACE ----- 2015-03-02T13:45:45.269-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:46:31.638-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:46:31.656-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:46:31.656-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:46:31.656-0500 I CONTROL [initandlisten] 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:46:31.657-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:46:31.665-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:46:31.732-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:46:31.732-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:46:31.732-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:46:41.839-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:46:43.657-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50975 #1 (1 connection now open) 2015-03-02T13:46:43.666-0500 E STORAGE [conn1] WiredTiger (28) [1425322003:666169][1278:0x7f49c288b700], session.commit_transaction: journal/WiredTigerLog.0000000182 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:46:43.666-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:46:43.676-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f49d046f9d1 0x7f49cf6108fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F49D0468000","o":"79D1"},{"b":"7F49CF528000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFCAA43000", "elfType" : 3 }, { "b" : "7F49D0468000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F49D0260000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F49D005C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F49CFD56000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F49CFAD2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F49CF8BC000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F49CF528000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F49D0685000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f49d046f9d1] libc.so.6(clone+0x6D) [0x7f49cf6108fd] ----- END BACKTRACE ----- 2015-03-02T13:46:43.677-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:47:32.427-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:47:32.444-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:47:32.444-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:47:32.444-0500 I CONTROL [initandlisten] 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:47:32.445-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:47:32.458-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:47:32.518-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:47:32.518-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:47:32.518-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:47:42.634-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:47:43.670-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50998 #1 (1 connection now open) 2015-03-02T13:47:43.685-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:47:45.124-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:50999 #2 (2 connections now open) 2015-03-02T13:47:45.328-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:47:45.334-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:47:45.337-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 208ms 2015-03-02T13:47:45.338-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1651ms 2015-03-02T13:47:45.346-0500 E STORAGE [conn1] WiredTiger (28) [1425322065:346646][1280:0x7f8cb975c700], session.commit_transaction: journal/WiredTigerLog.0000000183 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:47:45.346-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:47:45.347-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:47:45.367-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f8cc73409d1 0x7f8cc64e18fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F8CC7339000","o":"79D1"},{"b":"7F8CC63F9000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB0EFF000", "elfType" : 3 }, { "b" : "7F8CC7339000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8CC7131000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8CC6F2D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8CC6C27000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F8CC69A3000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8CC678D000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8CC63F9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8CC7556000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f8cc73409d1] libc.so.6(clone+0x6D) [0x7f8cc64e18fd] ----- END BACKTRACE ----- 2015-03-02T13:47:45.367-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:48:37.617-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:48:37.631-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:48:37.631-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:48:37.631-0500 I CONTROL [initandlisten] 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:48:37.634-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:48:37.640-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:48:37.691-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:48:37.691-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:48:37.691-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:48:47.832-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:48:48.683-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51026 #1 (1 connection now open) 2015-03-02T13:48:49.147-0500 E STORAGE [conn1] WiredTiger (28) [1425322129:147793][1278:0x7f1363d3c700], session.commit_transaction: journal/WiredTigerLog.0000000184 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:48:49.147-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:48:49.157-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f13719209d1 0x7f1370ac18fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F1371919000","o":"79D1"},{"b":"7F13709D9000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC442B000", "elfType" : 3 }, { "b" : "7F1371919000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1371711000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F137150D000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1371207000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F1370F83000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1370D6D000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F13709D9000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1371B36000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f13719209d1] libc.so.6(clone+0x6D) [0x7f1370ac18fd] ----- END BACKTRACE ----- 2015-03-02T13:48:49.157-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:49:38.256-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:49:38.274-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:49:38.274-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:49:38.274-0500 I CONTROL [initandlisten] 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:49:38.279-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:49:38.283-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:49:38.350-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:49:38.350-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:49:38.350-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:49:48.462-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:49:48.705-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51046 #1 (1 connection now open) 2015-03-02T13:49:48.714-0500 E STORAGE [conn1] WiredTiger (28) [1425322188:714947][1278:0x7f3cb18ff700], session.commit_transaction: journal/WiredTigerLog.0000000185 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:49:48.715-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:49:48.725-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f3cbf4e39d1 0x7f3cbe6848fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F3CBF4DC000","o":"79D1"},{"b":"7F3CBE59C000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA068C000", "elfType" : 3 }, { "b" : "7F3CBF4DC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3CBF2D4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3CBF0D0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3CBEDCA000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F3CBEB46000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3CBE930000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3CBE59C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3CBF6F9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f3cbf4e39d1] libc.so.6(clone+0x6D) [0x7f3cbe6848fd] ----- END BACKTRACE ----- 2015-03-02T13:49:48.725-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:50:40.048-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:50:40.066-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:50:40.067-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:50:40.067-0500 I CONTROL [initandlisten] 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:50:40.068-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:50:40.075-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:50:40.145-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:50:40.145-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:50:40.145-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:50:50.256-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:50:53.642-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51077 #1 (1 connection now open) 2015-03-02T13:50:53.659-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:50:55.323-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:50:55.330-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:50:55.333-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1672ms 2015-03-02T13:50:55.338-0500 E STORAGE [conn1] WiredTiger (28) [1425322255:338032][1276:0x7f87efb7e700], session.commit_transaction: journal/WiredTigerLog.0000000186 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:50:55.338-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:50:55.350-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f87fd7629d1 0x7f87fc9038fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F87FD75B000","o":"79D1"},{"b":"7F87FC81B000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFBB6FF000", "elfType" : 3 }, { "b" : "7F87FD75B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F87FD553000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F87FD34F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F87FD049000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F87FCDC5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F87FCBAF000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F87FC81B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F87FD978000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f87fd7629d1] libc.so.6(clone+0x6D) [0x7f87fc9038fd] ----- END BACKTRACE ----- 2015-03-02T13:50:55.350-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:51:39.206-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:51:39.223-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:51:39.223-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:51:39.223-0500 I CONTROL [initandlisten] 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:51:39.224-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:51:39.230-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:51:39.294-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:51:39.294-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:51:39.295-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:51:49.417-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:51:53.687-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51103 #1 (1 connection now open) 2015-03-02T13:51:53.699-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:51:55.335-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:51:55.341-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:51:55.344-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1644ms 2015-03-02T13:51:55.349-0500 E STORAGE [conn1] WiredTiger (28) [1425322315:349258][1278:0x7fb5b827d700], session.commit_transaction: journal/WiredTigerLog.0000000187 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T13:51:55.349-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:51:55.359-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fb5c5e619d1 0x7fb5c50028fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FB5C5E5A000","o":"79D1"},{"b":"7FB5C4F1A000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB16FF000", "elfType" : 3 }, { "b" : "7FB5C5E5A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB5C5C52000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB5C5A4E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB5C5748000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FB5C54C4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB5C52AE000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB5C4F1A000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB5C6077000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fb5c5e619d1] libc.so.6(clone+0x6D) [0x7fb5c50028fd] ----- END BACKTRACE ----- 2015-03-02T13:51:55.359-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:52:43.538-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:52:43.554-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:52:43.554-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:52:43.554-0500 I CONTROL [initandlisten] 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:52:43.558-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:52:43.566-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:52:43.630-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:52:43.630-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:52:43.630-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:52:53.742-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:52:58.673-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51127 #1 (1 connection now open) 2015-03-02T13:52:58.764-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51128 #2 (2 connections now open) 2015-03-02T13:52:58.787-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T13:53:00.244-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51129 #3 (3 connections now open) 2015-03-02T13:53:00.864-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T13:53:00.870-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T13:53:00.874-0500 I WRITE [conn1] insert test.foo query: { _id: ObjectId('54f4b18a24627132475c19ac'), x: 0.0, doc: "LargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalueLargevalue..." } ninserted:1 keyUpdates:0 writeConflicts:0 numYields:0 locks:{ Global: { acquireCount: { w: 1 } }, Database: { acquireCount: { w: 1 }, acquireWaitCount: { w: 1 }, timeAcquiringMicros: { w: 433555 } }, Collection: { acquireCount: { w: 1 } } } 434ms 2015-03-02T13:53:00.2015-03-02T13:53:41.724-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:53:41.742-0500 I CONTROL [initandlisten] MongoDB starting : pid=1274 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:53:41.742-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:53:41.743-0500 I CONTROL [initandlisten] 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:53:41.745-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:53:41.753-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:53:41.816-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:53:41.817-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:53:41.817-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:53:51.941-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:53:53.727-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51147 #1 (1 connection now open) 2015-03-02T13:53:53.736-0500 E STORAGE [conn1] WiredTiger (28) [1425322433:736664][1274:0x7f99d9705700], session.commit_transaction: journal/WiredTigerLog.0000000189 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:53:53.736-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:53:53.747-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f99e72e99d1 0x7f99e648a8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F99E72E2000","o":"79D1"},{"b":"7F99E63A2000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEECFF000", "elfType" : 3 }, { "b" : "7F99E72E2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F99E70DA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F99E6ED6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F99E6BD0000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F99E694C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F99E6736000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F99E63A2000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F99E74FF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f99e72e99d1] libc.so.6(clone+0x6D) [0x7f99e648a8fd] ----- END BACKTRACE ----- 2015-03-02T13:53:53.747-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:54:39.911-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:54:39.923-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:54:39.923-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:54:39.923-0500 I CONTROL [initandlisten] 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:54:39.930-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:54:39.938-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:54:40.000-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:54:40.000-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:54:40.000-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:54:50.123-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:54:53.734-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51170 #1 (1 connection now open) 2015-03-02T13:54:53.747-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:54:55.379-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:54:55.385-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:54:55.388-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1641ms 2015-03-02T13:54:55.393-0500 E STORAGE [conn1] WiredTiger (28) [1425322495:393488][1279:0x7fd141dc7700], session.commit_transaction: journal/WiredTigerLog.0000000190 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:54:55.393-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:54:55.404-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fd14f9ab9d1 0x7fd14eb4c8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FD14F9A4000","o":"79D1"},{"b":"7FD14EA64000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF06EE1000", "elfType" : 3 }, { "b" : "7FD14F9A4000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD14F79C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD14F598000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD14F292000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FD14F00E000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD14EDF8000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD14EA64000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD14FBC1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fd14f9ab9d1] libc.so.6(clone+0x6D) [0x7fd14eb4c8fd] ----- END BACKTRACE ----- 2015-03-02T13:54:55.404-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:55:40.526-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:55:40.542-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:55:40.542-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:55:40.543-0500 I CONTROL [initandlisten] 2015-03-02T13:55:40.545-0500 I CONTROL [initandlisten] 2015-03-02T13:55:40.545-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:55:40.545-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:55:40.545-0500 I CONTROL [in2015-03-02T13:56:41.398-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:56:41.415-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:56:41.415-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:56:41.415-0500 I CONTROL [initandlisten] 2015-03-02T13:56:41.416-0500 I CONTROL [initandlisten] 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:56:41.418-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:56:41.427-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:56:41.495-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:56:41.495-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:56:41.495-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:56:51.616-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:56:53.776-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51218 #1 (1 connection now open) 2015-03-02T13:56:53.787-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:56:55.436-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:56:55.442-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:56:55.445-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1658ms 2015-03-02T13:56:55.450-0500 E STORAGE [conn1] WiredTiger (28) [1425322615:450763][1279:0x7f3bbd24a700], session.commit_transaction: journal/WiredTigerLog.0000000192 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:56:55.450-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:56:55.462-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f3bcae2e9d1 0x7f3bc9fcf8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F3BCAE27000","o":"79D1"},{"b":"7F3BC9EE7000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFB74FF000", "elfType" : 3 }, { "b" : "7F3BCAE27000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F3BCAC1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F3BCAA1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F3BCA715000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F3BCA491000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3BCA27B000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3BC9EE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3BCB044000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f3bcae2e9d1] libc.so.6(clone+0x6D) [0x7f3bc9fcf8fd] ----- END BACKTRACE ----- 2015-03-02T13:56:55.462-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:57:38.544-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:57:38.559-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:57:38.559-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:57:38.559-0500 I CONTROL [initandlisten] 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:57:38.564-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:57:38.565-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:57:38.565-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:57:38.568-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:57:38.635-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:57:38.635-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:57:38.635-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:57:48.760-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:57:48.874-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51239 #1 (1 connection now open) 2015-03-02T13:57:48.884-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:57:50.540-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:57:50.546-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:57:50.549-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1664ms 2015-03-02T13:57:50.554-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:57:50.615-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:57:50.619-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:57:50.631-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:57:50.692-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:57:50.696-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:57:50.703-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T13:57:50.764-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T13:57:50.768-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T13:57:51.210-0500 E STORAGE [conn1] WiredTiger (28) [1425322671:210880][1280:0x7fab4babe700], session.commit_transaction: journal/WiredTigerLog.0000000193 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T13:57:51.210-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:57:51.220-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fab596a29d1 0x7fab588438fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FAB5969B000","o":"79D1"},{"b":"7FAB5875B000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFDD077000", "elfType" : 3 }, { "b" : "7FAB5969B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FAB59493000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FAB5928F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FAB58F89000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FAB58D05000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FAB58AEF000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FAB5875B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FAB598B8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fab596a29d1] libc.so.6(clone+0x6D) [0x7fab588438fd] ----- END BACKTRACE ----- 2015-03-02T13:57:51.220-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:58:36.311-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:58:36.326-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:58:36.326-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:58:36.326-0500 I CONTROL [initandlisten] 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T13:58:36.329-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T13:58:36.337-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T13:58:36.418-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T13:58:36.418-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T13:58:36.418-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T13:58:46.540-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T13:58:48.863-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51261 #1 (1 connection now open) 2015-03-02T13:58:48.875-0500 E STORAGE [conn1] WiredTiger (28) [1425322728:875478][1280:0x7f64e48e8700], session.commit_transaction: journal/WiredTigerLog.0000000194 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T13:58:48.875-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T13:58:48.886-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f64f24cc9d1 0x7f64f166d8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F64F24C5000","o":"79D1"},{"b":"7F64F1585000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF944BA000", "elfType" : 3 }, { "b" : "7F64F24C5000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F64F22BD000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F64F20B9000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F64F1DB3000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F64F1B2F000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F64F1919000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F64F1585000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F64F26E2000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f64f24cc9d1] libc.so.6(clone+0x6D) [0x7f64f166d8fd] ----- END BACKTRACE ----- 2015-03-02T13:58:48.886-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T13:59:34.954-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T13:59:34.970-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T13:59:34.970-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T13:59:34.970-0500 I CONTROL [initandlisten] 2015-03-02T13:59:34.976-0500 I CONTROL [initandlisten] 2015-03-02T13:59:34.976-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T13:59:34.976-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T13:59:34.976-0500 I CONTROL [initandlisten] 2015-03-02T13:59:34.976-0500 I CONTROL [initandlisten] ** WARNING: /sys/ke2015-03-02T14:00:32.559-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:00:32.577-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:00:32.577-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:00:32.577-0500 I CONTROL [initandlisten] 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:00:32.578-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:00:32.586-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:00:32.651-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:00:32.651-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:00:32.651-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:00:42.775-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:00:43.969-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51306 #1 (1 connection now open) 2015-03-02T14:00:43.983-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:00:45.420-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51307 #2 (2 connections now open) 2015-03-02T14:00:45.709-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:00:45.716-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:00:45.719-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 294ms 2015-03-02T14:00:45.719-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1734ms 2015-03-02T14:00:45.725-0500 E STORAGE [conn2] WiredTiger (28) [1425322845:725004][1278:0x7f96da73d700], session.commit_transaction: journal/WiredTigerLog.0000000196 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:00:45.725-0500 I - [conn2] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:00:45.727-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:00:45.746-0500 I CONTROL [conn2] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f96e84229d1 0x7f96e75c38fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F96E841B000","o":"79D1"},{"b":"7F96E74DB000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2204B000", "elfType" : 3 }, { "b" : "7F96E841B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96E8213000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96E800F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96E7D09000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F96E7A85000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96E786F000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96E74DB000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96E8638000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f96e84229d1] libc.so.6(clone+0x6D) [0x7f96e75c38fd] ----- END BACKTRACE ----- 2015-03-02T14:00:45.746-0500 I - [conn2] ***aborting after invariant() failure 2015-03-02T14:01:32.406-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:01:32.425-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:01:32.425-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:01:32.425-0500 I CONTROL [initandlisten] 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:01:32.426-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:01:32.431-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:01:32.513-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:01:32.513-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:01:32.513-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:01:42.629-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:01:44.005-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51336 #1 (1 connection now open) 2015-03-02T14:01:44.015-0500 E STORAGE [conn1] WiredTiger (28) [1425322904:15029][1280:0x7fdfa6c0d700], session.commit_transaction: journal/WiredTigerLog.0000000197 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:01:44.015-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:01:44.025-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fdfb47f19d1 0x7fdfb39928fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FDFB47EA000","o":"79D1"},{"b":"7FDFB38AA000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF310FF000", "elfType" : 3 }, { "b" : "7FDFB47EA000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FDFB45E2000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FDFB43DE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FDFB40D8000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FDFB3E54000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FDFB3C3E000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FDFB38AA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FDFB4A07000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fdfb47f19d1] libc.so.6(clone+0x6D) [0x7fdfb39928fd] ----- END BACKTRACE ----- 2015-03-02T14:01:44.025-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:02:37.038-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:02:37.054-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:02:37.054-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:02:37.054-0500 I CONTROL [initandlisten] 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:02:37.057-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:02:37.065-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:02:37.131-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:02:37.131-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:02:37.131-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:02:47.233-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:02:48.918-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51365 #1 (1 connection now open) 2015-03-02T14:02:48.931-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:02:50.572-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:02:50.578-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:02:50.581-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1649ms 2015-03-02T14:02:51.409-0500 E STORAGE [conn1] WiredTiger (28) [1425322971:409067][1277:0x7f98c337f700], session.commit_transaction: journal/WiredTigerLog.0000000198 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:02:51.409-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:02:51.418-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f98d0f639d1 0x7f98d01048fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F98D0F5C000","o":"79D1"},{"b":"7F98D001C000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6DAE8000", "elfType" : 3 }, { "b" : "7F98D0F5C000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F98D0D54000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F98D0B50000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F98D084A000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F98D05C6000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F98D03B0000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F98D001C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F98D1179000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f98d0f639d1] libc.so.6(clone+0x6D) [0x7f98d01048fd] ----- END BACKTRACE ----- 2015-03-02T14:02:51.418-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:03:37.274-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:03:37.291-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:03:37.291-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:03:37.291-0500 I CONTROL [initandlisten] 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:03:37.292-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:03:37.301-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:03:37.364-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:03:37.364-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:03:37.364-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:03:47.486-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:03:49.014-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51388 #1 (1 connection now open) 2015-03-02T14:03:49.026-0500 E STORAGE [conn1] WiredTiger (28) [1425323029:26643][1276:0x7f3444f26700], session.commit_transaction: journal/WiredTigerLog.0000000199 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T14:03:49.026-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:03:49.036-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f3452b0a9d1 0x7f3451cab8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F3452B03000","o":"79D1"},{"b":"7F3451BC3000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFD8AFF000", "elfType" : 3 }, { "b" : "7F3452B03000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F34528FB000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F34526F7000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F34523F1000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F345216D000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F3451F57000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F3451BC3000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F3452D20000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f3452b0a9d1] libc.so.6(clone+0x6D) [0x7f3451cab8fd] ----- END BACKTRACE ----- 2015-03-02T14:03:49.036-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:04:41.091-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:04:41.109-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:04:41.109-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:04:41.109-0500 I CONTROL [initandlisten] 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:04:41.113-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:04:41.120-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:04:41.230-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:04:41.230-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:04:41.230-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:04:51.355-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:04:53.950-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51411 #1 (1 connection now open) 2015-03-02T14:04:53.960-0500 E STORAGE [conn1] WiredTiger (28) [1425323093:960896][1279:0x7fb107c3b700], session.commit_transaction: journal/WiredTigerLog.0000000200 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:04:53.960-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:04:53.972-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fb11581f9d1 0x7fb1149c08fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FB115818000","o":"79D1"},{"b":"7FB1148D8000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFEACB7000", "elfType" : 3 }, { "b" : "7FB115818000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB115610000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB11540C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB115106000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FB114E82000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB114C6C000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB1148D8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB115A35000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fb11581f9d1] libc.so.6(clone+0x6D) [0x7fb1149c08fd] ----- END BACKTRACE ----- 2015-03-02T14:04:53.972-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:05:40.187-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:05:40.207-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:05:40.207-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:05:40.207-0500 I CONTROL [initandlisten] 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:05:40.208-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:05:40.217-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:05:40.286-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:05:40.286-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:05:40.286-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:05:50.388-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:05:53.996-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51433 #1 (1 connection now open) 2015-03-02T14:05:54.015-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:05:55.720-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:05:55.726-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:05:55.729-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1713ms 2015-03-02T14:05:56.649-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51435 #2 (2 connections now open) 2015-03-02T14:05:56.657-0500 E STORAGE [conn2] WiredTiger (28) [1425323156:657529][1280:0x7ffe59413700], session.commit_transaction: journal/WiredTigerLog.0000000201 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:05:56.657-0500 I - [conn2] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:05:56.681-0500 I CONTROL [conn2] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7ffe670f89d1 0x7ffe662998fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FFE670F1000","o":"79D1"},{"b":"7FFE661B1000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE0EFF000", "elfType" : 3 }, { "b" : "7FFE670F1000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FFE66EE9000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FFE66CE5000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FFE669DF000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FFE6675B000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FFE66545000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FFE661B1000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FFE6730E000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7ffe670f89d1] libc.so.6(clone+0x6D) [0x7ffe662998fd] ----- END BACKTRACE ----- 2015-03-02T14:05:56.681-0500 I - [conn2] ***aborting after invariant() failure 2015-03-02T14:06:37.676-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:06:37.693-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:06:37.693-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:06:37.693-0500 I CONTROL [initandlisten] 2015-03-02T14:06:37.694-0500 I CONTROL [initandlisten] 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:06:37.695-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:06:37.701-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:06:37.785-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:06:37.785-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02015-03-02T14:07:32.698-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:07:32.714-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:07:32.714-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:07:32.714-0500 I CONTROL [initandlisten] 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:07:32.717-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:07:32.720-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:07:32.787-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:07:32.787-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:07:32.787-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:07:42.903-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:07:44.103-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51475 #1 (1 connection now open) 2015-03-02T14:07:44.115-0500 E STORAGE [conn1] WiredTiger (28) [1425323264:115849][1278:0x7f508fc6e700], session.commit_transaction: journal/WiredTigerLog.0000000203 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:07:44.115-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:07:44.126-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f509d8529d1 0x7f509c9f38fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F509D84B000","o":"79D1"},{"b":"7F509C90B000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF76CFF000", "elfType" : 3 }, { "b" : "7F509D84B000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F509D643000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F509D43F000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F509D139000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F509CEB5000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F509CC9F000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F509C90B000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F509DA68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f509d8529d1] libc.so.6(clone+0x6D) [0x7f509c9f38fd] ----- END BACKTRACE ----- 2015-03-02T14:07:44.126-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:08:29.710-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:08:29.728-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:08:29.728-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:08:29.728-0500 I CONTROL [initandlisten] 2015-03-02T14:08:29.731-0500 I CONTROL [initandlisten] 2015-03-02T14:08:29.731-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabl2015-03-02T14:09:27.795-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:09:27.813-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:09:27.813-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:09:27.813-0500 I CONTROL [initandlisten] 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:09:27.815-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:09:27.823-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:09:27.890-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:09:27.890-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:09:27.890-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:09:38.001-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:09:39.056-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51525 #1 (1 connection now open) 2015-03-02T14:09:39.068-0500 E STORAGE [conn1] WiredTiger (28) [1425323379:68927][1277:0x7f6b99a87700], session.commit_transaction: journal/WiredTigerLog.0000000205 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T14:09:39.069-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:09:39.079-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f6ba766b9d1 0x7f6ba680c8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F6BA7664000","o":"79D1"},{"b":"7F6BA6724000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF1EEFF000", "elfType" : 3 }, { "b" : "7F6BA7664000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F6BA745C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F6BA7258000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F6BA6F52000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F6BA6CCE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F6BA6AB8000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F6BA6724000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F6BA7881000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f6ba766b9d1] libc.so.6(clone+0x6D) [0x7f6ba680c8fd] ----- END BACKTRACE ----- 2015-03-02T14:09:39.079-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:10:24.418-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:10:24.435-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:10:24.435-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:10:24.435-0500 I CONTROL [initandlisten] 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:10:24.440-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:10:24.445-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:10:24.512-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:10:24.512-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:10:24.513-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:10:34.624-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:10:35.594-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51553 #1 (1 connection now open) 2015-03-02T14:10:35.612-0500 E STORAGE [conn1] WiredTiger (28) [1425323435:611989][1278:0x7f9f47c1a700], session.commit_transaction: journal/WiredTigerLog.0000000206 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:10:35.612-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:10:35.622-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f9f557fe9d1 0x7f9f5499f8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F9F557F7000","o":"79D1"},{"b":"7F9F548B7000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFE8CFF000", "elfType" : 3 }, { "b" : "7F9F557F7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F9F555EF000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F9F553EB000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F9F550E5000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F9F54E61000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F9F54C4B000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F9F548B7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F9F55A14000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f9f557fe9d1] libc.so.6(clone+0x6D) [0x7f9f5499f8fd] ----- END BACKTRACE ----- 2015-03-02T14:10:35.623-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:11:27.862-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:11:27.878-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:11:27.878-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:11:27.878-0500 I CONTROL [initandlisten] 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:11:27.881-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:11:27.887-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:11:27.956-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:11:27.956-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:11:27.956-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:11:38.084-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:11:39.084-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51578 #1 (1 connection now open) 2015-03-02T14:11:39.094-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:11:40.757-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:11:40.763-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:11:40.766-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1671ms 2015-03-02T14:11:41.282-0500 E STORAGE [conn1] WiredTiger (28) [1425323501:281993][1276:0x7f1fe495d700], session.commit_transaction: journal/WiredTigerLog.0000000207 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:11:41.282-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:11:41.291-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f1ff25419d1 0x7f1ff16e28fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F1FF253A000","o":"79D1"},{"b":"7F1FF15FA000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF3F6FF000", "elfType" : 3 }, { "b" : "7F1FF253A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F1FF2332000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F1FF212E000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F1FF1E28000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F1FF1BA4000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F1FF198E000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F1FF15FA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F1FF2757000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f1ff25419d1] libc.so.6(clone+0x6D) [0x7f1ff16e28fd] ----- END BACKTRACE ----- 2015-03-02T14:11:41.292-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:12:29.739-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:12:29.756-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:12:29.756-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:12:29.756-0500 I CONTROL [initandlisten] 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:12:29.759-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:12:29.765-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:12:29.838-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:12:29.838-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:12:29.838-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:12:39.939-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:12:44.171-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51600 #1 (1 connection now open) 2015-03-02T14:12:44.185-0500 E STORAGE [conn1] WiredTiger (28) [1425323564:184952][1277:0x7ff3df39b700], session.commit_transaction: journal/WiredTigerLog.0000000208 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T14:12:44.185-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:12:44.195-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7ff3ecf7f9d1 0x7ff3ec1208fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FF3ECF78000","o":"79D1"},{"b":"7FF3EC038000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFFD4FF000", "elfType" : 3 }, { "b" : "7FF3ECF78000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FF3ECD70000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FF3ECB6C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FF3EC866000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FF3EC5E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FF3EC3CC000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FF3EC038000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FF3ED195000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7ff3ecf7f9d1] libc.so.6(clone+0x6D) [0x7ff3ec1208fd] ----- END BACKTRACE ----- 2015-03-02T14:12:44.195-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:13:33.950-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:13:33.969-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:13:33.969-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:13:33.969-0500 I CONTROL [initandlisten] 2015-03-02T14:13:33.971-0500 I CONTROL [initandlisten] 2015-03-02T14:13:33.971-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:13:33.971-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:13:33.971-0500 I CONTROL [initandlisten] 2015-03-02T14:13:33.971-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:13:33.971-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:13:33.973-0500 I CONTROL [initandlisten] 2015-03-02T14:13:33.973-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:13:33.973-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:13:33.973-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:13:33.973-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:13:33.973-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:13:33.978-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:13:34.049-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:13:34.053-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:13:34.053-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:13:44.150-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:13:44.180-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51626 #1 (1 connection now open) 2015-03-02T14:13:44.633-0500 E STORAGE [conn1] WiredTiger (28) [1425323624:633938][1278:0x7eff247df700], session.commit_transaction: journal/WiredTigerLog.0000000209 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:13:44.634-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:13:44.643-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7eff323c39d1 0x7eff315648fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7EFF323BC000","o":"79D1"},{"b":"7EFF3147C000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF03C8D000", "elfType" : 3 }, { "b" : "7EFF323BC000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7EFF321B4000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7EFF31FB0000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7EFF31CAA000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7EFF31A26000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7EFF31810000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7EFF3147C000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7EFF325D9000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7eff323c39d1] libc.so.6(clone+0x6D) [0x7eff315648fd] ----- END BACKTRACE ----- 2015-03-02T14:13:44.643-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:14:33.615-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:14:33.634-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:14:33.634-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:14:33.634-0500 I CONTROL [initandlisten] 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:14:33.635-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:14:33.642-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:14:33.721-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:14:33.721-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:14:33.721-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:14:43.822-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:14:44.178-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51651 #1 (1 connection now open) 2015-03-02T14:14:44.189-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:14:45.637-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51652 #2 (2 connections now open) 2015-03-02T14:14:45.877-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:14:45.885-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:14:45.888-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 247ms 2015-03-02T14:14:45.888-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1699ms 2015-03-02T14:14:45.896-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:14:45.970-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:14:45.976-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:14:46.630-0500 E STORAGE [conn1] WiredTiger (28) [1425323686:630769][1280:0x7f5acdeb3700], session.commit_transaction: journal/WiredTigerLog.0000000210 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:14:46.630-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:14:46.641-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f5adba979d1 0x7f5adac388fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F5ADBA90000","o":"79D1"},{"b":"7F5ADAB50000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA66FF000", "elfType" : 3 }, { "b" : "7F5ADBA90000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F5ADB888000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F5ADB684000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F5ADB37E000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F5ADB0FA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F5ADAEE4000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F5ADAB50000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F5ADBCAD000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f5adba979d1] libc.so.6(clone+0x6D) [0x7f5adac388fd] ----- END BACKTRACE ----- 2015-03-02T14:14:46.641-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:15:34.231-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:15:34.249-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:15:34.249-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:15:34.250-0500 I CONTROL [initandlisten] 2015-03-02T14:15:34.251-0500 I CONTROL [initandlisten] 2015-03-02T14:15:34.251-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:15:34.253-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:15:34.253-0500 I CONTROL [initandlisten] 2015-03-02T14:15:34.253-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:15:34.253-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:15:34.253-0500 I CONTROL [initandlisten] 2015-03-02T14:15:34.253-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:15:34.253-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:15:34.254-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:15:34.254-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:15:34.254-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:15:34.258-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:15:34.342-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:15:34.342-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:15:34.342-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:15:44.442-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:15:45.564-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51674 #1 (1 connection now open) 2015-03-02T14:15:45.577-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:15:47.226-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:15:47.233-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:15:47.235-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1658ms 2015-03-02T14:15:47.240-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:15:47.302-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:15:47.305-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:15:47.312-0500 E STORAGE [conn1] WiredTiger (28) [1425323747:312486][1278:0x7f672fb93700], session.commit_transaction: journal/WiredTigerLog.0000000211 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:15:47.312-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:15:47.323-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f673d7779d1 0x7f673c9188fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F673D770000","o":"79D1"},{"b":"7F673C830000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF00AFF000", "elfType" : 3 }, { "b" : "7F673D770000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F673D568000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F673D364000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F673D05E000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F673CDDA000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F673CBC4000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F673C830000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F673D98D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f673d7779d1] libc.so.6(clone+0x6D) [0x7f673c9188fd] ----- END BACKTRACE ----- 2015-03-02T14:15:47.323-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:16:36.339-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:16:36.357-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:16:36.357-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:16:36.357-0500 I CONTROL [initandlisten] 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:16:36.358-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:16:36.366-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:16:36.443-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:16:36.443-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:16:36.443-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:16:46.544-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:16:49.223-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51701 #1 (1 connection now open) 2015-03-02T14:16:49.232-0500 E STORAGE [conn1] WiredTiger (28) [1425323809:232956][1278:0x7f38c8730700], session.commit_transaction: journal/WiredTigerLog.0000000212 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:16:49.233-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:16:49.244-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f38d63149d1 0x7f38d54b58fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F38D630D000","o":"79D1"},{"b":"7F38D53CD000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF9FAFF000", "elfType" : 3 }, { "b" : "7F38D630D000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F38D6105000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F38D5F01000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F38D5BFB000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F38D5977000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F38D5761000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F38D53CD000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F38D652A000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f38d63149d1] libc.so.6(clone+0x6D) [0x7f38d54b58fd] ----- END BACKTRACE ----- 2015-03-02T14:16:49.244-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:17:42.738-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:17:42.760-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:17:42.760-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:17:42.760-0500 I CONTROL [initandlisten] 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:17:42.761-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:17:42.768-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:17:42.837-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:17:42.837-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:17:42.837-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:17:52.938-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:17:54.196-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51725 #1 (1 connection now open) 2015-03-02T14:17:54.207-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:17:55.867-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:17:55.873-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:17:55.876-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1668ms 2015-03-02T14:17:56.419-0500 E STORAGE [conn1] WiredTiger (28) [1425323876:419958][1277:0x7fa3b939b700], session.commit_transaction: journal/WiredTigerLog.0000000213 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:17:56.420-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:17:56.430-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fa3c6f7f9d1 0x7fa3c61208fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FA3C6F78000","o":"79D1"},{"b":"7FA3C6038000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC98FF000", "elfType" : 3 }, { "b" : "7FA3C6F78000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA3C6D70000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA3C6B6C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA3C6866000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FA3C65E2000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA3C63CC000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA3C6038000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA3C7195000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fa3c6f7f9d1] libc.so.6(clone+0x6D) [0x7fa3c61208fd] ----- END BACKTRACE ----- 2015-03-02T14:17:56.430-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:18:48.671-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:18:48.686-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:18:48.687-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:18:48.687-0500 I CONTROL [initandlisten] 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:18:48.692-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:18:48.693-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:18:48.693-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:18:48.698-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:18:48.780-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:18:48.780-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:18:48.780-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:18:58.881-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:18:59.193-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51748 #1 (1 connection now open) 2015-03-02T14:18:59.204-0500 E STORAGE [conn1] WiredTiger (28) [1425323939:204032][1278:0x7fa1e9053700], session.commit_transaction: journal/WiredTigerLog.0000000214 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:18:59.204-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:18:59.215-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fa1f6c379d1 0x7fa1f5dd88fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FA1F6C30000","o":"79D1"},{"b":"7FA1F5CF0000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF36AFF000", "elfType" : 3 }, { "b" : "7FA1F6C30000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FA1F6A28000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FA1F6824000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FA1F651E000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FA1F629A000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FA1F6084000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FA1F5CF0000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FA1F6E4D000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fa1f6c379d1] libc.so.6(clone+0x6D) [0x7fa1f5dd88fd] ----- END BACKTRACE ----- 2015-03-02T14:18:59.215-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:19:44.429-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:19:44.446-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:19:44.446-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:19:44.446-0500 I CONTROL [initandlisten] 2015-03-02T14:19:44.448-0500 I CONTROL [initandlisten] 2015-03-02T14:19:44.448-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:19:44.448-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:19:44.449-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:19:44.456-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:19:44.520-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:19:44.520-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:19:44.520-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:19:54.626-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:19:59.194-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51770 #1 (1 connection now open) 2015-03-02T14:19:59.205-0500 E STORAGE [conn1] WiredTiger (28) [1425323999:205694][1278:0x7fc4fe2a7700], session.commit_transaction: journal/WiredTigerLog.0000000215 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T14:19:59.205-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:19:59.216-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fc50be8b9d1 0x7fc50b02c8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FC50BE84000","o":"79D1"},{"b":"7FC50AF44000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6C6FF000", "elfType" : 3 }, { "b" : "7FC50BE84000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC50BC7C000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC50BA78000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC50B772000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FC50B4EE000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC50B2D8000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC50AF44000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC50C0A1000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fc50be8b9d1] libc.so.6(clone+0x6D) [0x7fc50b02c8fd] ----- END BACKTRACE ----- 2015-03-02T14:19:59.216-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:20:48.883-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:20:48.903-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:20:48.903-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:20:48.903-0500 I CONTROL [initandlisten] 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:20:48.905-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:20:48.912-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:20:48.979-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:20:48.979-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:20:48.979-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:20:59.092-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:20:59.217-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51791 #1 (1 connection now open) 2015-03-02T14:20:59.227-0500 E STORAGE [conn1] WiredTiger (28) [1425324059:227253][1276:0x7fd8e08d5700], session.commit_transaction: journal/WiredTigerLog.0000000216 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:20:59.227-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:20:59.238-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fd8ee4b99d1 0x7fd8ed65a8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FD8EE4B2000","o":"79D1"},{"b":"7FD8ED572000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAECFF000", "elfType" : 3 }, { "b" : "7FD8EE4B2000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FD8EE2AA000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FD8EE0A6000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FD8EDDA0000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FD8EDB1C000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FD8ED906000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FD8ED572000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FD8EE6CF000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fd8ee4b99d1] libc.so.6(clone+0x6D) [0x7fd8ed65a8fd] ----- END BACKTRACE ----- 2015-03-02T14:20:59.238-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:21:47.296-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:21:47.312-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:21:47.312-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:21:47.312-0500 I CONTROL [initandlisten] 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:21:47.315-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:21:47.322-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:21:47.386-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:21:47.386-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:21:47.387-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:21:57.496-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:21:59.247-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51814 #1 (1 connection now open) 2015-03-02T14:21:59.256-0500 E STORAGE [conn1] WiredTiger (28) [1425324119:256807][1278:0x7fc3ee0cb700], session.commit_transaction: journal/WiredTigerLog.0000000217 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:21:59.256-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:21:59.267-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fc3fbcaf9d1 0x7fc3fae508fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FC3FBCA8000","o":"79D1"},{"b":"7FC3FAD68000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF762B3000", "elfType" : 3 }, { "b" : "7FC3FBCA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FC3FBAA0000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FC3FB89C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FC3FB596000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FC3FB312000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FC3FB0FC000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FC3FAD68000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FC3FBEC5000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fc3fbcaf9d1] libc.so.6(clone+0x6D) [0x7fc3fae508fd] ----- END BACKTRACE ----- 2015-03-02T14:21:59.267-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:22:43.892-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:22:43.912-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:22:43.912-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:22:43.912-0500 I CONTROL [initandlisten] 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:22:43.913-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:22:43.921-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:22:43.991-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:22:43.991-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:22:43.991-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:22:54.094-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:22:54.262-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51844 #1 (1 connection now open) 2015-03-02T14:22:54.271-0500 E STORAGE [conn1] WiredTiger (28) [1425324174:271894][1278:0x7f19ef6c9700], session.commit_transaction: journal/WiredTigerLog.0000000218 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:22:54.271-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:22:54.283-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f19fd2ad9d1 0x7f19fc44e8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F19FD2A6000","o":"79D1"},{"b":"7F19FC366000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF566FF000", "elfType" : 3 }, { "b" : "7F19FD2A6000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F19FD09E000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F19FCE9A000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F19FCB94000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F19FC910000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F19FC6FA000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F19FC366000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F19FD4C3000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f19fd2ad9d1] libc.so.6(clone+0x6D) [0x7f19fc44e8fd] ----- END BACKTRACE ----- 2015-03-02T14:22:54.283-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:23:47.496-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:23:47.513-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:23:47.513-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:23:47.513-0500 I CONTROL [initandlisten] 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:23:47.514-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:23:47.522-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:23:47.574-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:23:47.574-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:23:47.575-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:23:57.713-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:23:59.263-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51871 #1 (1 connection now open) 2015-03-02T14:23:59.276-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:23:59.340-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51872 #2 (2 connections now open) 2015-03-02T14:24:00.801-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51873 #3 (3 connections now open) 2015-03-02T14:24:01.142-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:24:01.148-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:24:01.152-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 345ms 2015-03-02T14:24:01.152-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1806ms 2015-03-02T14:24:01.152-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1874ms 2015-03-02T14:24:01.158-0500 E STORAGE [conn2] WiredTiger (28) [1425324241:158794][1276:0x7f52fd94a700], session.commit_transaction: journal/WiredTigerLog.0000000219 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:24:01.158-0500 I - [conn2] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:24:01.166-0500 E STORAGE [conn1] WiredTiger (28) [1425324241:166041][1276:0x7f52fda4b700], session.commit_transaction: journal/WiredTigerLog.0000000219 write error: failed to write 640 bytes at offset 4480: No space left on device 2015-03-02T14:24:01.166-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:24:01.167-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:24:01.187-0500 I CONTROL [conn2] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f530b62f9d1 0x7f530a7d08fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F530B628000","o":"79D1"},{"b":"7F530A6E8000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF602C2000", "elfType" : 3 }, { "b" : "7F530B628000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F530B420000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F530B21C000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F530AF16000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F530AC92000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F530AA7C000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F530A6E8000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F530B845000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f530b62f9d1] libc.so.6(clone+0x6D) [0x7f530a7d08fd] ----- END BACKTRACE ----- 2015-03-02T14:24:01.187-0500 I - [conn2] ***aborting after invariant() failure 2015-03-02T14:24:48.845-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:24:48.870-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:24:48.870-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:24:48.870-0500 I CONTROL [initandlisten] 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:24:48.874-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:24:48.882-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:24:48.937-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:24:48.937-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:24:48.938-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:24:59.065-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:24:59.248-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51900 #1 (1 connection now open) 2015-03-02T14:24:59.271-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:24:59.324-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51901 #2 (2 connections now open) 2015-03-02T14:25:00.793-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51902 #3 (3 connections now open) 2015-03-02T14:25:01.028-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:25:01.035-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:25:01.038-0500 I COMMAND [conn3] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 240ms 2015-03-02T14:25:01.039-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 1709ms 2015-03-02T14:25:01.039-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1767ms 2015-03-02T14:25:01.059-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:25:01.061-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:25:01.067-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:25:01.242-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:25:01.245-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:25:01.248-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:25:01.257-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:25:01.262-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:25:01.263-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:25:01.269-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 209ms 2015-03-02T14:25:01.271-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 209ms 2015-03-02T14:25:01.273-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 206ms 2015-03-02T14:25:01.291-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:25:01.296-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:25:01.298-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:25:01.476-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:25:01.481-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:25:01.485-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:25:01.492-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:25:01.495-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:25:01.497-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 200ms 2015-03-02T14:25:01.498-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:25:01.500-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 209ms 2015-03-02T14:25:01.505-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 207ms 2015-03-02T14:25:01.507-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:25:01.513-0500 E STORAGE [conn3] WiredTiger (28) [1425324301:513146][1278:0x7f4845bc8700], session.commit_transaction: journal/WiredTigerLog.0000000220 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:25:01.513-0500 I - [conn3] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:25:01.537-0500 I CONTROL [conn3] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f48539ae9d1 0x7f4852b4f8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F48539A7000","o":"79D1"},{"b":"7F4852A67000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFA8492000", "elfType" : 3 }, { "b" : "7F48539A7000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F485379F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F485359B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F4853295000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F4853011000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F4852DFB000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F4852A67000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F4853BC4000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f48539ae9d1] libc.so.6(clone+0x6D) [0x7f4852b4f8fd] ----- END BACKTRACE ----- 2015-03-02T14:25:01.537-0500 I - [conn3] ***aborting after invariant() failure 2015-03-02T14:25:52.714-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:25:52.733-0500 I CONTROL [initandlisten] MongoDB starting : pid=1277 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:25:52.733-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:25:52.733-0500 I CONTROL [initandlisten] 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:25:52.734-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:25:52.735-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:25:52.735-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:25:52.741-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:25:52.821-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:25:52.821-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:25:52.821-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:26:02.929-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:26:05.818-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51925 #1 (1 connection now open) 2015-03-02T14:26:06.905-0500 E STORAGE [conn1] WiredTiger (28) [1425324366:905849][1277:0x7f228a34a700], session.commit_transaction: journal/WiredTigerLog.0000000221 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:26:06.905-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:26:06.915-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f2297f2e9d1 0x7f22970cf8fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F2297F27000","o":"79D1"},{"b":"7F2296FE7000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF2E2FF000", "elfType" : 3 }, { "b" : "7F2297F27000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F2297D1F000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F2297B1B000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F2297815000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F2297591000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F229737B000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F2296FE7000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F2298144000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f2297f2e9d1] libc.so.6(clone+0x6D) [0x7f22970cf8fd] ----- END BACKTRACE ----- 2015-03-02T14:26:06.916-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:26:58.237-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:26:58.254-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:26:58.254-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:26:58.254-0500 I CONTROL [initandlisten] 2015-03-02T14:26:58.256-0500 I CONTROL [initandlisten] 2015-03-02T14:26:58.256-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:26:58.257-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:26:58.265-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:26:58.343-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:26:58.343-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:26:58.343-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:27:08.458-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:27:09.273-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51952 #1 (1 connection now open) 2015-03-02T14:27:10.312-0500 E STORAGE [conn1] WiredTiger (28) [1425324430:312060][1278:0x7f96c9e2d700], session.commit_transaction: journal/WiredTigerLog.0000000222 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:27:10.312-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:27:10.321-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f96d7a119d1 0x7f96d6bb28fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F96D7A0A000","o":"79D1"},{"b":"7F96D6ACA000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF748FF000", "elfType" : 3 }, { "b" : "7F96D7A0A000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F96D7802000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F96D75FE000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F96D72F8000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F96D7074000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F96D6E5E000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F96D6ACA000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F96D7C27000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f96d7a119d1] libc.so.6(clone+0x6D) [0x7f96d6bb28fd] ----- END BACKTRACE ----- 2015-03-02T14:27:10.321-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:28:00.280-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:28:00.297-0500 I CONTROL [initandlisten] MongoDB starting : pid=1279 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:28:00.297-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:28:00.297-0500 I CONTROL [initandlisten] 2015-03-02T14:28:00.300-0500 I CONTROL [initandlisten] 2015-03-02T14:28:00.300-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:28:00.300-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:28:00.300-0500 I CONTROL [initandlisten] 2015-03-02T14:28:00.300-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:28:00.300-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:28:00.301-0500 I CONTROL [initandlisten] 2015-03-02T14:28:00.301-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:28:00.301-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:28:00.301-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:28:00.301-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:28:00.301-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:28:00.307-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:28:00.400-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:28:00.400-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:28:00.400-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:28:10.509-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:28:14.391-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:51976 #1 (1 connection now open) 2015-03-02T14:28:14.402-0500 E STORAGE [conn1] WiredTiger (28) [1425324494:402776][1279:0x7fb00eed0700], session.commit_transaction: journal/WiredTigerLog.0000000223 write error: failed to write 128 bytes at offset 4096: No space left on device 2015-03-02T14:28:14.402-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:28:14.413-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x9e4c98 0xbc02a4 0xbc0654 0xbc11dd 0x993e8a 0x9976e5 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7fb01cab49d1 0x7fb01bc558fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"5E4C98"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"593E8A"},{"b":"400000","o":"5976E5"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7FB01CAAD000","o":"79D1"},{"b":"7FB01BB6D000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF97AFF000", "elfType" : 3 }, { "b" : "7FB01CAAD000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7FB01C8A5000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7FB01C6A1000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7FB01C39B000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7FB01C117000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7FB01BF01000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7FB01BB6D000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7FB01CCCA000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11DeleteStage4workEPm+0x348) [0x9e4c98] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execRemoveERKNS_12BatchItemRefEPPNS_16WriteErrorDetailE+0x3DA) [0x993e8a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0xF5) [0x9976e5] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7fb01cab49d1] libc.so.6(clone+0x6D) [0x7fb01bc558fd] ----- END BACKTRACE ----- 2015-03-02T14:28:14.413-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:29:00.454-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:29:00.470-0500 I CONTROL [initandlisten] MongoDB starting : pid=1280 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:29:00.471-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:29:00.471-0500 I CONTROL [initandlisten] 2015-03-02T14:29:00.471-0500 I CONTROL [initandlisten] 2015-03-02T14:29:00.471-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:29:00.471-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:29:00.472-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:29:00.483-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:29:00.592-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:29:00.592-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:29:00.592-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,ses2015-03-02T14:30:54.830-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:30:54.850-0500 I CONTROL [initandlisten] MongoDB starting : pid=1273 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:30:54.850-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:30:54.850-0500 I CONTROL [initandlisten] 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:30:54.851-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:30:54.857-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:30:54.926-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:30:54.926-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:30:54.927-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:31:05.054-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:31:05.841-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52038 #1 (1 connection now open) 2015-03-02T14:31:05.864-0500 E STORAGE [conn1] WiredTiger (28) [1425324665:864701][1273:0x7f8d291b4700], session.commit_transaction: journal/WiredTigerLog.0000000226 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:31:05.864-0500 I - [conn1] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:31:05.877-0500 I CONTROL [conn1] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0xa1f773 0xa200f5 0xbc02a4 0xbc0654 0xbc11dd 0x994929 0x9977e2 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f8d36d989d1 0x7f8d35f398fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"61F773"},{"b":"400000","o":"6200F5"},{"b":"400000","o":"7C02A4"},{"b":"400000","o":"7C0654"},{"b":"400000","o":"7C11DD"},{"b":"400000","o":"594929"},{"b":"400000","o":"5977E2"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F8D36D91000","o":"79D1"},{"b":"7F8D35E51000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF0EE2F000", "elfType" : 3 }, { "b" : "7F8D36D91000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F8D36B89000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F8D36985000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F8D3667F000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F8D363FB000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F8D361E5000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F8D35E51000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F8D36FAE000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo11UpdateStage18transformAndUpdateERKNS_11SnapshottedINS_7BSONObjEEERNS_8RecordIdE+0x4D3) [0xa1f773] mongod(_ZN5mongo11UpdateStage4workEPm+0x3E5) [0xa200f5] mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbc02a4] mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbc0654] mongod(_ZN5mongo12PlanExecutor11executePlanEv+0x3D) [0xbc11dd] mongod(_ZN5mongo18WriteBatchExecutor10execUpdateERKNS_12BatchItemRefEPNS_7BSONObjEPPNS_16WriteErrorDetailE+0x679) [0x994929] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x1F2) [0x9977e2] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f8d36d989d1] libc.so.6(clone+0x6D) [0x7f8d35f398fd] ----- END BACKTRACE ----- 2015-03-02T14:31:05.877-0500 I - [conn1] ***aborting after invariant() failure 2015-03-02T14:32:02.726-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:32:02.744-0500 I CONTROL [initandlisten] MongoDB starting : pid=1311 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:32:02.744-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:32:02.744-0500 I CONTROL [initandlisten] 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:32:02.750-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:32:02.759-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:32:02.857-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:32:02.857-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:32:02.857-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:32:12.992-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:32:14.464-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52065 #1 (1 connection now open) 2015-03-02T14:32:14.474-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:32:15.937-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52066 #2 (2 connections now open) 2015-03-02T14:32:16.217-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:32:16.223-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:32:16.226-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 282ms 2015-03-02T14:32:16.226-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11681 locks:{} 1752ms 2015-03-02T14:32:16.963-0500 E STORAGE [conn2] WiredTiger (28) [1425324736:963725][1311:0x7f1021390700], session.commit_transaction: journal/WiredTigerLog.0000000227 write error: failed to write 384 bytes at offset 4096: No space left on device 2015-03-02T14:32:16.963-0500 I - [conn2] Invariant failure: s->commit_transaction(s, NULL) resulted in status UnknownError 28: No space left on device at src/mongo/db/storage/wiredtiger/wiredtiger_recovery_unit.cpp 289 2015-03-02T14:32:16.974-0500 I CONTROL [conn2] 0xf42359 0xeec481 0xed245a 0xd6353c 0xd6364a 0x8f6e8c 0x996a98 0x99755a 0x997624 0x997d35 0x99a96d 0x9bcad4 0x9bda13 0x9be60b 0xb8e5a5 0xaa0639 0x7e7590 0xf0040b 0x7f102f0759d1 0x7f102e2168fd ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"B42359"},{"b":"400000","o":"AEC481"},{"b":"400000","o":"AD245A"},{"b":"400000","o":"96353C"},{"b":"400000","o":"96364A"},{"b":"400000","o":"4F6E8C"},{"b":"400000","o":"596A98"},{"b":"400000","o":"59755A"},{"b":"400000","o":"597624"},{"b":"400000","o":"597D35"},{"b":"400000","o":"59A96D"},{"b":"400000","o":"5BCAD4"},{"b":"400000","o":"5BDA13"},{"b":"400000","o":"5BE60B"},{"b":"400000","o":"78E5A5"},{"b":"400000","o":"6A0639"},{"b":"400000","o":"3E7590"},{"b":"400000","o":"B0040B"},{"b":"7F102F06E000","o":"79D1"},{"b":"7F102E12E000","o":"E88FD"}],"processInfo":{ "mongodbVersion" : "3.0.0", "gitVersion" : "a841fd6394365954886924a35076691b4d149168", "uname" : { "sysname" : "Linux", "release" : "2.6.32-504.3.3.el6.x86_64", "version" : "#1 SMP Wed Dec 17 01:55:02 UTC 2014", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFAC4FF000", "elfType" : 3 }, { "b" : "7F102F06E000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F102EE66000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F102EC62000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F102E95C000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F102E6D8000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F102E4C2000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F102E12E000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F102F28B000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf42359] mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeec481] mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xDA) [0xed245a] mongod(_ZN5mongo22WiredTigerRecoveryUnit9_txnCloseEb+0x2EC) [0xd6353c] mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0x8A) [0xd6364a] mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x1C) [0x8f6e8c] mongod(_ZN5mongo18WriteBatchExecutor13execOneInsertEPNS0_16ExecInsertsStateEPPNS_16WriteErrorDetailE+0xBD8) [0x996a98] mongod(_ZN5mongo18WriteBatchExecutor11execInsertsERKNS_21BatchedCommandRequestEPSt6vectorIPNS_16WriteErrorDetailESaIS6_EE+0x27A) [0x99755a] mongod(_ZN5mongo18WriteBatchExecutor11bulkExecuteERKNS_21BatchedCommandRequestEPSt6vectorIPNS_19BatchedUpsertDetailESaIS6_EEPS4_IPNS_16WriteErrorDetailESaISB_EE+0x34) [0x997624] mongod(_ZN5mongo18WriteBatchExecutor12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x3A5) [0x997d35] mongod(_ZN5mongo8WriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x15D) [0x99a96d] mongod(_ZN5mongo12_execCommandEPNS_16OperationContextEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x34) [0x9bcad4] mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_iPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xC13) [0x9bda13] mongod(_ZN5mongo12_runCommandsEPNS_16OperationContextEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x28B) [0x9be60b] mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_b+0x755) [0xb8e5a5] mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortEb+0xB19) [0xaa0639] mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xE0) [0x7e7590] mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x32B) [0xf0040b] libpthread.so.0(+0x79D1) [0x7f102f0759d1] libc.so.6(clone+0x6D) [0x7f102e2168fd] ----- END BACKTRACE ----- 2015-03-02T14:32:16.975-0500 I - [conn2] ***aborting after invariant() failure 2015-03-02T14:33:02.900-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:33:02.921-0500 I CONTROL [initandlisten] MongoDB starting : pid=1391 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:33:02.921-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:33:02.921-0500 I CONTROL [initandlisten] 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:33:02.922-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:33:02.932-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:33:02.998-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:33:03.056-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:33:04.492-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52085 #1 (1 connection now open) 2015-03-02T14:33:04.502-0500 I INDEX [conn1] build index on: test.foo properties: { v: 1, key: { x: 1.0 }, name: "x_1", ns: "test.foo" } 2015-03-02T14:33:04.502-0500 I INDEX [conn1] building index using bulk method 2015-03-02T14:33:04.510-0500 I INDEX [conn1] build index done. scanned 0 total records. 0 secs 2015-03-02T14:33:04.514-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.514-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.514-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.521-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.521-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.521-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.523-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.524-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.524-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.526-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.526-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.526-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.530-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.530-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.530-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.533-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.534-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.534-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.537-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.537-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (1 records 46 bytes) is inconsistent with full validation results (0 records 0 bytes). Updating size storer with new values. 2015-03-02T14:33:04.537-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.537-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.540-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.540-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.540-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.543-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.543-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (0 records 0 bytes) is inconsistent with full validation results (1 records 46 bytes). Updating size storer with new values. 2015-03-02T14:33:04.543-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.543-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:04.546-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:04.546-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:04.546-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:05.974-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52086 #2 (2 connections now open) 2015-03-02T14:33:05.984-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:33:06.003-0500 W STORAGE [conn2] table:collection-2-7426715487060058096: Existing data in size storer (1997 records 20504954 bytes) is inconsistent with full validation results (2001 records 20546046 bytes). Updating size storer with new values. 2015-03-02T14:33:06.004-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:33:06.004-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:33:09.412-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52089 #3 (3 connections now open) 2015-03-02T14:33:09.422-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:09.633-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (9997 records 102688954 bytes) is inconsistent with full validation results (10001 records 102730046 bytes). Updating size storer with new values. 2015-03-02T14:33:09.633-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:09.634-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:09.635-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 212ms 2015-03-02T14:33:09.644-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:09.667-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:09.669-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:09.675-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:09.723-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:09.724-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:09.965-0500 I WRITE [conn3] remove test.foo query: { x: { $gte: 2185.0 } } ndeleted:5816 keyUpdates:0 writeConflicts:0 numYields:45 locks:{} 232ms 2015-03-02T14:33:09.965-0500 I COMMAND [conn3] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2185.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 233ms 2015-03-02T14:33:09.971-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:10.003-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (5005 records 51406138 bytes) is inconsistent with full validation results (4185 records 42992505 bytes). Updating size storer with new values. 2015-03-02T14:33:10.004-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:10.006-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:10.021-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:10.032-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:10.038-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:10.043-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:10.064-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:10.064-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:10.070-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:10.091-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:10.092-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:10.098-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:10.108-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:10.118-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:11.013-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:11.059-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (6365 records 65387645 bytes) is inconsistent with full validation results (7185 records 73811505 bytes). Updating size storer with new values. 2015-03-02T14:33:11.059-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:11.060-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:11.066-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:11.099-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:11.100-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:11.107-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:11.139-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:11.143-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:11.329-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 1892.0 } } ndeleted:3401 keyUpdates:0 writeConflicts:0 numYields:26 locks:{} 177ms 2015-03-02T14:33:11.329-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 1892.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 177ms 2015-03-02T14:33:11.333-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:11.355-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (5005 records 51416365 bytes) is inconsistent with full validation results (4784 records 49146032 bytes). Updating size storer with new values. 2015-03-02T14:33:11.360-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:11.362-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:11.367-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:11.378-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:11.379-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:11.387-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:33:11.401-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:33:11.404-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:33:12.838-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 120ms 2015-03-02T14:33:16.466-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 101ms 2015-03-02T14:33:16.728-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 115ms 2015-03-02T14:33:17.535-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T14:33:19.484-0500 I NETWORK [conn1] end connection 10.4.127.218:52085 (2 connections now open) 2015-03-02T14:33:19.515-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52090 #4 (3 connections now open) 2015-03-02T14:33:19.757-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:20.310-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (27563 records 283154699 bytes) is inconsistent with full validation results (27784 records 285425032 bytes). Updating size storer with new values. 2015-03-02T14:33:20.311-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:20.315-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:20.317-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 560ms 2015-03-02T14:33:20.322-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:20.396-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:20.399-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:20.405-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:20.476-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:20.480-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:22.793-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:33:23.075-0500 W STORAGE [conn2] table:collection-2-7426715487060058096: Existing data in size storer (32563 records 334519699 bytes) is inconsistent with full validation results (32784 records 336790032 bytes). Updating size storer with new values. 2015-03-02T14:33:23.075-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:33:23.080-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:33:23.082-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 289ms 2015-03-02T14:33:23.094-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:33:23.216-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:33:23.228-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:33:23.236-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 142ms 2015-03-02T14:33:26.048-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T14:33:27.196-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 122ms 2015-03-02T14:33:28.483-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:33:28.938-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T14:33:29.163-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (46784 records 480612032 bytes) are inconsistent with full validation results (45784 records 470339032 bytes). Updating counters with new values. 2015-03-02T14:33:29.163-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (46563 records 478341699 bytes) is inconsistent with full validation results (45784 records 470339032 bytes). Updating size storer with new values. 2015-03-02T14:33:29.163-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:33:29.174-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:33:29.177-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 694ms 2015-03-02T14:33:29.432-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52091 #5 (4 connections now open) 2015-03-02T14:33:29.470-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:33:29.474-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 174ms 2015-03-02T14:33:29.828-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing record and data size counters (46784 records 480664435 bytes) are inconsistent with full validation results (47768 records 490750408 bytes). Updating counters with new values. 2015-03-02T14:33:29.828-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing data in size storer (46784 records 480661159 bytes) is inconsistent with full validation results (47768 records 490750408 bytes). Updating size storer with new values. 2015-03-02T14:33:29.828-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:33:29.838-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:33:29.847-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 376ms 2015-03-02T14:33:31.692-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 233ms 2015-03-02T14:33:31.790-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 224ms 2015-03-02T14:33:31.882-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 5064.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:37488 nscannedObjects:37488 nMatched:18744 nModified:18744 keyUpdates:1 writeConflicts:0 numYields:322 locks:{} 2703ms 2015-03-02T14:33:31.883-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5064.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2703ms 2015-03-02T14:33:31.883-0500 I NETWORK [conn3] end connection 10.4.127.218:52089 (3 connections now open) 2015-03-02T14:33:35.953-0500 I NETWORK [conn2] end connection 10.4.127.218:52086 (2 connections now open) 2015-03-02T14:33:35.983-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52092 #6 (3 connections now open) 2015-03-02T14:33:36.019-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:33:36.514-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 125ms 2015-03-02T14:33:36.617-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing record and data size counters (57768 records 593671677 bytes) are inconsistent with full validation results (56784 records 583585704 bytes). Updating counters with new values. 2015-03-02T14:33:36.617-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing data in size storer (56803 records 583758232 bytes) is inconsistent with full validation results (56784 records 583585704 bytes). Updating size storer with new values. 2015-03-02T14:33:36.617-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:33:36.623-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:33:36.630-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11440 locks:{} 611ms 2015-03-02T14:33:37.028-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 111ms 2015-03-02T14:33:38.451-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 6135.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:41218 nscannedObjects:41218 nMatched:20609 nModified:20609 keyUpdates:1 writeConflicts:0 numYields:327 locks:{} 1816ms 2015-03-02T14:33:38.452-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 6135.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1817ms 2015-03-02T14:33:38.455-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:33:39.199-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing data in size storer (58210 records 598259247 bytes) is inconsistent with full validation results (58784 records 604155949 bytes). Updating size storer with new values. 2015-03-02T14:33:39.199-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:33:39.207-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:33:39.222-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11444 locks:{} 767ms 2015-03-02T14:33:39.851-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 107ms 2015-03-02T14:33:39.855-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T14:33:40.359-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing record and data size counters (59784 records 614567516 bytes) are inconsistent with full validation results (60784 records 624798214 bytes). Updating counters with new values. 2015-03-02T14:33:40.359-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing data in size storer (59784 records 614564487 bytes) is inconsistent with full validation results (60784 records 624798214 bytes). Updating size storer with new values. 2015-03-02T14:33:40.359-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T14:33:40.381-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T14:33:40.393-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11444 locks:{} 537ms 2015-03-02T14:33:40.998-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 167ms 2015-03-02T14:33:43.219-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 200ms 2015-03-02T14:33:45.705-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 150ms 2015-03-02T14:33:48.744-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 186ms 2015-03-02T14:33:49.524-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52093 #7 (4 connections now open) 2015-03-02T14:33:49.983-0500 I WRITE [conn6] update test.foo query: { x: { $gte: 108.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:140579 nscannedObjects:140579 nMatched:61920 nModified:61920 keyUpdates:1 writeConflicts:7194 numYields:1191 locks:{} 10758ms 2015-03-02T14:33:49.983-0500 I COMMAND [conn6] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 108.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 10758ms 2015-03-02T14:33:49.988-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:33:51.114-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing record and data size counters (56018 records 576147614 bytes) are inconsistent with full validation results (62078 records 638523076 bytes). Updating counters with new values. 2015-03-02T14:33:51.114-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing data in size storer (56316 records 579212842 bytes) is inconsistent with full validation results (62078 records 638523076 bytes). Updating size storer with new values. 2015-03-02T14:33:51.119-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:33:51.149-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:33:51.219-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 1230ms 2015-03-02T14:33:51.279-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:33:52.171-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 194ms 2015-03-02T14:33:52.176-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:33:52.180-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing record and data size counters (57061 records 586905214 bytes) are inconsistent with full validation results (55205 records 567827398 bytes). Updating counters with new values. 2015-03-02T14:33:52.180-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing data in size storer (57108 records 587389943 bytes) is inconsistent with full validation results (55205 records 567827398 bytes). Updating size storer with new values. 2015-03-02T14:33:52.181-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:33:52.208-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:33:52.231-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 952ms 2015-03-02T14:33:52.287-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:33:52.666-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing record and data size counters (52446 records 539448324 bytes) are inconsistent with full validation results (51018 records 524746916 bytes). Updating counters with new values. 2015-03-02T14:33:52.666-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing data in size storer (52898 records 544097596 bytes) is inconsistent with full validation results (51018 records 524746916 bytes). Updating size storer with new values. 2015-03-02T14:33:52.666-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:33:52.697-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:33:52.702-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing record and data size counters (50813 records 522638286 bytes) are inconsistent with full validation results (50386 records 518246164 bytes). Updating counters with new values. 2015-03-02T14:33:52.702-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing data in size storer (50970 records 524253188 bytes) is inconsistent with full validation results (50386 records 518246164 bytes). Updating size storer with new values. 2015-03-02T14:33:52.703-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:33:52.715-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 539ms 2015-03-02T14:33:52.723-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:33:52.741-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 453ms 2015-03-02T14:33:52.783-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:33:53.062-0500 I WRITE [conn4] update test.foo query: { x: { $gte: 1270.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:123840 nscannedObjects:123840 nMatched:61920 nModified:61920 keyUpdates:1 writeConflicts:18094 numYields:1127 locks:{} 12661ms 2015-03-02T14:33:53.062-0500 I COMMAND [conn4] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1270.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 12661ms 2015-03-02T14:33:53.067-0500 I NETWORK [conn4] end connection 10.4.127.218:52090 (3 connections now open) 2015-03-02T14:33:53.154-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing record and data size counters (46759 records 480938842 bytes) are inconsistent with full validation results (47508 records 488643056 bytes). Updating counters with new values. 2015-03-02T14:33:53.154-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing data in size storer (47547 records 489044210 bytes) is inconsistent with full validation results (47508 records 488643056 bytes). Updating size storer with new values. 2015-03-02T14:33:53.154-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:33:53.171-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:33:53.180-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 397ms 2015-03-02T14:33:53.206-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:33:53.465-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing record and data size counters (43745 records 449936838 bytes) are inconsistent with full validation results (43578 records 448219076 bytes). Updating counters with new values. 2015-03-02T14:33:53.465-0500 W STORAGE [conn6] table:collection-2-7426715487060058096: Existing data in size storer (44296 records 455604424 bytes) is inconsistent with full validation results (43578 records 448219076 bytes). Updating size storer with new values. 2015-03-02T14:33:53.465-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:33:53.479-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:33:53.487-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 280ms 2015-03-02T14:33:54.639-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T14:33:55.399-0500 I WRITE [conn7] remove test.foo query: { x: { $gte: 2622.0 } } ndeleted:63920 keyUpdates:0 writeConflicts:0 numYields:535 locks:{} 5860ms 2015-03-02T14:33:55.399-0500 I COMMAND [conn7] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 2622.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 5860ms 2015-03-02T14:33:55.402-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T14:33:55.556-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T14:33:56.125-0500 W STORAGE [conn7] table:collection-2-7426715487060058096: Existing record and data size counters (6795 records 69843138 bytes) are inconsistent with full validation results (2864 records 29421872 bytes). Updating counters with new values. 2015-03-02T14:33:56.126-0500 W STORAGE [conn7] table:collection-2-7426715487060058096: Existing data in size storer (6461 records 66411956 bytes) is inconsistent with full validation results (2864 records 29421872 bytes). Updating size storer with new values. 2015-03-02T14:33:56.126-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T14:33:56.136-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T14:33:56.167-0500 I COMMAND [conn7] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 764ms 2015-03-02T14:33:56.173-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T14:33:56.191-0500 W STORAGE [conn7] table:collection-2-7426715487060058096: Existing record and data size counters (2864 records 29421872 bytes) are inconsistent with full validation results (3864 records 39694872 bytes). Updating counters with new values. 2015-03-02T14:33:56.191-0500 W STORAGE [conn7] table:collection-2-7426715487060058096: Existing data in size storer (2864 records 29421872 bytes) is inconsistent with full validation results (3864 records 39694872 bytes). Updating size storer with new values. 2015-03-02T14:33:56.192-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T14:33:56.193-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T14:33:56.295-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T14:33:56.322-0500 W STORAGE [conn7] table:collection-2-7426715487060058096: Existing data in size storer (3864 records 39703530 bytes) is inconsistent with full validation results (3878 records 39851694 bytes). Updating size storer with new values. 2015-03-02T14:33:56.323-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T14:33:56.323-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T14:33:56.330-0500 I COMMAND [conn7] CMD: validate test.foo 2015-03-02T14:33:56.344-0500 W STORAGE [conn7] table:collection-2-7426715487060058096: Existing record and data size counters (4033 records 41444009 bytes) are inconsistent with full validation results (3890 records 39974970 bytes). Updating counters with new values. 2015-03-02T14:33:56.345-0500 W STORAGE [conn7] table:collection-2-7426715487060058096: Existing data in size storer (3878 records 39851694 bytes) is inconsistent with full validation results (3890 records 39974970 bytes). Updating size storer with new values. 2015-03-02T14:33:56.345-0500 I INDEX [conn7] validating index test.foo.$_id_ 2015-03-02T14:33:56.347-0500 I INDEX [conn7] validating index test.foo.$x_1 2015-03-02T14:33:56.396-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T14:33:59.404-0500 I NETWORK [conn5] end connection 10.4.127.218:52091 (2 connections now open) 2015-03-02T14:33:59.443-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52095 #8 (3 connections now open) 2015-03-02T14:33:59.453-0500 I COMMAND [conn8] CMD: validate test.foo 2015-03-02T14:33:59.565-0500 W STORAGE [conn8] table:collection-2-7426715487060058096: Existing record and data size counters (11721 records 120422833 bytes) are inconsistent with full validation results (11864 records 121891872 bytes). Updating counters with new values. 2015-03-02T14:33:59.565-0500 W STORAGE [conn8] table:collection-2-7426715487060058096: Existing data in size storer (11387 records 116991651 bytes) is inconsistent with full validation results (11864 records 121891872 bytes). Updating size storer with new values. 2015-03-02T14:33:59.565-0500 I INDEX [conn8] validating index test.foo.$_id_ 2015-03-02T14:33:59.569-0500 I INDEX [conn8] validating index test.foo.$x_1 2015-03-02T14:33:59.570-0500 I COMMAND [conn8] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11452 locks:{} 116ms 2015-03-02T14:33:59.663-0500 I COMMAND [conn8] CMD: validate test.foo 2015-03-02T14:33:59.691-0500 W STORAGE [conn8] table:collection-2-7426715487060058096: Existing data in size storer (11198 records 115041396 bytes) is inconsistent with full validation results (10864 records 111605872 bytes). Updating size storer with new values. 2015-03-02T14:33:59.692-0500 I INDEX [conn8] validating index test.foo.$_id_ 2015-03-02T14:33:59.696-0500 I INDEX [conn8] validating index test.foo.$x_1 2015-03-02T14:33:59.718-0500 I COMMAND [conn8] CMD: validate test.foo 2015-03-02T14:33:59.774-0500 W STORAGE [conn8] table:collection-2-7426715487060058096: Existing data in size storer (10864 records 111605872 bytes) is inconsistent with full validation results (10864 records 111608082 bytes). Updating size storer with new values. 2015-03-02T14:33:59.774-0500 I INDEX [conn8] validating index test.foo.$_id_ 2015-03-02T14:33:59.776-0500 I INDEX [conn8] validating index test.foo.$x_1 2015-03-02T14:33:59.785-0500 I COMMAND [conn8] CMD: validate test.foo 2015-03-02T14:33:59.826-0500 I INDEX [conn8] validating index test.foo.$_id_ 2015-03-02T14:33:59.828-0500 I INDEX [conn8] validating index test.foo.$x_1 2015-03-02T14:34:01.346-0500 I COMMAND [conn8] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 169ms 2015-03-02T14:34:01.347-0500 I COMMAND [conn6] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T14:34:02.893-0500 I COMMAND [conn8] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 137ms 2015-03-02T14:34:02.908-0500 I COMMAND [conn7] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T14:34:05.960-0500 I NETWORK [conn6] end connection 10.4.127.218:52092 (2 connections now open) 2015-03-02T14:34:05.990-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52096 #9 (3 connections now open) 2015-03-02T14:34:07.765-0500 I COMMAND [conn9] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T14:34:09.098-0500 I COMMAND [conn7] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 118ms 2015-03-02T14:34:09.437-0500 I COMMAND [conn8] CMD: validate test.foo 2015-03-02T14:34:09.838-0500 W STORAGE [conn8] table:collection-2-7426715487060058096: Existing data in size storer (32360 records 332436490 bytes) is inconsistent with full validation results (32864 records 337614082 bytes). Updating size storer with new values. 2015-03-02T14:34:09.838-0500 I INDEX [conn8] validating index test.foo.$_id_ 2015-03-02T14:34:09.843-0500 I INDEX [conn8] validating index test.foo.$x_1 2015-03-02T14:34:09.847-0500 I COMMAND [conn8] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11652 locks:{} 409ms 2015-03-02T14:34:38.064-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:34:38.082-0500 I CONTROL [initandlisten] MongoDB starting : pid=1278 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:34:38.082-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:34:38.082-0500 I CONTROL [initandlisten] 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:34:38.084-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:34:38.090-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:34:38.163-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:34:38.163-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:34:38.163-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:34:38.487-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:34:44.589-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52104 #1 (1 connection now open) 2015-03-02T14:34:44.596-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:44.693-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52105 #2 (2 connections now open) 2015-03-02T14:34:45.472-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing record and data size counters (21864 records 224611082 bytes) are inconsistent with full validation results (21867 records 224641901 bytes). Updating counters with new values. 2015-03-02T14:34:45.472-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (21864 records 224611082 bytes) is inconsistent with full validation results (21867 records 224641901 bytes). Updating size storer with new values. 2015-03-02T14:34:45.472-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:45.475-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:45.477-0500 I COMMAND [conn2] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:149 locks:{} 779ms 2015-03-02T14:34:45.477-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 880ms 2015-03-02T14:34:45.481-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:34:45.492-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:45.554-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:34:45.556-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:34:45.563-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:45.565-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:45.567-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:34:45.640-0500 W STORAGE [conn2] table:collection-2-7426715487060058096: Existing record and data size counters (21867 records 224649753 bytes) are inconsistent with full validation results (21867 records 224641901 bytes). Updating counters with new values. 2015-03-02T14:34:45.640-0500 W STORAGE [conn2] table:collection-2-7426715487060058096: Existing data in size storer (21867 records 224641914 bytes) is inconsistent with full validation results (21867 records 224641901 bytes). Updating size storer with new values. 2015-03-02T14:34:45.640-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:34:45.642-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:34:45.659-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:34:45.734-0500 W STORAGE [conn2] table:collection-2-7426715487060058096: Existing record and data size counters (21867 records 224652223 bytes) are inconsistent with full validation results (21867 records 224651937 bytes). Updating counters with new values. 2015-03-02T14:34:45.734-0500 W STORAGE [conn2] table:collection-2-7426715487060058096: Existing data in size storer (21867 records 224647062 bytes) is inconsistent with full validation results (21867 records 224651937 bytes). Updating size storer with new values. 2015-03-02T14:34:45.734-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:34:45.740-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:34:45.984-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 4160.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:9366 nscannedObjects:9366 nMatched:4683 nModified:4683 keyUpdates:1 writeConflicts:0 numYields:73 locks:{} 406ms 2015-03-02T14:34:45.984-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4160.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 406ms 2015-03-02T14:34:45.988-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:46.068-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing record and data size counters (21867 records 224692432 bytes) are inconsistent with full validation results (21867 records 224700570 bytes). Updating counters with new values. 2015-03-02T14:34:46.068-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (21867 records 224685776 bytes) is inconsistent with full validation results (21867 records 224700570 bytes). Updating size storer with new values. 2015-03-02T14:34:46.068-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:46.072-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:46.128-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52106 #3 (3 connections now open) 2015-03-02T14:34:46.156-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:46.235-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (21867 records 224718354 bytes) are inconsistent with full validation results (21867 records 224710515 bytes). Updating counters with new values. 2015-03-02T14:34:46.235-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (21867 records 224717704 bytes) is inconsistent with full validation results (21867 records 224710515 bytes). Updating size storer with new values. 2015-03-02T14:34:46.238-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:46.241-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:46.254-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:46.334-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (21867 records 224721383 bytes) are inconsistent with full validation results (21867 records 224720889 bytes). Updating counters with new values. 2015-03-02T14:34:46.334-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (21867 records 224710515 bytes) is inconsistent with full validation results (21867 records 224720889 bytes). Updating size storer with new values. 2015-03-02T14:34:46.334-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:46.336-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:48.126-0500 I COMMAND [conn2] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 177ms 2015-03-02T14:34:48.472-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1120.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:36067 nscannedObjects:36067 nMatched:16523 nModified:16523 keyUpdates:1 writeConflicts:398 numYields:298 locks:{} 2389ms 2015-03-02T14:34:48.472-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1120.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2389ms 2015-03-02T14:34:48.475-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:48.603-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing record and data size counters (22867 records 235119157 bytes) are inconsistent with full validation results (22867 records 235127490 bytes). Updating counters with new values. 2015-03-02T14:34:48.603-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (22867 records 235119157 bytes) is inconsistent with full validation results (22867 records 235127490 bytes). Updating size storer with new values. 2015-03-02T14:34:48.603-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:48.611-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:48.627-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 151ms 2015-03-02T14:34:48.639-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:48.734-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:48.740-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:48.742-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 102ms 2015-03-02T14:34:48.764-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:48.831-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 7388.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:33046 nscannedObjects:33046 nMatched:16523 nModified:16523 keyUpdates:1 writeConflicts:1276 numYields:278 locks:{} 2483ms 2015-03-02T14:34:48.831-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 7388.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2483ms 2015-03-02T14:34:48.835-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:48.888-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:48.893-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:48.895-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 130ms 2015-03-02T14:34:48.907-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:48.940-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:48.947-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:48.955-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 119ms 2015-03-02T14:34:48.971-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:49.037-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:49.040-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:49.043-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 135ms 2015-03-02T14:34:49.079-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:49.085-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:49.089-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 118ms 2015-03-02T14:34:49.101-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:49.232-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:49.241-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:49.245-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 143ms 2015-03-02T14:34:49.639-0500 I NETWORK [conn2] end connection 10.4.127.218:52105 (2 connections now open) 2015-03-02T14:34:49.668-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52107 #4 (3 connections now open) 2015-03-02T14:34:51.022-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 1787.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:38433 nscannedObjects:38433 nMatched:16523 nModified:16523 keyUpdates:1 writeConflicts:0 numYields:309 locks:{} 1974ms 2015-03-02T14:34:51.022-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1787.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1974ms 2015-03-02T14:34:51.025-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:34:51.150-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:34:51.155-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:34:51.166-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 141ms 2015-03-02T14:34:51.659-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 2001.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:33046 nscannedObjects:33046 nMatched:16523 nModified:16523 keyUpdates:1 writeConflicts:7370 numYields:291 locks:{} 2410ms 2015-03-02T14:34:51.659-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 2001.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 2410ms 2015-03-02T14:34:51.662-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:51.728-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:51.732-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:51.744-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:51.822-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:51.830-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:52.464-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T14:34:52.613-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 156ms 2015-03-02T14:34:53.417-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 9096.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:33046 nscannedObjects:33046 nMatched:16523 nModified:16523 keyUpdates:1 writeConflicts:0 numYields:263 locks:{} 1578ms 2015-03-02T14:34:53.417-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 9096.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 1579ms 2015-03-02T14:34:53.419-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:53.531-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:53.539-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:53.545-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 125ms 2015-03-02T14:34:53.566-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:34:53.693-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:34:53.699-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:34:53.703-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11642 locks:{} 136ms 2015-03-02T14:34:54.470-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T14:34:55.311-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 108ms 2015-03-02T14:34:56.299-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T14:34:57.388-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 110ms 2015-03-02T14:34:57.961-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T14:34:58.220-0500 I COMMAND [conn1] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T14:34:59.574-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52108 #5 (4 connections now open) 2015-03-02T14:34:59.591-0500 I NETWORK [conn1] end connection 10.4.127.218:52104 (3 connections now open) 2015-03-02T14:34:59.599-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:34:59.894-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 145ms 2015-03-02T14:35:00.280-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing record and data size counters (40867 records 420041490 bytes) are inconsistent with full validation results (39867 records 409768490 bytes). Updating counters with new values. 2015-03-02T14:35:00.280-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing data in size storer (40570 records 416990409 bytes) is inconsistent with full validation results (39867 records 409768490 bytes). Updating size storer with new values. 2015-03-02T14:35:00.281-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:00.285-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:00.288-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11646 locks:{} 689ms 2015-03-02T14:35:00.294-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:00.432-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing record and data size counters (39867 records 409768490 bytes) are inconsistent with full validation results (40867 records 420041490 bytes). Updating counters with new values. 2015-03-02T14:35:00.432-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing data in size storer (39867 records 409768490 bytes) is inconsistent with full validation results (40867 records 420041490 bytes). Updating size storer with new values. 2015-03-02T14:35:00.432-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:00.437-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:00.440-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11646 locks:{} 145ms 2015-03-02T14:35:00.445-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:00.529-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:00.534-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:00.560-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:00.651-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:00.656-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:00.674-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:00.836-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing record and data size counters (41390 records 425414269 bytes) are inconsistent with full validation results (40867 records 420041490 bytes). Updating counters with new values. 2015-03-02T14:35:00.838-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:00.850-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:00.860-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11646 locks:{} 185ms 2015-03-02T14:35:00.872-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:00.874-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 114ms 2015-03-02T14:35:01.030-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing record and data size counters (41344 records 424941711 bytes) are inconsistent with full validation results (41851 records 430150122 bytes). Updating counters with new values. 2015-03-02T14:35:01.030-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing data in size storer (41047 records 421890630 bytes) is inconsistent with full validation results (41851 records 430150122 bytes). Updating size storer with new values. 2015-03-02T14:35:01.030-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:01.040-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:01.051-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11646 locks:{} 179ms 2015-03-02T14:35:01.826-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 113ms 2015-03-02T14:35:03.554-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T14:35:04.234-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:04.768-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (50851 records 522607122 bytes) are inconsistent with full validation results (50337 records 517326800 bytes). Updating counters with new values. 2015-03-02T14:35:04.768-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (50554 records 519556041 bytes) is inconsistent with full validation results (50337 records 517326800 bytes). Updating size storer with new values. 2015-03-02T14:35:04.768-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:04.781-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:04.792-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11646 locks:{} 558ms 2015-03-02T14:35:05.260-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 136ms 2015-03-02T14:35:05.482-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 134ms 2015-03-02T14:35:06.140-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52109 #6 (4 connections now open) 2015-03-02T14:35:06.502-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 116ms 2015-03-02T14:35:07.378-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 194ms 2015-03-02T14:35:07.862-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 171ms 2015-03-02T14:35:09.214-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 4459.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:58292 nscannedObjects:58292 nMatched:29146 nModified:29146 keyUpdates:1 writeConflicts:0 numYields:506 locks:{} 4416ms 2015-03-02T14:35:09.214-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 4459.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 2015-03-02T14:35:36.438-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:35:36.453-0500 I CONTROL [initandlisten] MongoDB starting : pid=1275 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:35:36.453-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:35:36.453-0500 I CONTROL [initandlisten] 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] 2015-03-02T14:35:36.456-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:35:36.457-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:35:36.457-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:35:36.457-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:35:36.457-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:35:36.465-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:35:36.534-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:35:36.534-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:35:36.534-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:35:42.523-0500 I NETWORK [initandlisten] waiting for connections on port 27017 2015-03-02T14:35:43.135-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52116 #1 (1 connection now open) 2015-03-02T14:35:43.151-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:35:43.906-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing record and data size counters (21864 records 224611082 bytes) are inconsistent with full validation results (63181 records 649516403 bytes). Updating counters with new values. 2015-03-02T14:35:43.907-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (21864 records 224611082 bytes) is inconsistent with full validation results (63181 records 649516403 bytes). Updating size storer with new values. 2015-03-02T14:35:43.907-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:35:43.914-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:35:43.919-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11649 locks:{} 767ms 2015-03-02T14:35:43.928-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:35:44.170-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:35:44.177-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:35:44.180-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11649 locks:{} 252ms 2015-03-02T14:35:44.735-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52117 #2 (2 connections now open) 2015-03-02T14:35:44.762-0500 I COMMAND [conn2] CMD: validate test.foo 2015-03-02T14:35:45.400-0500 I INDEX [conn2] validating index test.foo.$_id_ 2015-03-02T14:35:45.415-0500 I INDEX [conn2] validating index test.foo.$x_1 2015-03-02T14:35:45.427-0500 I COMMAND [conn2] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11653 locks:{} 664ms 2015-03-02T14:35:46.183-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52118 #3 (3 connections now open) 2015-03-02T14:35:46.232-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:47.335-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (63181 records 649712534 bytes) are inconsistent with full validation results (63181 records 649631544 bytes). Updating counters with new values. 2015-03-02T14:35:47.335-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (63181 records 649705150 bytes) is inconsistent with full validation results (63181 records 649631544 bytes). Updating size storer with new values. 2015-03-02T14:35:47.337-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:47.381-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:47.398-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 1166ms 2015-03-02T14:35:47.439-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:48.286-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (63181 records 649635522 bytes) are inconsistent with full validation results (63181 records 649716512 bytes). Updating counters with new values. 2015-03-02T14:35:48.286-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (63181 records 649635522 bytes) is inconsistent with full validation results (63181 records 649716512 bytes). Updating size storer with new values. 2015-03-02T14:35:48.287-0500 I WRITE [conn1] update test.foo query: { x: { $gte: 5458.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:71858 nscannedObjects:71858 nMatched:35929 nModified:35929 keyUpdates:1 writeConflicts:0 numYields:589 locks:{} 4102ms 2015-03-02T14:35:48.287-0500 I COMMAND [conn1] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 5458.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 4102ms 2015-03-02T14:35:48.289-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:48.291-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:35:48.311-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:48.330-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 891ms 2015-03-02T14:35:49.440-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing record and data size counters (63181 records 649771112 bytes) are inconsistent with full validation results (63181 records 649716512 bytes). Updating counters with new values. 2015-03-02T14:35:49.440-0500 W STORAGE [conn1] table:collection-2-7426715487060058096: Existing data in size storer (63181 records 649771112 bytes) is inconsistent with full validation results (63181 records 649716512 bytes). Updating size storer with new values. 2015-03-02T14:35:49.440-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:35:49.463-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:35:49.485-0500 I COMMAND [conn1] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 1194ms 2015-03-02T14:35:49.723-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52119 #4 (4 connections now open) 2015-03-02T14:35:49.786-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T14:35:51.170-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing record and data size counters (58961 records 606309592 bytes) are inconsistent with full validation results (61060 records 627954506 bytes). Updating counters with new values. 2015-03-02T14:35:51.170-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing data in size storer (58961 records 606309592 bytes) is inconsistent with full validation results (61060 records 627954506 bytes). Updating size storer with new values. 2015-03-02T14:35:51.170-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T14:35:51.200-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T14:35:51.224-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 1437ms 2015-03-02T14:35:51.270-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T14:35:52.495-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing record and data size counters (55199 records 567668260 bytes) are inconsistent with full validation results (58961 records 606364192 bytes). Updating counters with new values. 2015-03-02T14:35:52.495-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing data in size storer (55424 records 569982610 bytes) is inconsistent with full validation results (58961 records 606364192 bytes). Updating size storer with new values. 2015-03-02T14:35:52.495-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T14:35:52.523-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T14:35:52.549-0500 I COMMAND [conn4] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 1279ms 2015-03-02T14:35:54.199-0500 I WRITE [conn2] update test.foo query: { x: { $gte: 1180.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:101246 nscannedObjects:101246 nMatched:50623 nModified:50623 keyUpdates:1 writeConflicts:0 numYields:877 locks:{} 8765ms 2015-03-02T14:35:54.200-0500 I COMMAND [conn2] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 1180.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 8766ms 2015-03-02T14:35:54.202-0500 I NETWORK [conn2] end connection 10.4.127.218:52117 (3 connections now open) 2015-03-02T14:35:56.035-0500 I WRITE [conn3] update test.foo query: { x: { $gte: 718.0 } } update: { $inc: { x: 10000.0 }, $set: { n: "hello" } } nscanned:89352 nscannedObjects:89352 nMatched:42421 nModified:42421 keyUpdates:1 writeConflicts:9155 numYields:779 locks:{} 7696ms 2015-03-02T14:35:56.035-0500 I COMMAND [conn3] command test.$cmd command: update { update: "foo", updates: [ { q: { x: { $gte: 718.0 } }, u: { $inc: { x: 10000.0 }, $set: { n: "hello" } }, multi: true, upsert: true } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:55 locks:{} 7696ms 2015-03-02T14:35:56.038-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:56.270-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (18493 records 190110344 bytes) are inconsistent with full validation results (16145 records 165958816 bytes). Updating counters with new values. 2015-03-02T14:35:56.270-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (19026 records 195592782 bytes) is inconsistent with full validation results (16145 records 165958816 bytes). Updating size storer with new values. 2015-03-02T14:35:56.270-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:56.284-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:56.285-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 246ms 2015-03-02T14:35:56.295-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:56.376-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing record and data size counters (14441 records 148431472 bytes) are inconsistent with full validation results (12260 records 125997706 bytes). Updating counters with new values. 2015-03-02T14:35:56.376-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (14678 records 150869254 bytes) is inconsistent with full validation results (12260 records 125997706 bytes). Updating size storer with new values. 2015-03-02T14:35:56.376-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:56.382-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:56.458-0500 I WRITE [conn4] remove test.foo query: { x: { $gte: 7064.0 } } ndeleted:94 keyUpdates:0 writeConflicts:210 numYields:183 locks:{} 3898ms 2015-03-02T14:35:56.458-0500 I COMMAND [conn4] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 7064.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 3898ms 2015-03-02T14:35:56.461-0500 I COMMAND [conn4] CMD: validate test.foo 2015-03-02T14:35:56.465-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:56.467-0500 I WRITE [conn1] remove test.foo query: { x: { $gte: 8598.0 } } ndeleted:0 keyUpdates:0 writeConflicts:336 numYields:237 locks:{} 6977ms 2015-03-02T14:35:56.467-0500 I COMMAND [conn1] command test.$cmd command: delete { delete: "foo", deletes: [ { q: { x: { $gte: 8598.0 } }, limit: 0.0 } ], ordered: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 6977ms 2015-03-02T14:35:56.470-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:35:56.527-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing record and data size counters (9690 records 99562686 bytes) are inconsistent with full validation results (8358 records 85861734 bytes). Updating counters with new values. 2015-03-02T14:35:56.527-0500 W STORAGE [conn4] table:collection-2-7426715487060058096: Existing data in size storer (10497 records 107863488 bytes) is inconsistent with full validation results (8358 records 85861734 bytes). Updating size storer with new values. 2015-03-02T14:35:56.529-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:56.533-0500 I INDEX [conn4] validating index test.foo.$_id_ 2015-03-02T14:35:56.534-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:35:56.536-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:56.537-0500 I INDEX [conn4] validating index test.foo.$x_1 2015-03-02T14:35:56.540-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:35:56.545-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:56.546-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:35:56.585-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:35:56.587-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:56.588-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:56.590-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:35:56.593-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:35:56.597-0500 I COMMAND [conn1] CMD: validate test.foo 2015-03-02T14:35:56.633-0500 I INDEX [conn1] validating index test.foo.$_id_ 2015-03-02T14:35:56.634-0500 I INDEX [conn1] validating index test.foo.$x_1 2015-03-02T14:35:56.637-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:35:56.638-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:35:59.582-0500 I NETWORK [conn1] end connection 10.4.127.218:52116 (2 connections now open) 2015-03-02T14:35:59.636-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52121 #5 (3 connections now open) 2015-03-02T14:35:59.647-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:59.808-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing data in size storer (13551 records 139209423 bytes) is inconsistent with full validation results (14358 records 147499734 bytes). Updating size storer with new values. 2015-03-02T14:35:59.808-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:59.810-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:59.812-0500 I COMMAND [conn5] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 164ms 2015-03-02T14:35:59.814-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:59.881-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:59.886-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:59.894-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:35:59.981-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:35:59.987-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:35:59.995-0500 I COMMAND [conn5] CMD: validate test.foo 2015-03-02T14:36:00.032-0500 W STORAGE [conn5] table:collection-2-7426715487060058096: Existing data in size storer (14358 records 147499734 bytes) is inconsistent with full validation results (14359 records 147499780 bytes). Updating size storer with new values. 2015-03-02T14:36:00.033-0500 I INDEX [conn5] validating index test.foo.$_id_ 2015-03-02T14:36:00.035-0500 I INDEX [conn5] validating index test.foo.$x_1 2015-03-02T14:36:00.608-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 117ms 2015-03-02T14:36:01.736-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 104ms 2015-03-02T14:36:03.065-0500 I COMMAND [conn3] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 112ms 2015-03-02T14:36:05.869-0500 I COMMAND [conn3] CMD: validate test.foo 2015-03-02T14:36:06.137-0500 W STORAGE [conn3] table:collection-2-7426715487060058096: Existing data in size storer (29551 records 303567196 bytes) is inconsistent with full validation results (30359 records 311867780 bytes). Updating size storer with new values. 2015-03-02T14:36:06.137-0500 I INDEX [conn3] validating index test.foo.$_id_ 2015-03-02T14:36:06.142-0500 I INDEX [conn3] validating index test.foo.$x_1 2015-03-02T14:36:06.149-0500 I COMMAND [conn3] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 280ms 2015-03-02T14:36:06.151-0500 I NETWORK [conn3] end connection 10.4.127.218:52118 (2 connections now open) 2015-03-02T14:36:06.197-0500 I NETWORK [initandlisten] connection accepted from 10.4.127.218:52122 #6 (3 connections now open) 2015-03-02T14:36:06.208-0500 I COMMAND [conn6] CMD: validate test.foo 2015-03-02T14:36:06.303-0500 I INDEX [conn6] validating index test.foo.$_id_ 2015-03-02T14:36:06.322-0500 I INDEX [conn6] validating index test.foo.$x_1 2015-03-02T14:36:06.325-0500 I COMMAND [conn6] command test.$cmd command: validate { validate: "foo", full: true } keyUpdates:0 writeConflicts:0 numYields:0 reslen:11657 locks:{} 117ms 2015-03-02T14:36:06.514-0500 I COMMAND [conn5] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 123ms 2015-03-02T14:36:06.555-0500 I COMMAND [conn4] command test.$cmd command: insert { insert: "foo", documents: 1000, ordered: false } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 128ms 2015-03-02T14:36:07.690-05002015-03-02T14:36:39.994-0500 I CONTROL ***** SERVER RESTARTED ***** 2015-03-02T14:36:40.007-0500 I CONTROL [initandlisten] MongoDB starting : pid=1276 port=27017 dbpath=/data/wiredTiger 64-bit host=centos64vm 2015-03-02T14:36:40.007-0500 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2015-03-02T14:36:40.007-0500 I CONTROL [initandlisten] 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] db version v3.0.0 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] git version: a841fd6394365954886924a35076691b4d149168 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] build info: Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] allocator: tcmalloc 2015-03-02T14:36:40.008-0500 I CONTROL [initandlisten] options: { config: "/etc/mongod.conf", processManagement: { fork: true, pidFilePath: "/var/run/mongodb/mongod.pid" }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", mmapv1: { preallocDataFiles: false, smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } } 2015-03-02T14:36:40.016-0500 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2015-03-02T14:36:40.076-0500 W - [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty. 2015-03-02T14:36:40.076-0500 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2015-03-02T14:36:40.076-0500 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2015-03-02T14:36:41.495-0500 E STORAGE [initandlisten] WiredTiger (-31802) [1425325001:495898][1276:0x7f2a4ce27b60]: journal/WiredTigerLog.0000000006 read error: failed to read 128 bytes at offset 0: WT_ERROR: non-specific WiredTiger error 2015-03-02T14:36:41.506-0500 I - [initandlisten] Assertion: 28595:-31802: WT_ERROR: non-specific WiredTiger error 2015-03-02T14:36:41.509-0500 I STORAGE [initandlisten] exception in initAndListen: 28595 -31802: WT_ERROR: non-specific WiredTiger error, terminating 2015-03-02T14:36:41.509-0500 I CONTROL [initandlisten] dbexit: rc: 100