2012-05-03_01:32:33.22089 Thu May  3 01:32:33 [conn8] command admin.$cmd command: { writebacklisten: ObjectId('4f9204fb36dcde4b00f48481') } ntoreturn:1 reslen:44 300000ms
2012-05-03_01:32:43.05207 Thu May  3 01:32:43 [rsSync] clone chalk-bump-f49.b.note 1488255
2012-05-03_01:32:48.21775 Thu May  3 01:32:48 [rsSync] 1509195 objects cloned so far from collection chalk-bump-f49.b.note
2012-05-03_01:33:41.14857 Thu May  3 01:33:41 [journal] old journal file will be removed: ./data/journal/j._9
2012-05-03_01:33:43.01237 Thu May  3 01:33:43 [rsSync] clone chalk-bump-f49.b.note 1675647
2012-05-03_01:33:47.25267 Thu May  3 01:33:47 [conn15] command admin.$cmd command: { serverStatus: 1 } ntoreturn:1 reslen:1791 654ms
2012-05-03_01:33:49.14785 Thu May  3 01:33:49 [rsSync] 1693853 objects cloned so far from collection chalk-bump-f49.b.note
2012-05-03_01:33:51.79718 Thu May  3 01:33:51 [conn15] command admin.$cmd command: { serverStatus: 1 } ntoreturn:1 reslen:1791 540ms
2012-05-03_01:33:55.78583 Thu May  3 01:33:55 [FileAllocator] allocating new datafile ./data/chalk-bump-f49/chalk-bump-f49.13, filling with zeroes...
2012-05-03_01:33:55.78666 Thu May  3 01:33:55 [rsSync]  chalk-bump-f49 Assertion failure approxSize < Extent::maxSize() db/pdfile.cpp 437
2012-05-03_01:33:55.79032 Thu May  3 01:33:55 [FileAllocator] done allocating datafile ./data/chalk-bump-f49/chalk-bump-f49.13, size: 2047MB,  took 0.004 secs
2012-05-03_01:33:55.80919 0x57a726 0x58520b 0x8ad13b 0x8a83c6 0x8a85c7 0x8b4069 0x8b576b 0x85aa85 0x5c183a 0x850885 0x852995 0x8542e9 0x82e76a 0x830323 0x828381 0x828438 0x8288d0 0xaabd90 0x7f492afa4d8c 0x7f492a54f04d 
2012-05-03_01:33:55.81360  bin/mongod(_ZN5mongo12sayDbContextEPKc+0x96) [0x57a726]
2012-05-03_01:33:55.81363  bin/mongod(_ZN5mongo8assertedEPKcS1_j+0xfb) [0x58520b]
2012-05-03_01:33:55.81364  bin/mongod(_ZN5mongo13MongoDataFile12createExtentEPKcibi+0x24b) [0x8ad13b]
2012-05-03_01:33:55.81365  bin/mongod(_ZN5mongo10outOfSpaceEPKcPNS_16NamespaceDetailsEibNS_7DiskLocE+0x116) [0x8a83c6]
2012-05-03_01:33:55.81366  bin/mongod(_ZN5mongo26allocateSpaceForANewRecordEPKcPNS_16NamespaceDetailsEib+0x77) [0x8a85c7]
2012-05-03_01:33:55.81367  bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibbPb+0x4a9) [0x8b4069]
2012-05-03_01:33:55.81368  bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x4b) [0x8b576b]
2012-05-03_01:33:55.81369  bin/mongod(_ZN5mongo6Cloner3FunclERNS_27DBClientCursorBatchIteratorE+0x545) [0x85aa85]
2012-05-03_01:33:55.81370  bin/mongod(_ZN5mongo18DBClientConnection5queryEN5boost8functionIFvRNS_27DBClientCursorBatchIteratorEEEERKSsNS_5QueryEPKNS_7BSONObjEi+0x1aa) [0x5c183a]
2012-05-03_01:33:55.81372  bin/mongod(_ZN5mongo6Cloner4copyEPKcS2_bbbbbbNS_5QueryE+0x3c5) [0x850885]
2012-05-03_01:33:55.81373  bin/mongod(_ZN5mongo6Cloner2goEPKcRSsRKSsbbbbbbPi+0x1665) [0x852995]
2012-05-03_01:33:55.81374  bin/mongod(_ZN5mongo9cloneFromEPKcRSsRKSsbbbbbbPi+0x59) [0x8542e9]
2012-05-03_01:33:55.81375  bin/mongod(_ZN5mongo11ReplSetImpl18_syncDoInitialSyncEv+0xe6a) [0x82e76a]
2012-05-03_01:33:55.81378  bin/mongod(_ZN5mongo11ReplSetImpl17syncDoInitialSyncEv+0x23) [0x830323]
2012-05-03_01:33:55.81379  bin/mongod(_ZN5mongo11ReplSetImpl11_syncThreadEv+0x61) [0x828381]
2012-05-03_01:33:55.81380  bin/mongod(_ZN5mongo11ReplSetImpl10syncThreadEv+0x48) [0x828438]
2012-05-03_01:33:55.81381  bin/mongod(_ZN5mongo15startSyncThreadEv+0xa0) [0x8288d0]
2012-05-03_01:33:55.81382  bin/mongod(thread_proxy+0x80) [0xaabd90]
2012-05-03_01:33:55.81383  /lib/x86_64-linux-gnu/libpthread.so.0(+0x6d8c) [0x7f492afa4d8c]
2012-05-03_01:33:55.81384  /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f492a54f04d]
2012-05-03_01:33:55.82802 Thu May  3 01:33:55 [rsSync] Socket flush send() errno:9 Bad file descriptor 10.218.95.168:27018
2012-05-03_01:33:55.82816 Thu May  3 01:33:55 [rsSync]  chalk-bump-f49 caught exception (socket exception) in destructor (~PiggyBackData)
2012-05-03_01:33:55.82837 Thu May  3 01:33:55 [rsSync] replSet initial sync exception 0 assertion db/pdfile.cpp:437
2012-05-03_01:34:10.45220 Thu May  3 01:34:10 [clientcursormon] mem (MB) res:13989 virt:100254 mapped:49865
2012-05-03_01:34:25.82894 Thu May  3 01:34:25 [rsSync] replSet initial sync pending
2012-05-03_01:34:25.82904 Thu May  3 01:34:25 [rsSync] replSet syncing to: mo08.production.simperium.com:27018
2012-05-03_01:34:25.85680 Thu May  3 01:34:25 [rsSync] replSet initial sync drop all databases
2012-05-03_01:34:25.85702 Thu May  3 01:34:25 [rsSync] dropAllDatabasesExceptLocal 6
2012-05-03_01:34:25.85790 Thu May  3 01:34:25 [rsSync] removeJournalFiles
2012-05-03_01:34:25.99980 Thu May  3 01:34:25 [rsSync] removeJournalFiles
2012-05-03_01:34:26.00154 Thu May  3 01:34:25 [rsSync] removeJournalFiles
2012-05-03_01:34:26.05359 Thu May  3 01:34:26 [rsSync] removeJournalFiles
2012-05-03_01:34:26.05538 Thu May  3 01:34:26 [rsSync] removeJournalFiles
2012-05-03_01:34:27.84153 Thu May  3 01:34:27 [conn15] warning: virtual size (86946MB) - mapped size (82328MB) is large (4611MB). could indicate a memory leak
2012-05-03_01:34:27.84153 Thu May  3 01:34:27 [conn15] warning: virtual size (86946MB) - mapped size (82328MB) is large (4611MB). could indicate a memory leak
2012-05-03_01:34:28.58770 Thu May  3 01:34:28 [conn15] serverStatus was very slow: { after basic: 0, middle of mem: 990, after mem: 990, after connections: 990, after extra info: 1730, after co
unters: 1730, after repl: 1730, after asserts: 1730, after dur: 1730, at end: 1730 }
2012-05-03_01:34:28.58775 Thu May  3 01:34:28 [conn15] command admin.$cmd command: { serverStatus: 1 } ntoreturn:1 reslen:2052 1742ms
2012-05-03_01:34:32.71194 Thu May  3 01:34:32 [rsSync] replSet initial sync clone all databases
....