Tue Nov 6 16:05:12 [rsSync] 66016900/66951032 98% Tue Nov 6 16:05:22 [rsSync] 66870600/66951032 99% Tue Nov 6 16:05:22 [rsSync] done building bottom layer, going to commit Tue Nov 6 16:05:36 [initandlisten] connection accepted from 10.63.11.129:60134 #165 (3 connections now open) Tue Nov 6 16:05:40 [initandlisten] connection accepted from 10.50.38.95:39204 #166 (3 connections now open) Tue Nov 6 16:05:42 [rsSync] old journal file will be removed: /mnt/db/journal/j._2 Tue Nov 6 16:05:57 [rsSync] build index done. scanned 994527 total records. 1180.01 secs Tue Nov 6 16:05:57 [rsSync] replSet initial sync cloning indexes for : DB Tue Nov 6 16:05:57 [rsSync] build index DB.Questions { text: 1 } Tue Nov 6 16:05:57 [rsSync] build index done. scanned 130 total records. 0.432 secs Tue Nov 6 16:05:57 [rsSync] build index DB.Answers { fbId: 1 } Tue Nov 6 16:05:57 [rsSync] build index done. scanned 3305 total records. 0.011 secs Tue Nov 6 16:05:57 [rsSync] build index DB.Answers { friendFbid: 1 } Tue Nov 6 16:05:57 [rsSync] build index done. scanned 3305 total records. 0.01 secs Tue Nov 6 16:05:57 [rsSync] build index DB.Answers { questionId: 1 } Tue Nov 6 16:05:57 [rsSync] build index done. scanned 3305 total records. 0.012 secs Tue Nov 6 16:05:57 [rsSync] build index DB.Users { fbProfile.id: 1 } Tue Nov 6 16:05:57 [rsSync] build index done. scanned 169 total records. 0.001 secs Tue Nov 6 16:05:57 [rsSync] build index DB.Users { fbFriends.data.id: 1 } Tue Nov 6 16:05:59 [rsSync] build index done. scanned 169 total records. 1.502 secs Tue Nov 6 16:05:59 [rsSync] oplog sync 3 of 3 Tue Nov 6 16:05:59 [rsSyncNotifier] repl: old cursor isDead, will initiate a new one Tue Nov 6 16:06:06 [initandlisten] connection accepted from 10.63.11.129:60402 #167 (3 connections now open) Tue Nov 6 16:06:10 [initandlisten] connection accepted from 10.50.38.95:39206 #168 (3 connections now open) Tue Nov 6 16:06:13 [rsSync] replSet initialSyncOplogApplication applied 1799 operations, synced to Nov 6 15:40:04:2f Tue Nov 6 16:06:25 [rsSync] replSet initialSyncOplogApplication applied 2800 operations, synced to Nov 6 15:40:13:4c Tue Nov 6 16:06:30 [DataFileSync] flushing mmaps took 29183ms for 19 files Tue Nov 6 16:06:36 [rsSync] replSet initialSyncOplogApplication applied 7227 operations, synced to Nov 6 15:41:03:b6 Tue Nov 6 16:06:36 [initandlisten] connection accepted from 10.63.11.129:60542 #169 (3 connections now open) Tue Nov 6 16:06:40 [initandlisten] connection accepted from 10.50.38.95:39208 #170 (3 connections now open) Tue Nov 6 16:06:47 [rsSync] replSet initialSyncOplogApplication applied 14256 operations, synced to Nov 6 15:42:32:3 Tue Nov 6 16:06:58 [rsSync] replSet initialSyncOplogApplication applied 19416 operations, synced to Nov 6 15:43:32:73 Tue Nov 6 16:07:06 [initandlisten] connection accepted from 10.63.11.129:60828 #171 (3 connections now open) Tue Nov 6 16:07:10 [rsSync] replSet initialSyncOplogApplication applied 23085 operations, synced to Nov 6 15:44:19:32 Tue Nov 6 16:07:10 [initandlisten] connection accepted from 10.50.38.95:55853 #172 (3 connections now open) Tue Nov 6 16:07:21 [rsSync] replSet initialSyncOplogApplication applied 24290 operations, synced to Nov 6 15:44:36:16 Tue Nov 6 16:07:35 [rsSync] replSet initialSyncOplogApplication applied 25291 operations, synced to Nov 6 15:44:49:56 Tue Nov 6 16:07:36 [initandlisten] connection accepted from 10.63.11.129:60961 #173 (3 connections now open) Tue Nov 6 16:07:40 [initandlisten] connection accepted from 10.50.38.95:55855 #174 (3 connections now open) Tue Nov 6 16:07:49 [rsSync] replSet initialSyncOplogApplication applied 26417 operations, synced to Nov 6 15:45:05:7 Tue Nov 6 16:08:06 [initandlisten] connection accepted from 10.63.11.129:32998 #175 (3 connections now open) Tue Nov 6 16:08:10 [initandlisten] connection accepted from 10.50.38.95:55857 #176 (3 connections now open) Tue Nov 6 16:08:14 [rsSync] replSet initialSyncOplogApplication applied 27423 operations, synced to Nov 6 15:45:14:27 Tue Nov 6 16:08:25 [rsSync] replSet initialSyncOplogApplication applied 28939 operations, synced to Nov 6 15:45:33:6 Tue Nov 6 16:08:25 [DataFileSync] flushing mmaps took 84110ms for 19 files Tue Nov 6 16:08:36 [initandlisten] connection accepted from 10.63.11.129:33137 #177 (3 connections now open) Tue Nov 6 16:08:40 [initandlisten] connection accepted from 10.50.38.95:55859 #178 (3 connections now open) Tue Nov 6 16:08:46 [DataFileSync] flushing mmaps took 21057ms for 19 files Tue Nov 6 16:08:46 [FileAllocator] allocating new datafile /mnt/db/db.9, filling with zeroes... Tue Nov 6 16:08:47 [rsSync] replSet initialSyncOplogApplication applied 29941 operations, synced to Nov 6 15:45:45:14 Tue Nov 6 16:09:06 [initandlisten] connection accepted from 10.63.11.129:33859 #179 (3 connections now open) Tue Nov 6 16:09:10 [initandlisten] connection accepted from 10.50.38.95:55861 #180 (3 connections now open) Tue Nov 6 16:09:36 [initandlisten] connection accepted from 10.63.11.129:34001 #181 (3 connections now open) Tue Nov 6 16:09:40 [initandlisten] connection accepted from 10.50.38.95:55863 #182 (4 connections now open) Tue Nov 6 16:09:50 [FileAllocator] done allocating datafile /mnt/db/db.9, size: 2047MB, took 63.925 secs Tue Nov 6 16:09:50 [journal] old journal file will be removed: /mnt/db/journal/j._3 Tue Nov 6 16:09:50 [rsSync] replSet initialSyncOplogApplication applied 30942 operations, synced to Nov 6 15:45:56:3d Tue Nov 6 16:10:01 [rsSync] replSet initialSyncOplogApplication applied 35163 operations, synced to Nov 6 15:46:45:29 Tue Nov 6 16:10:06 [initandlisten] connection accepted from 10.63.11.129:34253 #183 (3 connections now open) Tue Nov 6 16:10:11 [initandlisten] connection accepted from 10.50.38.95:55865 #184 (3 connections now open) Tue Nov 6 16:10:12 [rsSync] replSet initialSyncOplogApplication applied 39423 operations, synced to Nov 6 15:47:37:5f Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.577MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.585MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.593MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.601MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.61MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.618MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.626MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.634MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.642MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.651MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.659MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.667MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.675MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.683MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.692MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.7MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.708MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.716MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.724MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.733MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.741MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.749MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.757MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.765MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.774MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.782MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.79MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.798MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.806MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.814MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.823MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.831MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.839MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.847MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.855MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.864MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.872MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.88MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.888MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.896MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.905MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.913MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.921MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.929MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.937MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.946MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.954MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.962MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.97MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.978MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.986MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 314.995MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.003MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.011MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.019MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.027MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.036MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.044MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.052MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.06MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.068MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.077MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.085MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.093MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.101MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.109MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.118MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.126MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.134MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.142MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.15MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.159MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.167MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.175MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.183MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.191MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.199MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.208MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.216MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.224MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.232MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.24MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.249MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.257MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.265MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.273MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.281MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.29MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.298MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.306MB 0xaf8c41 0x731c01 0x731cdf 0x731fb2 0x7320cd 0x73213b 0x72bfba 0x6454d6 0x792949 0x793a8a 0x7945fd 0x868654 0x86bd6d 0x83d4d5 0x841cf7 0x82024f 0x99bea2 0x99b737 0xacc4cd 0xb3ec79 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x201) [0x731c01] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents8_unspoolEv+0x4f) [0x731cdf] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents7unspoolEv+0x52) [0x731fb2] /usr/bin/mongod(_ZN5mongo3dur18ThreadLocalIntents4pushERKNS0_11WriteIntentE+0x6d) [0x7320cd] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl18declareWriteIntentEPvj+0x6b) [0x73213b] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x72bfba] /usr/bin/mongod(_ZNK5mongo11BtreeBucketINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x516) [0x6454d6] /usr/bin/mongod(_ZNK5mongo18IndexInterfaceImplINS_12BtreeData_V1EE7unindexENS_7DiskLocERNS_12IndexDetailsERKNS_7BSONObjES3_+0x89) [0x792949] /usr/bin/mongod() [0x793a8a] /usr/bin/mongod(_ZN5mongo13unindexRecordEPNS_16NamespaceDetailsEPNS_6RecordERKNS_7DiskLocEb+0x7d) [0x7945fd] /usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbbb+0x204) [0x868654] /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x3dd) [0x86bd6d] /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x11d5) [0x83d4d5] /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0x841cf7] /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0xabf) [0x82024f] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x292) [0x99bea2] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.314MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.322MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.331MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.339MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.347MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.355MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.363MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.372MB Tue Nov 6 16:10:19 [repl writer worker 3] warning: DR102 too much data written uncommitted 315.38MB Tue Nov 6 16:10:21 [repl writer worker 3] db.UserVisits warning assertion failure a <= 256*1024*1024 src/mongo/util/alignedbuilder.cpp 90 0xaf8c41 0xabe07a 0xabdcc3 0x73b455 0x73b764 0x72e6d4 0x72ec2a 0x72c63c 0x72c74c 0x99beb9 0x99b737 0xacc4cd 0xb3ec79 0x7f93f17fd8ba 0x7f93f0bb102d /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo9wassertedEPKcS1_j+0x11a) [0xabe07a] /usr/bin/mongod(_ZN5mongo14AlignedBuilder14growReallocateEj+0x63) [0xabdcc3] /usr/bin/mongod() [0x73b455] /usr/bin/mongod(_ZN5mongo3dur13PREPLOGBUFFERERNS0_11JSectHeaderERNS_14AlignedBuilderE+0x214) [0x73b764] /usr/bin/mongod() [0x72e6d4] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl9commitNowEv+0x1a) [0x72ec2a] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl16_aCommitIsNeededEv+0x14c) [0x72c63c] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl14commitIfNeededEb+0x4c) [0x72c74c] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x2a9) [0x99beb9] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] /lib/libpthread.so.0(+0x68ba) [0x7f93f17fd8ba] /lib/libc.so.6(clone+0x6d) [0x7f93f0bb102d] Tue Nov 6 16:10:22 [repl writer worker 3] rate limiting wassert Tue Nov 6 16:10:23 [repl writer worker 3] db.UserVisits Assertion failure a <= 512*1024*1024 src/mongo/util/alignedbuilder.cpp 91 0xaf8c41 0xabf4cd 0xabdcdd 0x73b455 0x73b764 0x72e6d4 0x72ec2a 0x72c63c 0x72c74c 0x99beb9 0x99b737 0xacc4cd 0xb3ec79 0x7f93f17fd8ba 0x7f93f0bb102d /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xabf4cd] /usr/bin/mongod(_ZN5mongo14AlignedBuilder14growReallocateEj+0x7d) [0xabdcdd] /usr/bin/mongod() [0x73b455] /usr/bin/mongod(_ZN5mongo3dur13PREPLOGBUFFERERNS0_11JSectHeaderERNS_14AlignedBuilderE+0x214) [0x73b764] /usr/bin/mongod() [0x72e6d4] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl9commitNowEv+0x1a) [0x72ec2a] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl16_aCommitIsNeededEv+0x14c) [0x72c63c] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl14commitIfNeededEb+0x4c) [0x72c74c] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x2a9) [0x99beb9] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] /lib/libpthread.so.0(+0x68ba) [0x7f93f17fd8ba] /lib/libc.so.6(clone+0x6d) [0x7f93f0bb102d] Tue Nov 6 16:10:23 [repl writer worker 3] dbexception in groupCommit causing immediate shutdown: 0 assertion src/mongo/util/alignedbuilder.cpp:91 Tue Nov 6 16:10:23 gc1 Tue Nov 6 16:10:23 Got signal: 6 (Aborted). Tue Nov 6 16:10:23 Backtrace: 0xaf8c41 0x5586c9 0x7f93f0b141e0 0x7f93f0b14165 0x7f93f0b16f70 0x7a5487 0x72ea0a 0x72ec2a 0x72c63c 0x72c74c 0x99beb9 0x99b737 0xacc4cd 0xb3ec79 0x7f93f17fd8ba 0x7f93f0bb102d /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xaf8c41] /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x5586c9] /lib/libc.so.6(+0x321e0) [0x7f93f0b141e0] /lib/libc.so.6(gsignal+0x35) [0x7f93f0b14165] /lib/libc.so.6(abort+0x180) [0x7f93f0b16f70] /usr/bin/mongod(_ZN5mongo10mongoAbortEPKc+0x47) [0x7a5487] /usr/bin/mongod() [0x72ea0a] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl9commitNowEv+0x1a) [0x72ec2a] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl16_aCommitIsNeededEv+0x14c) [0x72c63c] /usr/bin/mongod(_ZN5mongo3dur11DurableImpl14commitIfNeededEb+0x4c) [0x72c74c] /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x2a9) [0x99beb9] /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x37) [0x99b737] /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x26d) [0xacc4cd] /usr/bin/mongod() [0xb3ec79] /lib/libpthread.so.0(+0x68ba) [0x7f93f17fd8ba] /lib/libc.so.6(clone+0x6d) [0x7f93f0bb102d]