[SERVER-3434] convertToCapped fails with journaling Created: 16/Jul/11  Updated: 12/Jul/16  Resolved: 30/Apr/12

Status: Closed
Project: Core Server
Component/s: Storage
Affects Version/s: None
Fix Version/s: 2.1.1

Type: Bug Priority: Minor - P4
Reporter: Dwight Merriman Assignee: Mathias Stearn
Resolution: Done Votes: 1
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Operating System: ALL
Participants:

 Description   

See below. Need to (1) fix and (2) make a test (i take it there isn't one, at least one that has some size, since it wasn't caught by the unit tests. could be a nightly.)

> db.pstats.convertToCapped(800*1024*1024)
{
"errmsg" : "cloneCollectionAsCapped failed:

{ errmsg: \"exception: DR102 too much data written uncommitted\", code: 13623, ok: 0.0 }

",
"ok" : 0
}



 Comments   
Comment by Mathias Stearn [ 30/Apr/12 ]

Already fixed

Comment by auto [ 30/Dec/11 ]

Author:

{u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: Better handling of temp collections SERVER-3434 SERVER-3501 SERVER-2534
Branch: master
https://github.com/mongodb/mongo/commit/8d9c9ac80c10786bf0d3e4c57a80608c9f89f595

Comment by Mathias Stearn [ 31/Oct/11 ]

Not 100% sure on estimate since I don't know exactly what is required to make this work. Estimate of 1 day includes time figuring that out. May revise upward as I get more info.

Comment by Change.org [ 06/Sep/11 ]

This actually just brought me to my knees, thankfully in my staging environment before I tried it on production.

> db.runCommand(

{"convertToCapped": 'tracked_events', size: 1000000}

)
Tue Sep 6 15:57:47 Error: error doing query: unknown shell/collection.js:150

In The server logs (in massive quantities):

Tue Sep 6 15:59:32 [conn14] change-main..tmp.convertToCapped.tracked_events Assertion failure ! "DR102 too much data written uncommitted" db/dur_commitjob.cpp 204
0x54e8de 0x55f5bf 0x636218 0x62961a 0x77346c 0x773818 0x73bd87 0x730445 0x73048a 0x777704 0x7791bc 0x7793b2 0x7efb22 0x7db210 0x7dc741 0x642c25 0x6477c6 0x752225 0x757938 0x759641
/usr/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xae) [0x54e8de]
/usr/bin/mongod(_ZN5mongo9wassertedEPKcS1_j+0x10f) [0x55f5bf]
/usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x178) [0x636218]
/usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x62961a]
/usr/bin/mongod(_ZN5mongo11DataFileMgr13_deleteRecordEPNS_16NamespaceDetailsEPKcPNS_6RecordERKNS_7DiskLocE+0x15c) [0x77346c]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbb+0x198) [0x773818]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails11cappedAllocEPKci+0x377) [0x73bd87]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails6_allocEPKci+0x25) [0x730445]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails5allocEPKciRNS_7DiskLocE+0x3a) [0x73048a]
/usr/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0x8a4) [0x777704]
/usr/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x4c) [0x7791bc]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12insertAndLogEPKcRKNS_7BSONObjEb+0x52) [0x7793b2]
/usr/bin/mongod(_ZN5mongo26CmdCloneCollectionAsCapped3runERKSsRNS_7BSONObjERSsRNS_14BSONObjBuilderEb+0xae2) [0x7efb22]
/usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x9a0) [0x7db210]
/usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x831) [0x7dc741]
/usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x35) [0x642c25]
/usr/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x2e86) [0x6477c6]
/usr/bin/mongod [0x752225]
/usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_8SockAddrE+0x5b8) [0x757938]
/usr/bin/mongod(_ZN5mongo14DBDirectClient4callERNS_7MessageES2_bPSs+0x81) [0x759641]
Tue Sep 6 15:59:32 [conn14] change-main..tmp.convertToCapped.tracked_events Assertion failure ! "DR102 too much data written uncommitted" db/dur_commitjob.cpp 204
0x54e8de 0x55f5bf 0x636218 0x62961a 0x7734be 0x773818 0x73bd87 0x730445 0x73048a 0x777704 0x7791bc 0x7793b2 0x7efb22 0x7db210 0x7dc741 0x642c25 0x6477c6 0x752225 0x757938 0x759641
/usr/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xae) [0x54e8de]
/usr/bin/mongod(_ZN5mongo9wassertedEPKcS1_j+0x10f) [0x55f5bf]
/usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x178) [0x636218]
/usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x62961a]
/usr/bin/mongod(_ZN5mongo11DataFileMgr13_deleteRecordEPNS_16NamespaceDetailsEPKcPNS_6RecordERKNS_7DiskLocE+0x1ae) [0x7734be]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbb+0x198) [0x773818]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails11cappedAllocEPKci+0x377) [0x73bd87]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails6_allocEPKci+0x25) [0x730445]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails5allocEPKciRNS_7DiskLocE+0x3a) [0x73048a]
/usr/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0x8a4) [0x777704]
/usr/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x4c) [0x7791bc]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12insertAndLogEPKcRKNS_7BSONObjEb+0x52) [0x7793b2]
/usr/bin/mongod(_ZN5mongo26CmdCloneCollectionAsCapped3runERKSsRNS_7BSONObjERSsRNS_14BSONObjBuilderEb+0xae2) [0x7efb22]
/usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x9a0) [0x7db210]
/usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x831) [0x7dc741]
/usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x35) [0x642c25]
/usr/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x2e86) [0x6477c6]
/usr/bin/mongod [0x752225]
/usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_8SockAddrE+0x5b8) [0x757938]
/usr/bin/mongod(_ZN5mongo14DBDirectClient4callERNS_7MessageES2_bPSs+0x81) [0x759641]
Tue Sep 6 15:59:32 [conn14] change-main..tmp.convertToCapped.tracked_events Assertion failure ! "DR102 too much data written uncommitted" db/dur_commitjob.cpp 204
0x54e8de 0x55f5bf 0x636218 0x62961a 0x72e579 0x7735f2 0x773818 0x73bd87 0x730445 0x73048a 0x777704 0x7791bc 0x7793b2 0x7efb22 0x7db210 0x7dc741 0x642c25 0x6477c6 0x752225 0x757938
/usr/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xae) [0x54e8de]
/usr/bin/mongod(_ZN5mongo9wassertedEPKcS1_j+0x10f) [0x55f5bf]
/usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x178) [0x636218]
/usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x62961a]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails13addDeletedRecEPNS_13DeletedRecordENS_7DiskLocE+0x29) [0x72e579]
/usr/bin/mongod(_ZN5mongo11DataFileMgr13_deleteRecordEPNS_16NamespaceDetailsEPKcPNS_6RecordERKNS_7DiskLocE+0x2e2) [0x7735f2]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbb+0x198) [0x773818]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails11cappedAllocEPKci+0x377) [0x73bd87]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails6_allocEPKci+0x25) [0x730445]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails5allocEPKciRNS_7DiskLocE+0x3a) [0x73048a]
/usr/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0x8a4) [0x777704]
/usr/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x4c) [0x7791bc]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12insertAndLogEPKcRKNS_7BSONObjEb+0x52) [0x7793b2]
/usr/bin/mongod(_ZN5mongo26CmdCloneCollectionAsCapped3runERKSsRNS_7BSONObjERSsRNS_14BSONObjBuilderEb+0xae2) [0x7efb22]
/usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x9a0) [0x7db210]
/usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x831) [0x7dc741]
/usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x35) [0x642c25]
/usr/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x2e86) [0x6477c6]
/usr/bin/mongod [0x752225]
/usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_8SockAddrE+0x5b8) [0x757938]
Tue Sep 6 15:59:32 [conn14] change-main..tmp.convertToCapped.tracked_events Assertion failure ! "DR102 too much data written uncommitted" db/dur_commitjob.cpp 204
0x54e8de 0x55f5bf 0x636218 0x62961a 0x72e7d8 0x7735f2 0x773818 0x73bd87 0x730445 0x73048a 0x777704 0x7791bc 0x7793b2 0x7efb22 0x7db210 0x7dc741 0x642c25 0x6477c6 0x752225 0x757938
/usr/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xae) [0x54e8de]
/usr/bin/mongod(_ZN5mongo9wassertedEPKcS1_j+0x10f) [0x55f5bf]
/usr/bin/mongod(_ZN5mongo3dur9CommitJob4noteEPvi+0x178) [0x636218]
/usr/bin/mongod(_ZN5mongo3dur11DurableImpl10writingPtrEPvj+0xa) [0x62961a]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails13addDeletedRecEPNS_13DeletedRecordENS_7DiskLocE+0x288) [0x72e7d8]
/usr/bin/mongod(_ZN5mongo11DataFileMgr13_deleteRecordEPNS_16NamespaceDetailsEPKcPNS_6RecordERKNS_7DiskLocE+0x2e2) [0x7735f2]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12deleteRecordEPKcPNS_6RecordERKNS_7DiskLocEbb+0x198) [0x773818]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails11cappedAllocEPKci+0x377) [0x73bd87]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails6_allocEPKci+0x25) [0x730445]
/usr/bin/mongod(_ZN5mongo16NamespaceDetails5allocEPKciRNS_7DiskLocE+0x3a) [0x73048a]
/usr/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0x8a4) [0x777704]
/usr/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x4c) [0x7791bc]
/usr/bin/mongod(_ZN5mongo11DataFileMgr12insertAndLogEPKcRKNS_7BSONObjEb+0x52) [0x7793b2]
/usr/bin/mongod(_ZN5mongo26CmdCloneCollectionAsCapped3runERKSsRNS_7BSONObjERSsRNS_14BSONObjBuilderEb+0xae2) [0x7efb22]
/usr/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x9a0) [0x7db210]
/usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x831) [0x7dc741]
/usr/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x35) [0x642c25]
/usr/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x2e86) [0x6477c6]
/usr/bin/mongod [0x752225]
/usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_8SockAddrE+0x5b8) [0x757938]
Tue Sep 6 15:59:32 [conn14] change-main..tmp.convertToCapped.tracked_events Assertion failure ! "DR102 too much data written uncommitted" db/dur_commitjob.cpp 204
0x54e8de 0x55f5bf 0x636218 0x62961a 0x739df0 0x73bd8f 0x730445 0x73048a 0x777704 0x7791bc 0x7793b2 0x7efb22 0x7db210 0x7dc741 0x642c25 0x6477c6 0x752225 0x757938 0x759641 0x598e30
/usr/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xae) [0x54e8de]

Generated at Thu Feb 08 03:03:03 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.