[SERVER-3412] We should truncate journal files to 1GB before recycling for prealloc Created: 11/Jul/11  Updated: 12/Jul/16  Resolved: 01/Aug/11

Status: Closed
Project: Core Server
Component/s: Storage
Affects Version/s: None
Fix Version/s: 1.9.2

Type: Improvement Priority: Major - P3
Reporter: Mathias Stearn Assignee: Mathias Stearn
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Participants:

 Description   

For an example with a 9GB prealloc file see http://groups.google.com/group/mongodb-user/browse_thread/thread/325f2d2da114e5f2



 Comments   
Comment by auto [ 01/Aug/11 ]

Author:

{u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: Rotation is now an internal detail of the jouurnal code called automatically on every commit SERVER-3412
Branch: master
https://github.com/mongodb/mongo/commit/bf4a31eef08d2671bce2821570558ec33fd4df00

Comment by auto [ 01/Aug/11 ]

Author:

{u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: Truncate journal files to 1GB before recycling for prealloc SERVER-3412
Branch: master
https://github.com/mongodb/mongo/commit/b4f185e7de1c9917b6469ecb0709933d1cffd201

Comment by auto [ 01/Aug/11 ]

Author:

{u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: journalRotate inside groupCommit not durThread SERVER-3412
Branch: master
https://github.com/mongodb/mongo/commit/d3ff333690bff9a52543a7cd9ffb6a3df481c0cd

Comment by auto [ 01/Aug/11 ]

Author:

{u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: Truncate log files to end of current commit on rotate SERVER-3412
Branch: master
https://github.com/mongodb/mongo/commit/7c2bd1f36f3bb5066bf9f9d7f23eb9b85635e701

Comment by Mathias Stearn [ 29/Jul/11 ]

Going to do the following three things:

journalRotate() inside of groupCommit()
truncate file to end of last commit in ~LogFile()
truncate file to DataLimitPerJouralFile when rotating in removeOldJournalFile

Comment by Eliot Horowitz (Inactive) [ 17/Jul/11 ]

We should fix that too

Comment by Mathias Stearn [ 13/Jul/11 ]

No, only in the durThread loop.

Comment by Dwight Merriman [ 12/Jul/11 ]

we don't rotate in groupCommit()?

Comment by Mathias Stearn [ 12/Jul/11 ]

Actually it looks like we will never rotate during an index build because that only happens in the durThread() loop which needs a dbmutex to progress. Maybe we should move the journalRotate() call to inside of groupCommit().

Edit: its more general. We never rotate during any large process that uses commitIfNeeded

Comment by Dwight Merriman [ 12/Jul/11 ]

why are the files 9GB? that is a bug. let's fix that first. missing commitifneeded or something on index build?

Generated at Thu Feb 08 03:02:59 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.