[SERVER-3412] We should truncate journal files to 1GB before recycling for prealloc Created: 11/Jul/11 Updated: 12/Jul/16 Resolved: 01/Aug/11 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Storage |
| Affects Version/s: | None |
| Fix Version/s: | 1.9.2 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Mathias Stearn | Assignee: | Mathias Stearn |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||
| Participants: | |||||
| Description |
|
For an example with a 9GB prealloc file see http://groups.google.com/group/mongodb-user/browse_thread/thread/325f2d2da114e5f2 |
| Comments |
| Comment by auto [ 01/Aug/11 ] |
|
Author: {u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}Message: Rotation is now an internal detail of the jouurnal code called automatically on every commit |
| Comment by auto [ 01/Aug/11 ] |
|
Author: {u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}Message: Truncate journal files to 1GB before recycling for prealloc |
| Comment by auto [ 01/Aug/11 ] |
|
Author: {u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}Message: journalRotate inside groupCommit not durThread |
| Comment by auto [ 01/Aug/11 ] |
|
Author: {u'login': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}Message: Truncate log files to end of current commit on rotate |
| Comment by Mathias Stearn [ 29/Jul/11 ] |
|
Going to do the following three things: journalRotate() inside of groupCommit() |
| Comment by Eliot Horowitz (Inactive) [ 17/Jul/11 ] |
|
We should fix that too |
| Comment by Mathias Stearn [ 13/Jul/11 ] |
|
No, only in the durThread loop. |
| Comment by Dwight Merriman [ 12/Jul/11 ] |
|
we don't rotate in groupCommit()? |
| Comment by Mathias Stearn [ 12/Jul/11 ] |
|
Actually it looks like we will never rotate during an index build because that only happens in the durThread() loop which needs a dbmutex to progress. Maybe we should move the journalRotate() call to inside of groupCommit(). Edit: its more general. We never rotate during any large process that uses commitIfNeeded |
| Comment by Dwight Merriman [ 12/Jul/11 ] |
|
why are the files 9GB? that is a bug. let's fix that first. missing commitifneeded or something on index build? |