[SERVER-16065] Long flush pauses in MMAPv1 Created: 11/Nov/14 Updated: 23/Jan/15 Resolved: 21/Jan/15 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Concurrency, Storage |
| Affects Version/s: | None |
| Fix Version/s: | 3.0.0-rc6 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Davide Italiano | Assignee: | Kaloian Manassiev |
| Resolution: | Done | Votes: | 0 |
| Labels: | 28qa | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
||||||||||||||||
| Issue Links: |
|
||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||
| Operating System: | ALL | ||||||||||||||||
| Participants: | |||||||||||||||||
| Description |
|
Reducing contention on GroupCommit mutex (
This is not an actual lock contention, but just long flush times. kaloian.manassiev suggests this could be made better by flushing more often and some other small optimizations. |
| Comments |
| Comment by Githook User [ 21/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: Offloads the writing of the journal to disk to a separate thread, so that This allows the journal write to be parallelized with concurrent workload | |||||||||||||||
| Comment by Githook User [ 16/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: No functional changes. | |||||||||||||||
| Comment by Githook User [ 16/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: No functional changes. | |||||||||||||||
| Comment by Githook User [ 12/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: | |||||||||||||||
| Comment by Githook User [ 12/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: No need to duplicate this functionality. | |||||||||||||||
| Comment by Githook User [ 07/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: We cannot remap selectively, because we now do not have a way to apply | |||||||||||||||
| Comment by Kaloian Manassiev [ 07/Jan/15 ] | |||||||||||||||
|
Need to reopen and pull out of RC5, because we now do not have a way to apply back-pressure on the inserts coming in while journal I/O is happening outside of a lock. That way if the journal I/O (WRITETOJOURNAL) takes long time, we end up accumulating too much data in memory.
| |||||||||||||||
| Comment by Kaloian Manassiev [ 06/Jan/15 ] | |||||||||||||||
|
Marking this as needed CAP verification, because we need to verify that the flush pauses are going down now. | |||||||||||||||
| Comment by Githook User [ 06/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: | |||||||||||||||
| Comment by Githook User [ 06/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: | |||||||||||||||
| Comment by Githook User [ 05/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: | |||||||||||||||
| Comment by Githook User [ 05/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: There are no functional changes, just adding comments and moving code | |||||||||||||||
| Comment by Githook User [ 02/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: | |||||||||||||||
| Comment by Githook User [ 02/Jan/15 ] | |||||||||||||||
|
Author: {u'username': u'kaloianm', u'name': u'Kaloian Manassiev', u'email': u'kaloian.manassiev@mongodb.com'}Message: No functional changes, just organizing declarations and cleaning up |