[SERVER-16366] Gradually degrading performance (wiredtiger) Created: 01/Dec/14 Updated: 18/Dec/14 Resolved: 17/Dec/14 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Performance, Storage |
| Affects Version/s: | 2.8.0-rc1, 2.8.0-rc2 |
| Fix Version/s: | 2.8.0-rc3 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Cailin Nelson | Assignee: | Bruce Lucas (Inactive) |
| Resolution: | Done | Votes: | 0 |
| Labels: | wiredtiger | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
||||||||||||
| Issue Links: |
|
||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||
| Operating System: | ALL | ||||||||||||
| Participants: | |||||||||||||
| Description |
|
After ~24 hours or so, I am finding that performance gradually degrades.
Please see attached MMS Screenshot. The displayed range starts shortly after a full system restart. Note that queues increase as well as replication lag on the secondaries. Also attach opcounters, from which you can at least crudely see that the application load is consistent. I do not see this type of behavior when the primary is MMAPv1. |
| Comments |
| Comment by Cailin Nelson [ 05/Dec/14 ] |
|
Still seeing a performance issue, however, this one was not gradual. Not that the opcounters drop off not because of a change in app behavior, but because the app just can't get the write through fast enough. Logs: https://dropbox.10gen.com/cailin/2014-12-05-17-05/mms-qa-2014-12-15.log
Here's what it looks like after a restart of the primary:
|