[SERVER-17206] WT Secondaries fall behind on heavy insert workload but MMAPv1 secondaries don't Created: 06/Feb/15 Updated: 19/Sep/15 Resolved: 20/Feb/15 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Replication, Storage |
| Affects Version/s: | 3.0.0-rc8 |
| Fix Version/s: | 3.0.0-rc9, 3.1.0 |
| Type: | Bug | Priority: | Critical - P2 |
| Reporter: | Michael Grundy | Assignee: | Darren Wood |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Issue Links: |
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Operating System: | ALL | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Backport Completed: | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Steps To Reproduce: | Socialite load workload (available at https://github.com/10gen-labs/socialite).
3 node replica set c3.2xlarge instances, 8 cpu, 15g.
Socialite load workload: java -jar target/socialite-0.0.1-SNAPSHOT.jar load --users 10000000 --maxfollows 1000 --messages 2000 --threads 32 sample-config.yml Indexes:
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Participants: | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Description |
|
Running the socialite load workload (primarily writes) against a three member replica set, 4g oplog with one secondary using MMAPv1 and the other using wiredTiger, the WT secondary starts falling behind. The MMAPv1 secondary keeps up. |
| Comments |
| Comment by Daniel Pasette (Inactive) [ 12/Feb/15 ] | |||||
|
This commit in WT was merged in this morning. This allows checkpoints and statistics cursors to not block application of oplog operations to secondaries.
| |||||
| Comment by Githook User [ 11/Feb/15 ] | |||||
|
Author: {u'username': u'monkey101', u'name': u'Dan Pasette', u'email': u'dan@10gen.com'}Message: (cherry picked from commit 47eafb2a05f902ffd9df5324a4c3490eaa581842) | |||||
| Comment by Githook User [ 11/Feb/15 ] | |||||
|
Author: {u'username': u'monkey101', u'name': u'Dan Pasette', u'email': u'dan@10gen.com'}Message: | |||||
| Comment by Michael Grundy [ 07/Feb/15 ] | |||||
|
Attaching the oplog collection statstimeline from each member, plus the raw data | |||||
| Comment by Daniel Pasette (Inactive) [ 07/Feb/15 ] | |||||
|
Do you have collection stats for the oplog? |