[SERVER-17033] Improve performance for bulk insert into WT with under oplog back pressure Created: 24/Jan/15 Updated: 31/Aug/15 Resolved: 31/Aug/15 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Storage, WiredTiger |
| Affects Version/s: | 3.0.0-rc6 |
| Fix Version/s: | None |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Asya Kamsky | Assignee: | Martin Bligh |
| Resolution: | Duplicate | Votes: | 0 |
| Labels: | WTcc | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||
| Sprint: | Quint Iteration 7, QuInt 8 08/28/15, Quint 9 09/18/15 | ||||||||||||||||
| Participants: | |||||||||||||||||
| Description |
|
Using YCSB inserting 30M documents with 24 threads I see a drop in performance between build Running a test to confirm exactly which commit it was. |
| Comments |
| Comment by Martin Bligh [ 31/Aug/15 ] |
|
Will be resolved by |
| Comment by Daniel Pasette (Inactive) [ 25/Jan/15 ] |
|
We'll leave this ticket open to examine the impact of back-pressue introduced in |
| Comment by Daniel Pasette (Inactive) [ 24/Jan/15 ] |
|
There are other oplog performance improvements planned, but not for 3.0.0 |
| Comment by Daniel Pasette (Inactive) [ 24/Jan/15 ] |
|
The previous version was broken and allowing the oplog to grow unbounded. Mathias' patch keeps the oplog size within a narrow size threshold and applies back pressure, which is necessary. |