[SERVER-25268] OplogBufferCollection should cache last pushed/popped values and tryPop() should not remove documents from collection - MongoDB Jira

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major - P3
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.3.14
Component/s: Replication
Labels:
None

Backwards Compatibility:
Fully Compatible
Sprint:
Repl 2016-08-29, Repl 2016-09-19, Repl 2016-10-10

Description

The OplogBufferCollection appears to be about 20x slower than the OplogBufferInMemory.

To improve it, we can:
1) Delete documents in batches in the background
2) Fetch documents and batch them so they are ready when the Applier needs them.

Data can be found here:

https://evergreen.mongodb.com/task/sys_perf_linux_3_node_replSet_initialsync_initialsync_WT_dr_28d04fda95321c84c402338c0849155140dc6cff_16_07_21_19_45_13#/%7B%22compare%22:%5B%7B%22hash%22:%2228d04fda95321c84c402338c0849155140dc6cff%22%7D%5D%7D#%7B%22compare%22:%5B%7B%22hash%22:%2228d04fda95321c84c402338c0849155140dc6cff%22%7D,%7B%22hash%22:%2228d04fda95321c84c402338c0849155140dc6cff%22%7D%5D%7D

Compared to here:

https://evergreen.mongodb.com/task/sys_perf_linux_3_node_replSet_initialsync_initialsync_WT_dr_f4fc210e00ac1be7cc960fa12358e02b0a92ede0_16_07_22_21_36_33#/%7B%22compare%22:%5B%7B%22hash%22:%22f4fc210e00ac1be7cc960fa12358e02b0a92ede0%22%7D%5D%7D

Attachments

Issue Links

depends on

SERVER-26033 Add startKeyInclusive option to InternalPlanner

Closed

is depended on by

SERVER-26191 OplogBufferCollection should batch reads from collection

Closed

Activity

People

Assignee:: Benety Goh

Reporter:: Judah Schvimer

Participants:: Benety Goh, Githook User, Judah Schvimer, Scott Hernandez

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: Jul 25 2016 06:53:12 PM UTC

Updated:: Jan 25 2017 09:58:23 PM UTC

Resolved:: Sep 20 2016 08:21:19 PM UTC