[SERVER-9335] prefetch/fault-in the tail of the oplog in large chunks Created: 11/Apr/13  Updated: 11/Jul/16  Resolved: 29/Jan/14

Status: Closed
Project: Core Server
Component/s: Replication
Affects Version/s: None
Fix Version/s: 2.5.5

Type: Bug Priority: Minor - P4
Reporter: Scott Hernandez (Inactive) Assignee: Eliot Horowitz (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Related
related to SERVER-9378 make server auto-read-ahead on capped... Closed
is related to SERVER-2126 test use of madvise to improve perfor... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Participants:

 Description   

We could prefetch/fault-in the tail of the oplog if we think that it is not in memory so when we go to delete the docs to put new entries we don't block on the disk io.

This could be done for all capped collections optionally.



 Comments   
Comment by Githook User [ 29/Jan/14 ]

Author:

{u'username': u'erh', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}

Message: SERVER-9335: fix dbtests with new alloc code
Branch: master
https://github.com/mongodb/mongo/commit/2bee3f018b8d4351f8261c405adcdff44c7f9a70

Comment by Githook User [ 29/Jan/14 ]

Author:

{u'username': u'erh', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}

Message: SERVER-9335: madvise sequenetial for all capped collections
Branch: master
https://github.com/mongodb/mongo/commit/e5f5ff9ef84c38e2b66cc9bb31ada12c4ed26c50

Comment by Githook User [ 29/Jan/14 ]

Author:

{u'username': u'erh', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}

Message: SERVER-9335: remove addRecordToRecListInExtent and allocateSpaceForANewRecord from pdfile
Branch: master
https://github.com/mongodb/mongo/commit/a2741dab6e7b447e610968002d835c60b7043773

Comment by Githook User [ 29/Jan/14 ]

Author:

{u'username': u'erh', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}

Message: SERVER-9335: don't call getCollection from NamesapceDetails
Branch: master
https://github.com/mongodb/mongo/commit/2906d67b2f1d9e7feff5e679489e835c491ec8bd

Comment by Githook User [ 29/Jan/14 ]

Author:

{u'username': u'erh', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}

Message: SERVER-9335: some notion of interface is there now
Branch: master
https://github.com/mongodb/mongo/commit/7c1edcfa9c017fc6bfdebdefeb918e2d91287d8f

Comment by Githook User [ 29/Jan/14 ]

Author:

{u'username': u'erh', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}

Message: SERVER-9335: remove dead code from NamespaceDetails
Branch: master
https://github.com/mongodb/mongo/commit/266626f3bc8a61a452e774b42686161ea773923b

Comment by Githook User [ 29/Jan/14 ]

Author:

{u'username': u'erh', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}

Message: SERVER-9335: move cap.cpp with namespace_details
Branch: master
https://github.com/mongodb/mongo/commit/b9e2ba4a31c95a00f4fcee8ffe316a9c8136f6a7

Comment by Scott Hernandez (Inactive) [ 21/Apr/13 ]

One way to implement this would be to use madvise MADV_SEQUENTIAL for the collection's extents and/or MADV_WILLNEED for the next part of the oplog (logical tail).

Generated at Thu Feb 08 03:20:06 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.