Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-1983

Enhance wtperf to support oplog like workloads

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • WT2.7.0
    • None
    • None

    Description

      It would be useful to have a test tool independent of MongoDB that can be used to simulate workloads generated by the MongoDB oplog.

      It makes sense to split this change into two parts. First phase:

      • Append mostly workload from multiple threads.
      • Concurrent truncate from the tail of the oplog, retaining a certain size database. The truncate should be able to remove a configurable amount of the table.

      Second phase:

      • Supporting a configurable number of readers from the table. Those readers should read in a manner similar to the oplog (do they keep a cursor open and traverse, or do they do point reads)? It would be good to think about where in the table the reads are coming from.

      I'd recommend skipping the populate phase, and using the existing functionality that allows for setting up groups of worker threads during the workload phase.

      Attachments

        Issue Links

          Activity

            People

              david.hows David Hows
              alexander.gorrod@mongodb.com Alexander Gorrod
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: