Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-56601

Make use of Storage Engine API improvements to improve SpillableCache performance

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Backlog
    • Major - P3
    • Resolution: Unresolved
    • None
    • None
    • None
    • Query Optimization

    Description

      As part of SERVER-56430 a number of potential optimizations came up that could be implemented if the API for the TemporaryRecordStore was improved. These are things that are for the most part already doable in the storage engine, just not exposed or easy to access.

      1. We could boost performance of the SpillableCache if we read ranges of documents from the TemporaryRecordStore at once instead of one at a time using a readOnce cursor.
      2. We could skip the cache and write straight to disk if the bulk load WT API was exposed and we were concerned about evicting other, more important data from the WT cache
      3. Deleting is expensive in WT. Right now only 'cappedTruncateAfter' is implemented, but if there was a 'cappedTruncateBefore' or equivalent we could use that instead of deleting documents individually.

      Attachments

        Issue Links

          depends on

          Task - A task that needs to be done. SERVER-56430 Implement spill to disk in the window function partition iterator

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-56610 Allow for setting readOnce on a cursor rather than taking value from the RecoveryUnit

          • Major - P3 - Major loss of function.
          • Backlog

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-56613 Expose WT bulk load API for RecordStore/TemporaryRecord store

          • Major - P3 - Major loss of function.
          • Backlog

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-56615 Implement truncateBefore on RecordStore/TemporaryRecordStore

          • Major - P3 - Major loss of function.
          • Backlog

          Activity

            People

              backlog-query-optimization Backlog - Query Optimization
              ted.tuckman@mongodb.com Ted Tuckman
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: