Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-56194

Make TTL deletes fair

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • 6.1.0-rc0
    • None
    • Fully Compatible
    • Execution Team 2021-08-23, Execution Team 2022-05-02, Execution Team 2022-05-16, Execution Team 2022-05-30, Execution Team 2022-06-13

    Description

      The single-threaded TTL Monitor can get "stuck" deleting large ranges of documents on specific collections or databases.

      This prevents the TTL monitor from performing deletes on higher-priority collections such as config.system.sessions.

      We should consider imposing configurable per-database and per-collection document deletion limits. In addition, we will need to consider significantly lowering the default TTL pass interval (from 60 seconds) to ensure we make progress.

      Some hypothetical limits would be:

      • Maximum 10000 documents per database
      • Maximum 1000 documents per collection
      • Run TTL monitor every 5 seconds.

      Also consider prioritizing important collections like config.system.sessions.

      Attachments

        Issue Links

          depends on

          Task - A task that needs to be done. SERVER-63040 Batch TTL deletions

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-66210 BatchedDeleteStage doesn't indicate when completion is caused by pass targets

          • Major - P3 - Major loss of function.
          • Closed
          is documented by

          Task - A task that needs to be done. DOCS-15365 Investigate changes in SERVER-56194: Make TTL deletes fair

          • Major - P3 - Major loss of function.
          • Backlog
          is related to

          Task - A task that needs to be done. SERVER-66655 Update Storage Execution Arch Guide with new TTL Behavior

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-66537 Combine BatchedDeleteStage<Batch/Pass>Params

          • Major - P3 - Major loss of function.
          • Closed
          related to

          Bug - A problem which impairs or prevents the functions of the product. SERVER-71290 configure ttlIndexDeleteTargetTimeMS in TTLTest

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-66898 Update permalinks in TTLMonitor Arch guide section

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-56195 Make TTL monitor multi-threaded

          • Major - P3 - Major loss of function.
          • Backlog

          Activity

            People

              haley.connelly@mongodb.com Haley Connelly
              louis.williams@mongodb.com Louis Williams
              Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: