Introduce background maintenance task queue

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Won't Fix
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Execution
    • Execution Team 2023-12-25, Execution Team 2024-01-08
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      We occasionally have infrequent or one-off background maintenance tasks we wish to run in the server. Currently we typically need to register these with some existing service that runs periodically and requires that service to check whether we have any such tasks waiting. Alternatively we sometimes create a new background service for each such type of task (a dedicated thread, either raw or via PeriodicJobRunner), which runs into issues of thread proliferation.

      As an alternative, we can create a general-purpose task queue that processes these infrequent tasks when they come available.

      At least to begin with, the queue will be focused on processing light-weight tasks, and is not meant to replace any existing thread pools that we use for heavy processing (e.g. index builds).

            Assignee:
            Daotang Yang
            Reporter:
            Dan Larkin-York
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: