Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-13888

Use directory list to queue work items for live restore.

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Storage Engines
    • 5
    • StorEng - 2025-01-21

      Right now we are walking the metadata file to determine what content needs copying from source to destination in live restore. This has one main problem in that it skips log files, right now we want to transfer log files, that may change in the future.

      To implement this we need to do 2 things:

      1. Perform directory list on the log dir, and queue these logs
      2. Perform directory list on the database dir and queue the WiredTiger namespace objects
        1. Don't queue the metadata file when restoring from a backup.

      We also should consider transferring the oplog as priority. Keep in mind that directory list will call into the live restore file system.

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            luke.pearson@mongodb.com Luke Pearson
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: