Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-12396

Extend backup analysis tool for parsing text metadata

    • Type: Icon: Task Task
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Storage Engines
    • StorEng - Defined Pipeline

      This ticket adds functionality to the tools/backup_analysis.py script to parse metadata. The script works on backup directories and verifies that WiredTiger.backup exists in both. This ticket should extend the script so that it can read the WiredTiger.backup file and extract out information from it about specific tables, etc.

      Some of the operations this work should add is:

      • Determine which of the two directories specified is the older/newer. Use that for the code that prints out which tables were dropped or created between the backups. This information should be able to reliably determine this by looking at the file:WiredTigerHS.wt table's metadata and getting out the checkpoint=WiredTiger...=(...time=<seconds>) and seeing which one is smaller.
        NOTE: WiredTiger guarantees on a running system successive checkpoints always use a later time. Generally the time is a second counter though.
      • Decide if the current method of walking the directory list for *.wt or walking the metadata files for file: entries is the better method to get the directory list. I think the current system based is faster and easier.
      • Provide a function that takes a table name (on-disk) and a metadata configuration item name and returns the value. This function should be able to handle top-level configurations (for example allocation_size) or nested like checkpoint=...(... time=...). These may be different functions.

            Assignee:
            sue.loverso@mongodb.com Susan LoVerso
            Reporter:
            sue.loverso@mongodb.com Susan LoVerso
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: