Trigger immediate drop of unfinished indexes during startup recovery

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Fixed
    • Priority: Major - P3
    • 6.1.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Fully Compatible
    • Execution Team 2022-05-30, Execution Team 2022-06-13
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      During startup recovery after an unclean shutdown (i.e. it can't be resumed), we drop any incomplete-built indexes and rebuild them. When we drop these tables, we queue them for deletion, but we only run the reaper when the minimum of the oldest and checkpoint timestamps are advanced.

      At this point in startup, we have not initialized replication, so we are not advancing the oldest or stable timestamps. We have started the checkpoint thread, but this also only runs every minute.

      This can be problematic after an unclean shutdown due to running out of disk space during an index build. Because the table isn't dropped immediately, we end up with potentially very large files that can't be dropped until the next index build completes.

            Assignee:
            Dianna Hohensee (Inactive)
            Reporter:
            Louis Williams
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: