Improve checkpoint progress messages with additional metrics

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Checkpoints
    • None

      Issue Summary

      The current checkpoint progress messages in WiredTiger provide limited information, primarily reporting the duration, pages written, and bytes written. There is an opportunity to improve the utility of these messages for users and support engineers by including additional metrics.

      Context

      In the checkpoint code (checkpoint_txn.c), the following message is logged:

      if (closing || (time_diff / WT_PROGRESS_MSG_PERIOD) > conn->ckpt.progress.msg_count) {
          __wt_verbose_info(session, WT_VERB_CHECKPOINT_PROGRESS,
            "Checkpoint %s for %" PRIu64 " seconds and wrote: %" PRIu64 " pages (%" PRIu64 " MB)",
            closing ? "ran" : "has been running", time_diff, conn->ckpt.progress.write_pages,
            conn->ckpt.progress.write_bytes / WT_MEGABYTE);
          conn->ckpt.progress.msg_count++;
      }
      

      Currently, the message does not include:

      • Number of files already checkpointed (to help estimate remaining files)
      • Pages walked
      • btree->bytes_dirty_leaf

      Proposed Solution

      • Investigate the feasibility and value of adding the following metrics to the checkpoint progress messages:
      1. Number of files already checkpointed
      2. Pages walked
      3. btree->bytes_dirty_leaf
      • If deemed valuable, update the checkpoint progress logging to include these metrics, providing more comprehensive information for users and support engineers.

      Original Slack thread: Slack Thread
      This ticket was generated by AI from a Slack thread.

            Assignee:
            Unassigned
            Reporter:
            Memento Slack Bot
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: