Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-8792

Clean obsolete on-disk pages with overflow items during checkpoint cleanup

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      Summary
      Checkpoint cleanup skips the on-disk obsolete pages with overflow items. Those obsolete pages are never freed until they are accessed again.

      Motivation
      No. Overflow items are used rarely in MongoDB, but possible that they are used by the WT standalone users.

      • How likely is it that this use case or problem will occur?
        Edge case scenario of overflow items.
      • If the problem does occur, what are the consequences and how severe are they?
        Disk space use increases.
      • Is this issue urgent?
        No.

      Acceptance Criteria (Definition of Done)
      Checkpoint cleanup can able to free the obsolete pages with overflow items.

      • Testing
        Functional testing is required to verify that checkpoint cleanup removes obsolete pages with overflow items.
      • Documentation update
        NA

      [Optional] Suggested Solution
      Read the obsolete pages back into memory and mark them dirty to let the reconciliation remove the overflow items. Page read is a costly operation, limit the number of pages that are read per checkpoint.

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            haribabu.kommi@mongodb.com Haribabu Kommi
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: