Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-4614

Trigger sweep immediately to reclaim space after a table drop

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT3.2.0, 4.1.10
    • Component/s: None
    • Labels:
    • Story Points:
      3
    • Sprint:
      Storage Engines 2019-03-25, Storage Engines 2019-04-08
    • Backport Requested:
      v4.0

      Description

      After the WiredTiger import in MongoDB (0c6ba8d8be02dd34a46c3e9533971f1739b6ad8e), WT's cache while running as an in-memory storage engine does not reconcile memory promptly causing the test to fail with a `WT_CACHE_FULL` error.
      A build failure sprung up as a consequence of this, where it requires approximately 5-6GB of cache to pass successfully, as opposed to ~3GB prior to the WT import.

      I'm attaching diagnostic data I collected of the test (agg_sort_external.js) from before and after the WT import, as well as some graphs that could be useful to understanding the problem.
      From my observations, after the import, the WT cache fill ratio is climbing steadily after a certain point and the tracked bytes belonging to leaf pages in the cache climbs towards the 4GB cache limit, causing the test to fail.
      Prior to the import, the WT cache fill ratio would oscillate around 50%, as well as the tracked bytes belonging to leaf pages in the cache at around 2GB.

      `metrics.passing` was taken from `970e0c02de8c5922efcab74cfee258f447f94741` and `metrics.failing` was taken from `83336cb56b269195110253918d226cbba4377a03` on the MongoDB repo.

        Attachments

        1. failing-1.png
          failing-1.png
          368 kB
        2. failing-2.png
          failing-2.png
          342 kB
        3. failing-3.png
          failing-3.png
          55 kB
        4. metrics.failing
          47 kB
        5. metrics.passing
          39 kB
        6. passing-1.png
          passing-1.png
          371 kB
        7. passing-2.png
          passing-2.png
          352 kB
        8. passing-3.png
          passing-3.png
          65 kB
        9. runs_evg.png
          runs_evg.png
          176 kB
        10. wt_runs.png
          wt_runs.png
          196 kB

          Issue Links

            Activity

              People

              • Assignee:
                sulabh.mahajan Sulabh Mahajan
                Reporter:
                gregory.wlodarek Gregory Wlodarek
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: