Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-6499

Ignore evict priority for btrees that are dominating cache usage

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: 4.4.0-rc11
    • Fix Version/s: WT3.2.2, 4.4.1, 4.7.0
    • Component/s: None
    • Labels:
      None
    • Story Points:
      8
    • Sprint:
      Storage - Ra 2020-07-27, Storage - Ra 2020-08-10

      Description

      MongoDB instance with 1 GB cache; workload simple continuously creates collections with the default single _id index.

      • At A we begin doing evictions. Dirty fill ratio is small so this appears to be triggered by "bytes allocated for updates" reaching 25 MB or 2.5% of cache. Also disabling WT-6175 eliminates this behavior. Not sure though why this is triggered at 2.5% of cache - isn't the trigger value by default 10%?
      • At B it appears we no longer are able to evict the "bytes allocated for updates" and begin indefinitely burning 1 CPU apparently trying to evict content that can't be evicted. This occurs when we reach 6000 collections (12000 tables/files including the single index, 24000 handles). Dropping all the collections reduces open files to 0 but does not immediately reduce handles, and the eviction/cpu behavior continues, so the "bytes allocated for updates" that can't be evicted appears to be associated with handles, not files.

      This is related to WT-6420 but distinct from it as it looks like this issue is not specific to very small caches and can happen with any size cache and sufficient file handles.

        Attachments

        1. handles.png
          handles.png
          185 kB
        2. Screen Shot 2020-07-17 at 7.15.12 pm.png
          Screen Shot 2020-07-17 at 7.15.12 pm.png
          263 kB
        3. x-1GB-1.tar
          286 kB

          Issue Links

            Activity

              People

              Assignee:
              alex.cameron Alex Cameron
              Reporter:
              bruce.lucas Bruce Lucas
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: