Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-19818

Cache usage exceeds configured maximum during index builds under WiredTiger

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.0.5
    • Component/s: WiredTiger
    • ALL

      Note: this issue is similar to SERVER-18829, but the fix there was verified on the repro on that ticket and the particulars are different in this case, so I believe this is a different issue.

      During an _id index build of a collection with about 5G documents in an initial sync of a secondary cache usage grew to exceed the specified maximum. Some stats:

      • The index build starts at A. At this point (and for the duration of the timeline) we are only reading the collection data; no index entries are being inserted yet.
      • Since the cache is full pages are being evicted as fast as they are being read, and cache usage remains bounded.
      • But at B the statistics shift. Data is still being read at the same rate, but evictions are not being done in the same way, and don't keep up with the rate at which data is being read into the cache, so cache usage grows unbounded.

        1. index-build-exceeds-cache.html
          2.41 MB
          Bruce Lucas
        2. index-build-exceeds-cache.png
          186 kB
          Bruce Lucas

            Assignee:
            bruce.lucas@mongodb.com Bruce Lucas (Inactive)
            Reporter:
            bruce.lucas@mongodb.com Bruce Lucas (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

              Created:
              Updated:
              Resolved: