Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2036

The sweep server can stall eviction

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: WT2.6.1
    • Fix Version/s: WT2.7.0
    • Labels:
      None
    • # Replies:
      4
    • Last comment by Customer:
      true

      Description

      We've seen cases of a livelock of some kind between the sweep server and eviction. The sweep server is not completely stuck (it still occasionally increments statistics), but checkpoints that normally take seconds get stuck indefinitely.

        Issue Links

          Activity

          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2036 Clear time-of-death in handles with more than one reference, don't sweep handles with the exclusive flag set.
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/b4959228e97d06c8f7073d11f84fbe0288c9beba

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2036 Clear time-of-death in handles with more than one reference, don't sweep handles with the exclusive flag set. Branch: develop https://github.com/wiredtiger/wiredtiger/commit/b4959228e97d06c8f7073d11f84fbe0288c9beba
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2036 Don't try to repeatedly remove busy handles. Count dead handles later in the sweep, only try to remove handles if we are likely to find good candidates, in case the handle list becomes very long.

          While in the area, simplify sweep logic and only get the system time once per pass, outside any locks.
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/d0889ebde0c65fe3a775ac5a397d62cfeb3e77aa

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2036 Don't try to repeatedly remove busy handles. Count dead handles later in the sweep, only try to remove handles if we are likely to find good candidates, in case the handle list becomes very long. While in the area, simplify sweep logic and only get the system time once per pass, outside any locks. Branch: develop https://github.com/wiredtiger/wiredtiger/commit/d0889ebde0c65fe3a775ac5a397d62cfeb3e77aa
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: Merge pull request #2113 from wiredtiger/sweep-robustness

          WT-2036 Make handle sweeps more robust
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/36310d45b73e0d97f69efcee075141ba81153563

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: Merge pull request #2113 from wiredtiger/sweep-robustness WT-2036 Make handle sweeps more robust Branch: develop https://github.com/wiredtiger/wiredtiger/commit/36310d45b73e0d97f69efcee075141ba81153563
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2036 Make handle sweeps more robust

          Merge pull request #2113 from wiredtiger/sweep-robustness
          (cherry picked from commit 36310d45b73e0d97f69efcee075141ba81153563)
          Branch: mongodb-3.0
          https://github.com/wiredtiger/wiredtiger/commit/58bc810b91b7496ee2db388a562f069a1ea05b14

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2036 Make handle sweeps more robust Merge pull request #2113 from wiredtiger/sweep-robustness (cherry picked from commit 36310d45b73e0d97f69efcee075141ba81153563) Branch: mongodb-3.0 https://github.com/wiredtiger/wiredtiger/commit/58bc810b91b7496ee2db388a562f069a1ea05b14

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:
                Days since reply:
                1 year, 46 weeks, 2 days ago
                Date of 1st Reply: