Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2928

Eviction failing to switch queues can lead to starvation

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.9.0, 3.2.10, 3.3.15
    • Labels:
      None
    • # Replies:
      13
    • Last comment by Customer:
      true

      Description

      eviction failing to switch queues leads to starvation

        Issue Links

          Activity

          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2928 Don't give up when the urgent queue is half empty. (#3063)
          Branch: mongodb-3.4
          https://github.com/wiredtiger/wiredtiger/commit/5fb852354745b9efe638183084ee00db821aa132

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2928 Don't give up when the urgent queue is half empty. (#3063) Branch: mongodb-3.4 https://github.com/wiredtiger/wiredtiger/commit/5fb852354745b9efe638183084ee00db821aa132
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'keithbostic', u'name': u'Keith Bostic', u'email': u'keith.bostic@mongodb.com'}

          Message: WT-2928 Eviction failing to switch queues can lead to starvation (#3060)

          There are some configurations where the eviction server waiting for a the current queue to drain before switching in the new queue can lead to starvation. Specifically if in-memory is configured, the cache is full and there is only a single eviction thread. Or if an operation that does not contribute to eviction fills the cache (for example compact).
          Branch: mongodb-3.2
          https://github.com/wiredtiger/wiredtiger/commit/7cc8f4bfbc5b45486e35072771c659e3c9e12ece

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'keithbostic', u'name': u'Keith Bostic', u'email': u'keith.bostic@mongodb.com'} Message: WT-2928 Eviction failing to switch queues can lead to starvation (#3060) There are some configurations where the eviction server waiting for a the current queue to drain before switching in the new queue can lead to starvation. Specifically if in-memory is configured, the cache is full and there is only a single eviction thread. Or if an operation that does not contribute to eviction fills the cache (for example compact). Branch: mongodb-3.2 https://github.com/wiredtiger/wiredtiger/commit/7cc8f4bfbc5b45486e35072771c659e3c9e12ece
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2928 Don't give up when the urgent queue is half empty. (#3063)
          Branch: mongodb-3.2
          https://github.com/wiredtiger/wiredtiger/commit/5fb852354745b9efe638183084ee00db821aa132

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2928 Don't give up when the urgent queue is half empty. (#3063) Branch: mongodb-3.2 https://github.com/wiredtiger/wiredtiger/commit/5fb852354745b9efe638183084ee00db821aa132
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'name': u'Ramon Fernandez', u'email': u'ramon@mongodb.com'}

          Message: Import wiredtiger: 9cf2f89d6d95e1de797f05ab1fef28695f8bae7b from branch mongodb-3.2

          ref: bb18c43915..9cf2f89d6d
          for: 3.2.10

          WT-2864 Reconfiguring the checkpoint server can lead to hangs
          WT-2874 Change test_compact01 to avoid eviction
          WT-2918 The dist scripts create C files s_whitespace complains about
          WT-2919 Don't mask error returns from style checking scripts
          WT-2921 Reduce the WT_SESSION hazard_size when possible
          WT-2923 heap-use-after-free on address in compaction
          WT-2924 Ensure we are doing eviction when threads are waiting for it
          WT-2925 WT_THREAD_PANIC_FAIL is a WT_THREAD structure flag
          WT-2926 WT_CONNECTION.reconfigure can attempt unlock of not-locked lock
          WT-2928 Eviction failing to switch queues can lead to starvation
          Branch: v3.2
          https://github.com/mongodb/mongo/commit/79d9b3ab5ce20f51c272b4411202710a082d0317

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'name': u'Ramon Fernandez', u'email': u'ramon@mongodb.com'} Message: Import wiredtiger: 9cf2f89d6d95e1de797f05ab1fef28695f8bae7b from branch mongodb-3.2 ref: bb18c43915..9cf2f89d6d for: 3.2.10 WT-2864 Reconfiguring the checkpoint server can lead to hangs WT-2874 Change test_compact01 to avoid eviction WT-2918 The dist scripts create C files s_whitespace complains about WT-2919 Don't mask error returns from style checking scripts WT-2921 Reduce the WT_SESSION hazard_size when possible WT-2923 heap-use-after-free on address in compaction WT-2924 Ensure we are doing eviction when threads are waiting for it WT-2925 WT_THREAD_PANIC_FAIL is a WT_THREAD structure flag WT-2926 WT_CONNECTION.reconfigure can attempt unlock of not-locked lock WT-2928 Eviction failing to switch queues can lead to starvation Branch: v3.2 https://github.com/mongodb/mongo/commit/79d9b3ab5ce20f51c272b4411202710a082d0317
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'name': u'Ramon Fernandez', u'email': u'ramon@mongodb.com'}

          Message: Import wiredtiger: fc0e7abe82595e579573d42448632f7b36a2d154 from branch mongodb-3.4

          ref: 5bc03723a7..fc0e7abe82
          for: 3.3.15

          WT-2864 Reconfiguring the checkpoint server can lead to hangs
          WT-2874 Change test_compact01 to avoid eviction
          WT-2918 The dist scripts create C files s_whitespace complains about
          WT-2919 Don't mask error returns from style checking scripts
          WT-2921 Reduce the WT_SESSION hazard_size when possible
          WT-2923 heap-use-after-free on address in compaction
          WT-2924 Ensure we are doing eviction when threads are waiting for it
          WT-2925 WT_THREAD_PANIC_FAIL is a WT_THREAD structure flag
          WT-2926 WT_CONNECTION.reconfigure can attempt unlock of not-locked lock
          WT-2928 Eviction failing to switch queues can lead to starvation
          Branch: master
          https://github.com/mongodb/mongo/commit/9dda827a3ae58beef36d53da1b55554cbd8744c4

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'name': u'Ramon Fernandez', u'email': u'ramon@mongodb.com'} Message: Import wiredtiger: fc0e7abe82595e579573d42448632f7b36a2d154 from branch mongodb-3.4 ref: 5bc03723a7..fc0e7abe82 for: 3.3.15 WT-2864 Reconfiguring the checkpoint server can lead to hangs WT-2874 Change test_compact01 to avoid eviction WT-2918 The dist scripts create C files s_whitespace complains about WT-2919 Don't mask error returns from style checking scripts WT-2921 Reduce the WT_SESSION hazard_size when possible WT-2923 heap-use-after-free on address in compaction WT-2924 Ensure we are doing eviction when threads are waiting for it WT-2925 WT_THREAD_PANIC_FAIL is a WT_THREAD structure flag WT-2926 WT_CONNECTION.reconfigure can attempt unlock of not-locked lock WT-2928 Eviction failing to switch queues can lead to starvation Branch: master https://github.com/mongodb/mongo/commit/9dda827a3ae58beef36d53da1b55554cbd8744c4

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:
                Days since reply:
                26 weeks, 2 days ago
                Date of 1st Reply: