Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: 3.1.7
    • Fix Version/s: 3.1.8
    • Component/s: WiredTiger
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible
    • Operating System:
      ALL

      Description

      https://logkeeper.mongodb.org/build/55d24df390413011a25f61c1/all

      This was a replication jstest running on the head of master branch. The secondary node hit this error and shut down:

      [ReplicaSetFixture:job0:secondary] 2015-08-17T21:14:17.531+0000 E STORAGE  [thread1] WiredTiger (0) [1439846057:531093][2736:2005873552], file:collection-992-5875615686962012966.wt, eviction-worker: src\third_party\wiredtiger\src\btree\bt_discard.c, 419: F_ISSET(session, WT_SESSION_DISCARD_FORCE) || upd->txnid == WT_TXN_ABORTED || __wt_txn_visible_all(session, upd->txnid)
      [ReplicaSetFixture:job0:secondary] 2015-08-17T21:14:17.531+0000 E STORAGE  [thread2] WiredTiger (0) [1439846057:531093][2736:2005873552], file:index-993-5875615686962012966.wt, eviction-worker: src\third_party\wiredtiger\src\btree\bt_discard.c, 419: F_ISSET(session, WT_SESSION_DISCARD_FORCE) || upd->txnid == WT_TXN_ABORTED || __wt_txn_visible_all(session, upd->txnid)
      [ReplicaSetFixture:job0:secondary] 2015-08-17T21:14:17.531+0000 E STORAGE  [thread1] WiredTiger (0) [1439846057:531093][2736:2005873552], file:collection-992-5875615686962012966.wt, eviction-worker: aborting WiredTiger library
      [ReplicaSetFixture:job0:secondary] 2015-08-17T21:14:17.531+0000 E STORAGE  [thread2] WiredTiger (0) [1439846057:531093][2736:2005873552], file:index-993-5875615686962012966.wt, eviction-worker: aborting WiredTiger library
      

      This appears to have happened after three attempts by replication to drop a collection. It appears three times in the log, so my guess is that it may have hit a WriteConflictException and retried. I believe there is really only one drop instruction in the replication stream.

      [ReplicaSetFixture:job0:secondary] 2015-08-17T21:14:12.544+0000 I COMMAND  [repl writer worker 2] CMD: drop test.cursora
      [ReplicaSetFixture:job0:secondary] 2015-08-17T21:14:16.079+0000 I COMMAND  [repl writer worker 1] CMD: drop test.cursora
      [ReplicaSetFixture:job0:secondary] 2015-08-17T21:14:17.117+0000 I COMMAND  [repl writer worker 1] CMD: drop test.cursora
      

        Issue Links

          Activity

          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

          Message: Merge pull request #2145 from wiredtiger/SERVER-19990

          SERVER-19990 Don't assert on eviction of live updates from dead trees.
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/3e46e79990170b9fd4c03e087c6876c22733fe5f

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Merge pull request #2145 from wiredtiger/ SERVER-19990 SERVER-19990 Don't assert on eviction of live updates from dead trees. Branch: develop https://github.com/wiredtiger/wiredtiger/commit/3e46e79990170b9fd4c03e087c6876c22733fe5f
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

          Message: Merge pull request #2145 from wiredtiger/SERVER-19990

          SERVER-19990 Don't assert on eviction of live updates from dead trees.
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/3e46e79990170b9fd4c03e087c6876c22733fe5f

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Merge pull request #2145 from wiredtiger/ SERVER-19990 SERVER-19990 Don't assert on eviction of live updates from dead trees. Branch: develop https://github.com/wiredtiger/wiredtiger/commit/3e46e79990170b9fd4c03e087c6876c22733fe5f
          Show
          milkie Eric Milkie added a comment - Recording another test failure instance here, for tracking purposes: https://evergreen.mongodb.com/task/mongodb_mongo_master_windows_64_2k8_debug_jsCore_small_oplog_rs_WT_5d76623abc23f453c6530b1f8543476c5d65c4e9_15_08_26_04_49_10
          Hide
          michael.cahill Michael Cahill added a comment -

          Should be fixed by the latest WT drop into MongoDB master.

          Show
          michael.cahill Michael Cahill added a comment - Should be fixed by the latest WT drop into MongoDB master.
          Hide
          michael.cahill Michael Cahill added a comment -

          Ramon Fernandez, WiredTiger only checks assertions when configured for diagnostic builds, so we could only see this in debug builds on MongoDB. Triggering this would require a combination of high insert rates and collection drops on a debug build (and hasn't shown up in Evergreen in 3.0, as far as I know).

          tl;dr I am happy not to backport this.

          Show
          michael.cahill Michael Cahill added a comment - Ramon Fernandez , WiredTiger only checks assertions when configured for diagnostic builds, so we could only see this in debug builds on MongoDB. Triggering this would require a combination of high insert rates and collection drops on a debug build (and hasn't shown up in Evergreen in 3.0, as far as I know). tl;dr I am happy not to backport this.

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: