Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-10737

Investigate failures in stress tests when run in release mode

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • 5
    • 2023-03-21 Ellen Ripley

      WT-10642 is adding four new buildvariants to evergreen.yml (PR here):

      • Ubuntu 20.04 (Release Build)
      • Ubuntu 20.04 (ARM64, Release Build)
      • Ubuntu 20.04 Stress tests (Release Build)
      • Ubuntu 20.04 Stress tests (ARM64, Release Build)

      Each of these is identical to an existing buildvariant, but with -DCMAKE_BUILD_TYPE=Release rather than the default value of Debug.

       

      The PR patch build is here and contains the following failures:

      9 tests failing with 

       [2023/03/08 07:40:07.840]     [1678261164:499004][155636:0xffff83f93100], t, file:T00001.wt, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __verify_page_content_leaf, 1146: page at [0: 100847616-100859904, 12288, 815299404] newest durable: (0, 0)/(0, 0) oldest start: (0, 0)/0 newest stop (4294967295, 4294967295)/18446744073709551605, of type row-store leaf and referenced in its parent by a cell of type addr/leaf-no, contains overflow items: WT_ERROR: non-specific WiredTiger error
 [2023/03/08 07:40:07.840]     [1678261165:430541][155636:0xffff83f93100], t, file:T00001.wt, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __verify_ckptfrag_chk, 520: checkpoint ranges never verified: 2696
 [2023/03/08 07:40:07.840]     [1678261166:68151][155636:0xffff83f93100], t, file:T00001.wt, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __verify_filefrag_chk, 434: file ranges never verified: 2457
 [2023/03/08 07:40:07.840]     t: FAILED: table_verify/49: ret == 0 || ret == EBUSY

       

      One test format-stress-test-2-nonstandalone (here) failing with

       [2023/03/08 09:22:46.535]     mirror: 914806/918708 mismatch: table:T00001: {0000914806.00/opqrs}/{00}, table:T00002: {0000918708.00/opqrstuvwxyzabcdefghij}/{00009187}
 [2023/03/08 09:22:46.535]     last successful match was 914805
 [2023/03/08 09:22:46.535]     t: FAILED: table_verify_mirror/312: base_keyno == table_keyno || (FLD_ISSET(g.trace_flags, TRACE_MIRROR_FAIL) && failures < 20)

       

      and unit-test-nonstandalone (here) failing with a timeout.

      The scope of this ticket is to investigate each failure and resolve them either here or in a separate ticket.

       

            Assignee:
            andrew.morton@mongodb.com Andrew Morton
            Reporter:
            andrew.morton@mongodb.com Andrew Morton
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: