test/format (disagg.mode=leader,PALite) reconcile failure

XMLWordPrintableJSON

      format-stress-data-validation-test-disagg-leader-palite-1 on amazon2023-disagg-stress

      Host: i-05029796dcf105a1c
      Project: wiredtiger
      Commit: bf3f8b9e
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-data-validation-test-disagg-leader-palite-1 task_log

      Logs:

      [1763430404:871608][7947:0xffff69fedbc0], t, file:T00003.wt_stable, WT_SESSION.rollback_transaction: [WT_VERB_DEFAULT][ERROR]: __rec_write_err, 3346: WiredTiger assertion failed: '!((((r)->flags) & (0x0020u)) != 0)'. Expression returned false
      [1763430404:871632][7947:0xffff69fedbc0], t, file:T00003.wt_stable, WT_SESSION.rollback_transaction: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
      [1763430404:871636][7947:0xffff69fedbc0], t, file:T00003.wt_stable, WT_SESSION.rollback_transaction: [WT_VERB_ERROR_RETURNS][ERROR]: __evict_page, 3006: Error at src/evict/evict_lru.c:3006: "__evict_get_ref(session, is_server, &btree, &ref, &previous_state)" failed: WT_NOTFOUND: item not found
      

      logs

      format-stress-data-validation-test-disagg-leader-palite-1 task_log

      Logs:

      #0  0x0000ffff828bf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
      #0  0x0000ffff828bf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
      #1  0x0000ffff828763a0 [PAC] in raise () from /lib64/libc.so.6
      #2  0x0000ffff82862264 [PAC] in abort () from /lib64/libc.so.6
      #3  0x0000ffff82c2bdcc [PAC] in __wt_abort (session=session@entry=0x72b97fc9a7a0) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/os_common/os_abort.c:32
      #4  0x0000ffff82c6ff94 in __rec_write_err (session=session@entry=0x72b97fc9a7a0, r=r@entry=0x72b97c902580, page=page@entry=0x72b9580f2380) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/reconcile/rec_write.c:3346
      #5  0x0000ffff82c78c8c in __reconcile (session=session@entry=0x72b97fc9a7a0, ref=ref@entry=0x72b97dd7a5a0, salvage=salvage@entry=0x0, flags=flags@entry=10560, page_lockedp=page_lockedp@entry=0xffff69feba5f) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/reconcile/rec_write.c:377
      #6  0x0000ffff82c77d10 in __wt_reconcile (session=session@entry=0x72b97fc9a7a0, ref=ref@entry=0x72b97dd7a5a0, salvage=salvage@entry=0x0, flags=flags@entry=10560) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/reconcile/rec_write.c:128
      #7  0x0000ffff82be772c in __evict_reconcile (session=session@entry=0x72b97fc9a7a0, ref=ref@entry=0x72b97dd7a5a0, evict_flags=evict_flags@entry=0) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/evict/evict_page.c:1072
      #8  0x0000ffff82be9594 in __wt_evict (session=session@entry=0x72b97fc9a7a0, ref=0x72b97dd7a5a0, previous_state=3 '\003', flags=flags@entry=0) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/evict/evict_page.c:241
      #9  0x0000ffff82bdcf44 in __evict_page (session=session@entry=0x72b97fc9a7a0, is_server=is_server@entry=false) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/evict/evict_lru.c:3040
      #10 0x0000ffff82bde478 in __wti_evict_app_assist_worker (session=session@entry=0x72b97fc9a7a0, busy=<optimized out>, busy@entry=false, readonly=readonly@entry=false, interruptible=interruptible@entry=true) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/evict/evict_lru.c:3171
      #11 0x0000ffff82cfb4bc in __wt_evict_app_assist_worker_check (session=session@entry=0x72b97fc9a7a0, busy=busy@entry=false, readonly=readonly@entry=false, interruptible=interruptible@entry=true, didworkp=didworkp@entry=0x0) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/include/../evict/evict_inline.h:913
      #12 0x0000ffff82cff9c8 in __wt_txn_rollback (session=session@entry=0x72b97fc9a7a0, cfg=cfg@entry=0xffff69fecde8, api_call=api_call@entry=true) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/txn/txn.c:2165
      #13 0x0000ffff82cabf00 in __session_rollback_transaction (wt_session=0x72b97fc9a7a0, config=<optimized out>) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/src/session/session_api.c:2044
      #14 0x0000000000415c74 in rollback_transaction (tinfo=tinfo@entry=0x72b979e3a400, prepared=prepared@entry=false) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/test/format/ops.c:660
      #15 0x0000000000416b70 in ops (arg=0x72b979e3a400) at /data/mci/00aba3be669846c54d8cfdb09fef9252/wiredtiger/test/format/ops.c:1460
      #16 0x0000ffff828bdb78 in start_thread () from /lib64/libc.so.6
      #17 0x0000ffff8292acdc [PAC] in thread_start () from /lib64/libc.so.6
      

      logs

      Repro Artifacts:

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: