(disagg.mode=leader) test/format gen drain timeout

XMLWordPrintableJSON

    • Type: Build Failure
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      format-stress-test-disagg-leader-5 on amazon2023-disagg-stress

      Host: i-0d380101a1e8a319b
      Project: wiredtiger
      Commit: caf29b5f
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-test-disagg-leader-5 task_log

      Logs:

      [1759795288:901894][4701:0xfffe8ddbdbc0], t, file:T00003.wt_stable, WT_SESSION.checkpoint: [WT_VERB_GENERATION][ERROR]: evict generation drain timed out
[1759795288:901920][4701:0xfffe8ddbdbc0], t, file:T00003.wt_stable, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __gen_drain_callback, 192: WiredTiger assertion failed: '0'. Expression returned false
[1759795288:901925][4701:0xfffe8ddbdbc0], t, file:T00003.wt_stable, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library

      logs

      format-stress-test-disagg-leader-5 task_log

      Logs:

      #0  0x0000ffffa8abf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
#0  0x0000ffffa8abf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
#1  0x0000ffffa8a763a0 [PAC] in raise () from /lib64/libc.so.6
#2  0x0000ffffa8a62264 [PAC] in abort () from /lib64/libc.so.6
#3  0x0000ffffa8e24fe8 [PAC] in __wt_abort (session=session@entry=0x11813fc9d310) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/os_common/os_abort.c:32
#4  0x0000ffffa8ec9048 in __gen_drain_callback (session=0x11813fc9d310, array_session=0x11813fc91bf8, exit_walkp=0xfffe8ddbbd4f, cookiep=0xfffe8ddbbd70) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/support/generation.c:192
#5  0x0000ffffa8eb3150 in __wt_session_array_walk (session=session@entry=0x11813fc9d310, walk_func=walk_func@entry=0xffffa8ec8cfc <__gen_drain_callback>, skip_internal=skip_internal@entry=false, cookiep=cookiep@entry=0xfffe8ddbbd70) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/session/session_helper.c:59
#6  0x0000ffffa8ec8cf0 in __gen_drain (session=session@entry=0x11813fc9d310, which=which@entry=1, generation=<optimized out>) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/support/generation.c:214
#7  0x0000ffffa8ec91f4 in __wt_gen_next_drain (session=session@entry=0x11813fc9d310, which=which@entry=1) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/support/generation.c:77
#8  0x0000ffffa8ce9580 in __wt_sync_file (session=session@entry=0x11813fc9d310, syncop=syncop@entry=WT_SYNC_CHECKPOINT) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/btree/bt_sync.c:248
#9  0x0000ffffa8d240ac in __checkpoint_tree (session=session@entry=0x11813fc9d310, is_checkpoint=is_checkpoint@entry=true, cfg=cfg@entry=0xfffe8ddbce18) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/checkpoint/checkpoint_txn.c:2568
#10 0x0000ffffa8d24754 in __checkpoint_tree_helper (session=0x11813fc9d310, cfg=0xfffe8ddbce18) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/checkpoint/checkpoint_txn.c:2706
#11 0x0000ffffa8d1d3e4 in __checkpoint_apply_to_dhandles (session=session@entry=0x11813fc9d310, cfg=cfg@entry=0xfffe8ddbce18, op=op@entry=0xffffa8d246d0 <__checkpoint_tree_helper>) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/checkpoint/checkpoint_txn.c:340
#12 0x0000ffffa8d2535c in __checkpoint_db_internal (session=session@entry=0x11813fc9d310, cfg=cfg@entry=0xfffe8ddbce18) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/checkpoint/checkpoint_txn.c:1348
#13 0x0000ffffa8d266a4 in __checkpoint_db_wrapper (session=session@entry=0x11813fc9d310, cfg=cfg@entry=0xfffe8ddbce18) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/checkpoint/checkpoint_txn.c:1742
#14 0x0000ffffa8d26a7c in __wt_checkpoint_db (session=session@entry=0x11813fc9d310, cfg=cfg@entry=0xfffe8ddbce18, waiting=waiting@entry=true) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/checkpoint/checkpoint_txn.c:1821
#15 0x0000ffffa8ea7834 in __session_checkpoint (wt_session=0x11813fc9d310, config=<optimized out>) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/src/session/session_api.c:2433
#16 0x0000000000405bf0 in checkpoint (arg=<optimized out>) at /data/mci/dfbb107a166315f117503d2497ce05cf/wiredtiger/test/format/checkpoint.c:147
#17 0x0000ffffa8abdb78 in start_thread () from /lib64/libc.so.6
#18 0x0000ffffa8b2acdc [PAC] in thread_start () from /lib64/libc.so.6

      logs

      Repro Artifacts:

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: