Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-14262

live restore has an open source file handle when the global state is COMPLETE

    • 5
    • StorEng - 2025-03-14

      race-condition-stress-sanitizer-test-1 on amazon2023-stress-tests-armv9

      Host: i-01eafd9e3d4919d49
      Project: wiredtiger
      Commit: f1b17035
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      race-condition-stress-sanitizer-test-1 task_log

      Logs:

          [1741685232:000311][229517:0xfffee45ef080], t, file:F00001, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: int __wt_live_restore_metadata_to_fh(WT_SESSION_IMPL *, WT_FILE_HANDLE *, WT_LIVE_RESTORE_FH_META *), 1163: WiredTiger assertion failed: '((lr_fh)->source == ((void*)0))'. Expression returned false
          [1741685232:000353][229517:0xfffee45ef080], t, file:F00001, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 29: aborting WiredTiger library
      

      logs

      race-condition-stress-sanitizer-test-1 task_log

      Logs:

      #0  0x0000ffff9d8c4554 in __pthread_kill_implementation () from /lib64/libc.so.6
      #0  0x0000ffff9d8c4554 in __pthread_kill_implementation () from /lib64/libc.so.6
      #1  0x0000ffff9d87b3e0 [PAC] in raise () from /lib64/libc.so.6
      #2  0x0000ffff9d862224 [PAC] in abort () from /lib64/libc.so.6
      #3  0x0000ffff9ded9df4 [PAC] in __wt_abort (session=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/os_common/os_abort.c:31
      #4  0x0000ffff9de72de8 in __wt_live_restore_metadata_to_fh (session=0xffff84bc5fa8, fh=<optimized out>, lr_fh_meta=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/live_restore/live_restore_fs.c:1167
      #5  0x0000ffff9db9e32c in __wt_block_open (session=<optimized out>, filename=<optimized out>, objectid=<optimized out>, cfg=<optimized out>, forced_salvage=<optimized out>, readonly=<optimized out>, fixed=<optimized out>, allocsize=512, lr_fh_meta=<optimized out>, blockp=0xfffef6c64560) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/block/block_open.c:254
      #6  0x0000ffff9dbb1918 in __wt_blkcache_open (session=<optimized out>, uri=0x38d62 <error: Cannot access memory at address 0x38d62>, cfg=<optimized out>, forced_salvage=<optimized out>, readonly=<optimized out>, allocsize=<optimized out>, lr_fh_meta=<optimized out>, bmp=0xffff2f60fe28) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/block_cache/block_cache.c:743
      #7  0x0000ffff9dc34cf4 in __wt_btree_open (session=<optimized out>, op_cfg=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/btree/bt_handle.c:118
      #8  0x0000ffff9dd5cf4c in __wt_conn_dhandle_open (session=0xffff84bc5fa8, cfg=<optimized out>, flags=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/conn/conn_dhandle.c:563
      #9  0x0000ffff9dfcdc48 in __wt_session_get_dhandle (session=0xffff84bc5fa8, uri=<optimized out>, checkpoint=<optimized out>, cfg=<optimized out>, flags=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/session/session_dhandle.c:945
      #10 0x0000ffff9dfccb88 in __wt_session_get_btree_ckpt (session=0xffff84bc5fa8, uri=0xffff99306104 "file:F00001", cfg=0xfffee45ebee0, flags=4194320, hs_dhandlep=0x0, ckpt_snapshot=0x0) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/session/session_dhandle.c:469
      #11 0x0000ffff9df8fdc4 in __wti_execute_handle_operation (session=<optimized out>, uri=<optimized out>, file_func=<optimized out>, cfg=<optimized out>, open_flags=4194320) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/schema/schema_worker.c:31
      #12 0x0000ffff9df906e8 in __wt_schema_worker (session=<optimized out>, uri=<optimized out>, file_func=<optimized out>, name_func=<optimized out>, cfg=<optimized out>, open_flags=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/schema/schema_worker.c:108
      #13 0x0000ffff9dfa859c in __session_verify (wt_session=0xffff84bc5fa8, uri=<optimized out>, config=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/src/session/session_api.c:1731
      #14 0x00000000004f7694 in table_verify (table=0xffff99306100, arg=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/test/format/verify.c:49
      #15 0x00000000004f7ddc in tables_apply (func=<optimized out>, arg=arg@entry=0xffff01eb4100) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/test/format/format_inline.h:186
      #16 0x00000000004f799c in wts_verify (conn=<optimized out>, mirror_check=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/test/format/verify.c:442
      #17 0x00000000004c6284 in check_copy (session=<optimized out>, id=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/test/format/backup.c:57
      #18 0x00000000004c370c in backup (arg=<optimized out>) at /data/mci/90e7880dc8929526c2bfea94c4683ebe/wiredtiger/test/format/backup.c:624
      #19 0x0000ffff9d8c2934 in start_thread () from /lib64/libc.so.6
      #20 0x0000ffff9d866e5c [PAC] in thread_start () from /lib64/libc.so.6
      

      logs

      Repro Artifacts:

            Assignee:
            luke.pearson@mongodb.com Luke Pearson
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: