failed: format-stress-test-1 on amazon2023-armv9-release-nonstandalone [wiredtiger @ 50e6d880]

XMLWordPrintableJSON

    • Type: Build Failure
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      format-stress-test-1 on amazon2023-armv9-release-nonstandalone

      Host: i-0f0873e6f29cf76a1
      Project: wiredtiger
      Commit: 50e6d880
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-test-1 task_log

      Logs:

          [1756734760:274265][138470:0xffffa456eb80], t, file:F00003, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wti_btcur_evict_reposition, 778: failed to reposition the cursor: WT_NOTFOUND: item not found
          [1756734760:274296][138470:0xffffa456eb80], t, file:F00003, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wti_btcur_evict_reposition, 778: the process must exit and restart: WT_PANIC: WiredTiger library panic
      

      logs

      format-stress-test-1 task_log

      Logs:

          t: FAILED: table_op/876: (1 && ret == WT_NOTFOUND) || ret == WT_CACHE_FULL || ret == WT_ROLLBACK: operation failed: -31804
      
      

      logs

      format-stress-test-1 task_log

      Logs:

          [1756734760:274369][138470:0xffffa77beb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_thread_run, 358: eviction thread error: WT_PANIC: WiredTiger library panic
          [1756734760:274375][138470:0xffffa77beb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __thread_run, 42: Unrecoverable utility thread error: WT_PANIC: WiredTiger library panic
      

      logs

      format-stress-test-1 task_log

      Logs:

          t: FAILED: table_op/940: tinfo->cursor->reset(tinfo->cursor): WT_PANIC: WiredTiger library panic
      
      

      logs

      format-stress-test-1 task_log

      Logs:

          [1756734760:274872][138470:0xffffa6daeb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_thread_run, 358: eviction thread error: WT_PANIC: WiredTiger library panic
          [1756734760:274876][138470:0xffffa6daeb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __thread_run, 42: Unrecoverable utility thread error: WT_PANIC: WiredTiger library panic
      

      logs

      format-stress-test-1 task_log

      Logs:

          t: FAILED: table_op/940: tinfo->cursor->reset(tinfo->cursor): WT_PANIC: WiredTiger library panic
          t: FAILED: commit_transaction/604: session->timestamp_transaction_uint(session, WT_TS_TXN_TYPE_COMMIT, ts): WT_PANIC: WiredTiger library panic
      

      logs

      format-stress-test-1 task_log

      Logs:

          [1756734760:275515][138470:0xffffa95eeb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_thread_run, 358: eviction thread error: WT_PANIC: WiredTiger library panic
          [1756734760:275519][138470:0xffffa95eeb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __thread_run, 42: Unrecoverable utility thread error: WT_PANIC: WiredTiger library panic
          [1756734760:275542][138470:0xffffa9ffeb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_thread_run, 358: eviction thread error: WT_PANIC: WiredTiger library panic
          [1756734760:275555][138470:0xffffa9ffeb80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __thread_run, 42: Unrecoverable utility thread error: WT_PANIC: WiredTiger library panic
          [1756734760:275963][138470:0xffffa1d2eb80], t, file:T00002.wt, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_block_checkpoint_resolve, 1059: T00002.wt: the checkpoint failed, the system must restart: Invalid argument
          [1756734760:275974][138470:0xffffa1d2eb80], t, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_cursor_set_key, 304: failed to set key: WT_PANIC: WiredTiger library panic
          [1756734760:275978][138470:0xffffa1d2eb80], t, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __meta_track_unroll, 222: metadata unroll update file:T00002.wt to access_pattern_hint=none,allocation_size=512,app_metadata=,assert=(commit_timestamp=none,durable_timestamp=none,read_timestamp=none,write_timestamp=off),block_allocation=best,block_compressor="snappy",block_manager=default,cache_resident=false,checksum="on",collator=,columns=,dictionary=290,disaggregated=(page_log=),encryption=(keyid=,name=),format=btree,huffman_key=,huffman_value=,id=24,ignore_in_memory_cache_size=false,in_memory=false,internal_item_max=0,internal_key_max=0,internal_key_truncate=true,internal_page_max=1024,key_format=r,key_gap=10,leaf_item_max=0,leaf_key_max=49,leaf_page_max=2048,leaf_value_max=20480,log=(enabled=false),memory_page_image_max=0,memory_page_max=5242880,os_cache_dirty_max=0,os_cache_max=0,prefix_compression=false,prefix_compression_min=4,readonly=false,split_deepen_min_child=0,split_deepen_per_child=0,split_pct=73,tiered_object=false,tiered_storage=(auth_token=,bucket=,bucket_prefix=,cache_directory=,local_retention=300,name=,object_target_size=0),value_format=u,verbose=[],version=(major=1,minor=1),write_timestamp_usage=none,checkpoint=(mine.3=(addr="01e2c03b82e4c99d6d02e2c22c81e4acf609c0e2c03f85e4121f944d808080e401c0e9c0e401bfdfc0",order=10,time=1756734517,size=29361152,newest_start_durable_ts=294940,oldest_start_ts=0,newest_txn=304794,newest_stop_durable_ts=0,newest_stop_ts=-1,newest_stop_txn=-11,prepare=0,write_gen=57713,run_write_gen=19,next_page_id=100),WiredTigerCheckpoint.21=(addr="01e2cc5381e4f948ba86e2cc5481e4d6de75dfe2cc5685e4324b24d9e2cc5581e4aab8f920e401dba3c0e401d94fc0",order=21,time=1756734730,size=31027712,newest_start_durable_ts=725561,oldest_start_ts=0,newest_txn=745835,newest_stop_durable_ts=0,newest_stop_ts=-1,newest_stop_txn=-11,prepare=0,write_gen=85229,run_write_gen=19,next_page_id=100)),checkpoint_backup_info=,checkpoint_lsn=(4294967295,2147483647): WT_PANIC: WiredTiger library panic
          [1756734760:275985][138470:0xffffa1d2eb80], t, file:F00003, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_block_checkpoint_resolve, 1059: F00003: the checkpoint failed, the system must restart: Invalid argument
          [1756734760:275987][138470:0xffffa1d2eb80], t, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_cursor_set_key, 304: failed to set key: WT_PANIC: WiredTiger library panic
          [1756734760:275989][138470:0xffffa1d2eb80], t, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __meta_track_unroll, 222: metadata unroll update file:F00003 to access_pattern_hint=none,allocation_size=512,app_metadata=,assert=(commit_timestamp=none,durable_timestamp=none,read_timestamp=none,write_timestamp=off),block_allocation=best,block_compressor="snappy",block_manager=default,cache_resident=false,checksum="unencrypted",collator=,columns=,dictionary=0,disaggregated=(page_log=),encryption=(keyid=,name=),format=btree,huffman_key=,huffman_value=,id=32,ignore_in_memory_cache_size=false,in_memory=false,internal_item_max=0,internal_key_max=0,internal_key_truncate=true,internal_page_max=65536,key_format=u,key_gap=10,leaf_item_max=0,leaf_key_max=335,leaf_page_max=16384,leaf_value_max=0,log=(enabled=false),memory_page_image_max=0,memory_page_max=2097152,os_cache_dirty_max=0,os_cache_max=0,prefix_compression=false,prefix_compression_min=0,readonly=false,split_deepen_min_child=0,split_deepen_per_child=0,split_pct=50,tiered_object=false,tiered_storage=(auth_token=,bucket=,bucket_prefix=,cache_directory=,local_retention=300,name=,object_target_size=0),value_format=u,verbose=[],version=(major=1,minor=1),write_timestamp_usage=none,checkpoint=(mine.3=(addr="01e301eec8c052e49e191e97cc1f93e4a4db44dee2f4bb9ae47533db21808080e405ec51c0e402f93dc0",order=10,time=1756734517,size=49971712,newest_start_durable_ts=294728,oldest_start_ts=0,newest_txn=304585,newest_stop_durable_ts=294729,newest_stop_ts=-1,newest_stop_txn=-11,prepare=0,write_gen=170716,run_write_gen=19,next_page_id=100),WiredTigerCheckpoint.21=(addr="01e301d97cc043e4fead0359e301d9ff98e4af09bd6ae301da17bae4290123d6e275fa95e4f7a7e69ee408355dc0e402d8fdc0",order=21,time=1756734730,size=47850496,newest_start_durable_ts=725393,oldest_start_ts=0,newest_txn=745787,newest_stop_durable_ts=725513,newest_stop_ts=-1,newest_stop_txn=-11,prepare=0,write_gen=400833,run_write_gen=19,next_page_id=100)),checkpoint_backup_info=,checkpoint_lsn=(4294967295,2147483647): WT_PANIC: WiredTiger library panic
          [1756734760:275995][138470:0xffffa1d2eb80], t, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_meta_track_off, 343: failed to apply or unroll all tracked operations: WT_PANIC: WiredTiger library panic
          [1756734760:275997][138470:0xffffa1d2eb80], t, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __checkpoint_db_internal, 1624: Failed to turn off metadata tracking.: WT_PANIC: WiredTiger library panic
      

      logs

      format-stress-test-1 task_log

      Logs:

          t: FAILED: checkpoint/153: ret == 0 || (ret == EBUSY && ebusy_ok)
          t: FAILED: hs_cursor/92: ret == WT_NOTFOUND || ret == WT_CACHE_FULL || ret == WT_ROLLBACK: WT_CURSOR.prev failed: -31804
      

      logs

      format-stress-test-1 task_log

      Logs:

          t: process aborting
          WiredTiger Error: __wt_abort, 29: aborting WiredTiger library
      

      logs

      format-stress-test-1 task_log

      Logs:

      test/format run configuration highlights
      

      logs

      Repro Artifacts:

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: