Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-10268

Fatal read error in test_wt4156_metadata_salvage (5.0)

    • Type: Icon: Build Failure Build Failure
    • Resolution: Cannot Reproduce
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • 5
    • TheMoon-StorEng - 2023-09-19

      make-check-test on ubuntu1804-ppc-cmake

      Host: ubuntu1804-ppc-3.pic.build.10gen.cc
      Project: wiredtiger-mongo-v5.0
      Commit: babc2b51

      Task Logs:

      make-check-test task_log

      Logs:

      C Suite Failure Assertion message
      34/92 Test #54: test_wt4156_metadata_salvage .....................***Exception: Child aborted 33.04 sec
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9198
      
      Compiler and other error messages
      [1669872217:861516][33913:0x775858664d20], file:WiredTiger.wt, WT_CURSOR.next: __wt_block_read_off, 309: WiredTiger.wt: fatal read error: WT_ERROR: non-specific WiredTiger error: WT_ERROR: non-specific WiredTiger error
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9221
      
      Failure keywords
      [1669872217:861528][33913:0x775858664d20], file:WiredTiger.wt, WT_CURSOR.next: __wt_block_read_off, 309: the process must exit and restart: WT_PANIC: WiredTiger library panic: WT_PANIC: WiredTiger library panic
      [1669872217:861557][33913:0x775858664d20], txn-recover: __wt_txn_recover, 1052: Recovery failed: WT_PANIC: WiredTiger library panic: WT_PANIC: WiredTiger library panic
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9222
      
      Test Failure message
      test_wt4156_metadata_salvage: FAILED: verify_metadata/291: wt_session->open_cursor(wt_session, t->name, NULL, NULL, &cursor): No such file or directory
      
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9242
      
      Failure keywords
      test_wt4156_metadata_salvage: process aborting
      WiredTiger Error: aborting WiredTiger library
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9243
      
      C Suite Failure Assertion message
      86/92 Test #57: test_wt4803_history_store_abort ..................***Exception: Child aborted448.47 sec
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9315
      
      Failure keywords
      Successfully completed workload (expect_panic=false)
      
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9316
      
      Cache Stuck Failures
      transaction state dump
      current ID: 3629
      last running ID: 3629
      metadata_pinned ID: 2005
      oldest ID: 2005
      durable timestamp: (0, 0)
      oldest timestamp: (0, 0)
      pinned timestamp: (0, 0)
      stable timestamp: (0, 0)
      has_durable_timestamp: no
      has_oldest_timestamp: no
      has_pinned_timestamp: no
      has_stable_timestamp: no
      oldest_is_pinned: no
      stable_is_pinned: no
      checkpoint running: no
      checkpoint generation: 1
      checkpoint pinned ID: 0
      checkpoint txn ID: 0
      session count: 16
      Transaction state of active sessions:
      ID: 0, pinned ID: 2005, metadata pinned ID: 0, name: EMPTY
      transaction id: 0, mod count: 0, snap min: 2005, snap max: 2005, snapshot count: 0, commit_timestamp: (0, 0), durable_timestamp: (0, 0), first_commit_timestamp: (0, 0), prepare_timestamp: (0, 0), pinned_durable_timestamp: (0, 0), read_timestamp: (0, 0), checkpoint LSN: [0][0], full checkpoint: false, rollback reason: , flags: 0x00000808, isolation: WT_ISO_SNAPSHOT
      =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      cache dump
      cache full: no
      cache clean check: no (65.532%)
      cache dirty check: no (10.827%)
      cache updates check: yes (10.808%)
      file:test_wt4803_history_store_abort.wt(<live>):
      internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      leaf: 15 pages, 5MB, 14/1 clean/dirty pages, 0/5/5 clean/dirty/updates MB, 5MB max page, 5MB max dirty page
      file:WiredTigerHS.wt(<live>):
      internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      leaf: 25 pages, 25MB, 25/0 clean/dirty pages, 25/0/0 clean/dirty/updates MB, 1MB max page, 0MB max dirty page
      file:WiredTiger.wt(<live>):
      internal: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      leaf: 0 pages
      cache dump: total found: 32MB vs tracked inuse 30MB
      total dirty bytes: 5MB vs tracked dirty 5MB
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9320
      
      Compiler and other error messages
      [1669872638:582570][36939:0x7ec11776f180], eviction-server: __wt_evict_thread_run, 324: cache eviction thread error: Connection timed out: Connection timed out
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9361
      
      Failure keywords
      [1669872638:582579][36939:0x7ec11776f180], eviction-server: __wt_evict_thread_run, 324: the process must exit and restart: WT_PANIC: WiredTiger library panic: WT_PANIC: WiredTiger library panic
      [1669872638:582593][36939:0x7ec11776f180], eviction-server: __wt_abort, 28: aborting WiredTiger library: Successful return: 0
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v5.0_ubuntu1804_ppc_cmake_make_check_test_638834d33627e0534c4be322_22_12_01_05_00_03/0?type=T#L9362
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: