Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-11229

test_wt8246_compact_rts_data_correctness wiredtiger_open failure due to resource busy

    • Type: Icon: Build Failure Build Failure
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • StorEng - Refinement Pipeline

      spinlock-pthread-adaptive-test on ubuntu2004

      Host: i-0d9cec22e0465fd83
      Project: wiredtiger-mongo-v5.0
      Commit: 6857535f

      Task Logs:

      spinlock-pthread-adaptive-test task_log

      Logs:

      # XFAIL: 0
      # FAIL:  0
      # XPASS: 0
      # ERROR: 0
      ============================================================================
      make[3]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/lang/python'
      make[2]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/lang/python'
      make[1]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/lang/python'
      Making check in test/utility
      make[1]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/utility'
      make[1]: Nothing to be done for 'check'.
      make[1]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/utility'
      Making check in examples/c
      make[1]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/examples/c'
      make  check-TESTS
      make[2]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/examples/c'
      make[3]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/examples/c'
      PASS: ex_config_parse
      PASS: ex_cursor
      PASS: ex_col_store
      PASS: ex_call_center
      PASS: ex_access
      PASS: ex_data_source
      PASS: ex_event_handler
      PASS: ex_extractor
      PASS: ex_file_system
      PASS: ex_extending
      PASS: ex_encrypt
      PASS: ex_hello
      PASS: ex_process
      PASS: ex_schema
      PASS: ex_pack
      PASS: ex_all
      PASS: ex_smoke
      PASS: ex_log
      PASS: ex_thread
      PASS: ex_stat
      PASS: ex_backup
      PASS: ex_backup_block
      ============================================================================
      Testsuite summary for WiredTiger 10.0.2
      ============================================================================
      # TOTAL: 22
      # PASS:  22
      # SKIP:  0
      # XFAIL: 0
      # FAIL:  0
      # XPASS: 0
      # ERROR: 0
      ============================================================================
      make[3]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/examples/c'
      make[2]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/examples/c'
      make[1]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/examples/c'
      Making check in test/bloom
      make[1]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/bloom'
      make  check-TESTS
      make[2]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/bloom'
      make[3]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/bloom'
      PASS: t
      ============================================================================
      Testsuite summary for WiredTiger 10.0.2
      ============================================================================
      # TOTAL: 1
      # PASS:  1
      # SKIP:  0
      # XFAIL: 0
      # FAIL:  0
      # XPASS: 0
      # ERROR: 0
      ============================================================================
      make[3]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/bloom'
      make[2]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/bloom'
      make[1]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/bloom'
      Making check in test/checkpoint
      make[1]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/checkpoint'
      make  check-TESTS
      make[2]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/checkpoint'
      make[3]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/checkpoint'
      PASS: smoke.sh
      ============================================================================
      Testsuite summary for WiredTiger 10.0.2
      ============================================================================
      # TOTAL: 1
      # PASS:  1
      # SKIP:  0
      # XFAIL: 0
      # FAIL:  0
      # XPASS: 0
      # ERROR: 0
      ============================================================================
      make[3]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/checkpoint'
      make[2]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/checkpoint'
      make[1]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/checkpoint'
      Making check in test/cppsuite
      make[1]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/cppsuite'
      make  check-TESTS
      make[2]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/cppsuite'
      make[3]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/cppsuite'
      PASS: csuite_style_example_test
      PASS: run
      ============================================================================
      Testsuite summary for WiredTiger 10.0.2
      ============================================================================
      # TOTAL: 2
      # PASS:  2
      # SKIP:  0
      # XFAIL: 0
      # FAIL:  0
      # XPASS: 0
      # ERROR: 0
      ============================================================================
      make[3]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/cppsuite'
      make[2]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/cppsuite'
      make[1]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/cppsuite'
      Making check in test/csuite
      make[1]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/csuite'
      make  check-TESTS
      make[2]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/csuite'
      make[3]: Entering directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/csuite'
      PASS: tiered_abort/smoke.sh
      PASS: test_scope
      PASS: test_wt1965_col_efficiency
      PASS: incr_backup/smoke.sh
      PASS: truncated_log/smoke.sh
      PASS: test_rwlock
      PASS: test_wt2246_col_append
      PASS: wt2447_join_main_table/smoke.sh
      PASS: test_wt2695_checksum
      PASS: test_wt2592_join_schema
      PASS: random_directio/smoke.sh
      PASS: test_wt2719_reconfig
      PASS: wt2535_insert_race/smoke.sh
      PASS: random_abort/smoke.sh
      PASS: test_wt2999_join_extractor
      PASS: test_wt3120_filesys
      PASS: test_wt3135_search_near_collator
      PASS: test_wt3184_dup_index_collator
      PASS: timestamp_abort/smoke.sh
      PASS: test_wt3363_checkpoint_op_races
      PASS: test_wt3874_pad_byte_collator
      PASS: test_wt2834_join_bloom_fix
      PASS: test_wt4117_checksum
      PASS: test_wt2403_lsm_workload
      PASS: test_wt4156_metadata_salvage
      PASS: test_wt4699_json
      PASS: wt4105_large_doc_small_upd/smoke.sh
      PASS: test_wt4891_meta_ckptlist_get_alloc
      PASS: wt6185_modify_ts/smoke.sh
      PASS: schema_abort/smoke.sh
      PASS: wt6616_checkpoint_oldest_ts/smoke.sh
      PASS: test_wt2323_join_visibility
      ../../../build_posix/gnu-support/test-driver: line 107: 73104 Aborted                 (core dumped) "$@" > $log_file 2>&1
      FAIL: test_wt8246_compact_rts_data_correctness
      PASS: wt2853_perf/smoke.sh
      PASS: test_wt4803_history_store_abort
      PASS: test_wt8057_compact_stress
      PASS: test_wt4333_handle_locks
      PASS: test_wt3338_partial_update
      PASS: test_wt7989_compact_checkpoint
      PASS: wt2909_checkpoint_integrity/smoke.sh
      ===================================================
         WiredTiger 10.0.2: test/csuite/test-suite.log
      ===================================================
      # TOTAL: 40
      # PASS:  39
      # SKIP:  0
      # XFAIL: 0
      # FAIL:  1
      # XPASS: 0
      # ERROR: 0
      .. contents:: :depth: 2
      FAIL: test_wt8246_compact_rts_data_correctness
      ==============================================
      [1687848670:793288][73109:0x7f7891d463c0], wiredtiger_open: __posix_file_lock, 393: WT_TEST.compact-stress-row/WiredTiger.lock: handle-lock: fcntl: Resource temporarily unavailable
      [1687848670:793348][73109:0x7f7891d463c0], wiredtiger_open: __conn_single, 1807: WiredTiger database is already being managed by another process: Device or resource busy
      Running test command: ./test_wt8246_compact_rts_data_correctness
      Work directory: WT_TEST.compact-stress-row
      

      logs

      spinlock-pthread-adaptive-test task_log

      Logs:

      test_wt8246_compact_rts_data_correctness: FAILED: workload_compact/218: wiredtiger_open(home, NULL, conn_config, &conn): Device or resource busy
      
      

      logs

      spinlock-pthread-adaptive-test task_log

      Logs:

      test_wt8246_compact_rts_data_correctness: process aborting
      WiredTiger Error: aborting WiredTiger library
      

      logs

      spinlock-pthread-adaptive-test task_log

      Logs:

      test_wt8246_compact_rts_data_correctness: FAILED: Child process 73109 abnormally exited: Invalid argument
      
      

      logs

      spinlock-pthread-adaptive-test task_log

      Logs:

      test_wt8246_compact_rts_data_correctness: process aborting
      WiredTiger Error: aborting WiredTiger library
      

      logs

      spinlock-pthread-adaptive-test task_log

      Logs:

      # XFAIL: 0
      # FAIL:  1
      # XPASS: 0
      # ERROR: 0
      ============================================================================
      See test/csuite/test-suite.log
      Please report to support@wiredtiger.com
      ============================================================================
      make[3]: *** [Makefile:1820: test-suite.log] Error 1
      make[3]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/csuite'
      make[2]: *** [Makefile:1928: check-TESTS] Error 2
      make[2]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/csuite'
      make[1]: *** [Makefile:2274: check-am] Error 2
      make[1]: Leaving directory '/data/mci/ad2028d75f157f82d230b03b6b138441/wiredtiger/build_posix/test/csuite'
      make: *** [Makefile:2479: check-recursive] Error 1
      fi
      Command 'shell.exec' in function 'make check all' (step 3 of 5) failed: shell script encountered problem: exit code 2.
      Task completed - FAILURE.
      Running post-task commands.
      Running command 'archive.targz_pack' in function 'upload artifact' (step 1.1 of 4) in block 'post'.
      Finished command 'archive.targz_pack' in function 'upload artifact' (step 1.1 of 4) in block 'post' in 2m0.981522377s.
      Running command 's3.put' in function 'upload artifact' (step 1.2 of 4) in block 'post'.
      Putting local file 'wiredtiger.tgz' into path 'build_external/wiredtiger/ubuntu2004/6857535f7469f07bdd1caf7bf47ec9b2728d94b8/artifacts/spinlock-pthread-adaptive-test_wiredtiger_mongo_v5.0_ubuntu2004_6857535f7469f07bdd1caf7bf47ec9b2728d94b8_23_06_27_06_26_36-0.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/ubuntu2004/6857535f7469f07bdd1caf7bf47ec9b2728d94b8/artifacts/spinlock-pthread-adaptive-test_wiredtiger_mongo_v5.0_ubuntu2004_6857535f7469f07bdd1caf7bf47ec9b2728d94b8_23_06_27_06_26_36-0.tgz).
      Performing S3 put to file 'wiredtiger/ubuntu2004/6857535f7469f07bdd1caf7bf47ec9b2728d94b8/artifacts/spinlock-pthread-adaptive-test_wiredtiger_mongo_v5.0_ubuntu2004_6857535f7469f07bdd1caf7bf47ec9b2728d94b8_23_06_27_06_26_36-0.tgz' in bucket 'build_external' (attempt 1 of 5).
      Finished command 's3.put' in function 'upload artifact' (step 1.2 of 4) in block 'post' in 38.252427595s.
      Running command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 2.1 of 4) in block 'post'.
      Finished command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 2.1 of 4) in block 'post' in 24.326497ms.
      Running command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 2.2 of 4) in block 'post'.
      Putting local file 'wt-hang-analyzer.tgz' into path 'build_external/wiredtiger/ubuntu2004/6857535f7469f07bdd1caf7bf47ec9b2728d94b8/wt_hang_analyzer/wt-hang-analyzer_spinlock-pthread-adaptive-test_wiredtiger_mongo_v5.0_ubuntu2004_6857535f7469f07bdd1caf7bf47ec9b2728d94b8_23_06_27_06_26_36-0.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/ubuntu2004/6857535f7469f07bdd1caf7bf47ec9b2728d94b8/wt_hang_analyzer/wt-hang-analyzer_spinlock-pthread-adaptive-test_wiredtiger_mongo_v5.0_ubuntu2004_6857535f7469f07bdd1caf7bf47ec9b2728d94b8_23_06_27_06_26_36-0.tgz).
      Performing S3 put to file 'wiredtiger/ubuntu2004/6857535f7469f07bdd1caf7bf47ec9b2728d94b8/wt_hang_analyzer/wt-hang-analyzer_spinlock-pthread-adaptive-test_wiredtiger_mongo_v5.0_ubuntu2004_6857535f7469f07bdd1caf7bf47ec9b2728d94b8_23_06_27_06_26_36-0.tgz' in bucket 'build_external' (attempt 1 of 5).
      Command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 2.2 of 4) in block 'post' failed: missing file '/data/mci/ad2028d75f157f82d230b03b6b138441/wt-hang-analyzer.tgz': opening file '/data/mci/ad2028d75f157f82d230b03b6b138441/wt-hang-analyzer.tgz': open /data/mci/ad2028d75f157f82d230b03b6b138441/wt-hang-analyzer.tgz: no such file or directory.
      Finished command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 2.2 of 4) in block 'post' in 22.188475ms.
      Running command 'shell.exec' in function 'dump stderr/stdout' (step 3 of 4) in block 'post'.
      if [ -d "WT_TEST" ]; then
        # Dump stderr/stdout contents generated by the C libraries onto console for Python tests
        find "WT_TEST" -name "std*.txt" ! -empty -exec sh -c "echo 'Contents from {}:'; cat '{}'" \;
      fi
      Finished command 'shell.exec' in function 'dump stderr/stdout' (step 3 of 4) in block 'post' in 953.856µs.
      Running command 'shell.exec' in function 'cleanup' (step 4 of 4) in block 'post'.
      Finished command 'shell.exec' in function 'cleanup' (step 4 of 4) in block 'post' in 703.50957ms.
      Finished running post-task commands in 2m40.006872124s.
      running setup group because we have a new independent task
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: