Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-13652

test_lsm03 failed with "lost connection during test" on amazon2-arm64

    • Type: Icon: Build Failure Build Failure
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: LSM
    • StorEng - Defined Pipeline

      unit-test on amazon2-arm64

      Host: i-0183b769f5fe62195
      Project: wiredtiger-mongo-v7.0
      Commit: 79cf40ee

      Task Logs:

      unit-test task_log

      Logs:

      [pid:8510]: ERROR: test_lsm03.test_lsm03.test_lsm_drop_active
      ----------------------------------------------------------------------
      [pid:8510]: testtools.testresult.real._StringException: lost connection during test 'test_lsm03.test_lsm03.test_lsm_drop_active'
      ----------------------------------------------------------------------
      Ran 12253 tests in 1816.700s
      

      logs

      unit-test task_log

      Logs:

      #0  0x0000ffff94468834 in raise () from /lib64/libc.so.6
      #0  0x0000ffff94468834 in raise () from /lib64/libc.so.6
      #1  0x0000ffff9446a140 in abort () from /lib64/libc.so.6
      #2  0x0000ffff9392bbb0 in __wt_abort (session=session@entry=0x3b5e5148) at /data/mci/909806dc9cd7fce79f76f5282336df82/wiredtiger/src/os_common/os_abort.c:30
      #3  0x0000ffff9390748c in __clsm_open_cursors (clsm=clsm@entry=0x3b5b46c0, update=update@entry=false, start_chunk=start_chunk@entry=6, start_id=start_id@entry=7) at /data/mci/909806dc9cd7fce79f76f5282336df82/wiredtiger/src/lsm/lsm_cursor.c:689
      #4  0x0000ffff93910ad8 in __wt_clsm_init_merge (cursor=0x3b5b46c0, start_chunk=start_chunk@entry=6, start_id=7, nchunks=nchunks@entry=1) at /data/mci/909806dc9cd7fce79f76f5282336df82/wiredtiger/src/lsm/lsm_cursor.c:728
      #5  0x0000ffff9391bf50 in __lsm_bloom_create (session=session@entry=0x3b5e5148, lsm_tree=lsm_tree@entry=0x501fcb40, chunk=chunk@entry=0x4f685760, chunk_off=chunk_off@entry=6) at /data/mci/909806dc9cd7fce79f76f5282336df82/wiredtiger/src/lsm/lsm_work_unit.c:551
      #6  0x0000ffff9391d46c in __wt_lsm_work_bloom (session=session@entry=0x3b5e5148, lsm_tree=0x501fcb40) at /data/mci/909806dc9cd7fce79f76f5282336df82/wiredtiger/src/lsm/lsm_work_unit.c:219
      #7  0x0000ffff9391e5f4 in __lsm_worker_general_op (session=session@entry=0x3b5e5148, cookie=cookie@entry=0x3c92d280, completed=completed@entry=0xffff7bc8a8f6) at /data/mci/909806dc9cd7fce79f76f5282336df82/wiredtiger/src/lsm/lsm_worker.c:81
      #8  0x0000ffff9391e670 in __lsm_worker (arg=0x3c92d280) at /data/mci/909806dc9cd7fce79f76f5282336df82/wiredtiger/src/lsm/lsm_worker.c:126
      #9  0x0000ffff946c6230 in start_thread () from /lib64/libpthread.so.0
      #10 0x0000ffff945117dc in thread_start () from /lib64/libc.so.6
      

      logs

      unit-test task_log

      Logs:

      [1728964481:870564][8523:0xffff7bc8b110], test_lsm03.test_lsm03.test_lsm_drop_active, file:test_lsm03-000007.lsm, lsm-worker: [WT_VERB_DEFAULT][ERROR]: __clsm_open_cursors, 689: WiredTiger assertion failed: '(((((chunk)->flags) & (0x08u)) != 0) && !chunk->empty) ? checkpoint != ((void *)0) : checkpoint == ((void *)0)'. LSM tree checkpoint config does not match
      [1728964481:870645][8523:0xffff7bc8b110], test_lsm03.test_lsm03.test_lsm_drop_active, file:test_lsm03-000007.lsm, lsm-worker: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 28: aborting WiredTiger library
      

      logs

      unit-test task_log

      Logs:

      [1728964820:793110][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99032, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793119][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99033, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793125][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99034, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793131][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99035, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793136][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99036, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793141][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99037, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793146][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99038, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793151][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99039, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793160][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99040, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793165][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99041, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793170][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99042, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793175][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99043, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793180][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99044, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793185][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99045, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793190][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99046, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793195][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99047, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793200][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99048, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793205][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99049, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793210][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99050, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793227][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99051, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793232][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99052, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793237][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99053, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793242][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99054, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793246][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99055, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793251][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99056, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PREPARE_INIT
      [1728964820:793256][8531:0xffff95082010], test_rollback_to_stable22.test_rollback_to_stable22.test_rollback_to_stable, file:rollback_to_stable22_0.wt, txn rollback_to_stable: [WT_VERB_RTS][DEBUG_1]: [UPDATE_ABORT] rollback to stable aborting update with txnid=99057, txnid_not_visible=false, stable_timestamp=(0, 990) < durable_timestamp=(0, 1000): true, prepare_state=WT_PRE
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: