Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Fixed
Priority: Major - P3
Fix Version/s: WT12.0.0, 8.2.0-rc0
Affects Version/s: None
Component/s: Test Python
Labels:
- BB-Tools
- CI-blocker

Assigned Teams:

Storage Engines, Storage Engines - Transactions
Sprint:
SE Transactions - 2025-07-18
Story Points:
5
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
Failing Tasks:
- unit-test-extra-long
- unit-test-macos
First Failing Revision:
- a4f10c8e09b18698ff8eaf7feb479ca18ecde8dc(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-14954
Count of Linked BFGs (Last 30 days):
57

unit-test-extra-long on ubuntu2004-nonstandalone

Host: i-0450b802ab3ca9478
Project: wiredtiger
Commit: a4f10c8e
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task unit-test-extra-long

unit-test-extra-long task_log

Logs:

[pid:118520]: FAIL: test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl2.read2.write1.txn2)
----------------------------------------------------------------------
[pid:118520]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/wttest.py", line 570, in tearDown
    self.captureout.check(self)
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/../py_utility/abstract_test_case.py", line 111, in check
    testcase.fail('unexpected ' + self.desc + ', contains: "' +
  File "/opt/mongodbtoolchain/revisions/79c9b62fe59b85252bd716333ebea111b4d03a12/stow/python3-v5.pJI/lib/python3.10/unittest/case.py", line 675, in fail
    raise self.failureException(msg)
AssertionError: unexpected standard output, contains: "[1751931175:625954][118540:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl2.read2.write1.txn2), txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
[1751931241:364630][118540:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl2.read2.write1.txn2), file:test_truncate.wt_stable, WT_CURSOR.search: [WT_VERB_EVICTION][WARNING]: Eviction took more than 1 minute (65254967us). Building disk image took 65222782us. History store wrapup took 6105us.
[1751931241:919855][118540:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl2.read2.write1.txn2), WT_CONNECTION.close: [WT_VERB_RTS][WARNING]: skipped shutdown RTS due to disagg
"
======================================================================
[pid:118520]: FAIL: test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read2.write2.txn2)
----------------------------------------------------------------------
[pid:118520]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/wttest.py", line 570, in tearDown
    self.captureout.check(self)
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/../py_utility/abstract_test_case.py", line 111, in check
    testcase.fail('unexpected ' + self.desc + ', contains: "' +
  File "/opt/mongodbtoolchain/revisions/79c9b62fe59b85252bd716333ebea111b4d03a12/stow/python3-v5.pJI/lib/python3.10/unittest/case.py", line 675, in fail
    raise self.failureException(msg)
AssertionError: unexpected standard output, contains: "[1751931177:173548][118557:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read2.write2.txn2), txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
[1751931243:633623][118557:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read2.write2.txn2), file:test_truncate.wt_stable, WT_CURSOR.search: [WT_VERB_EVICTION][WARNING]: Eviction took more than 1 minute (65971466us). Building disk image took 65942185us. History store wrapup took 6261us.
[1751931244:499756][118557:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read2.write2.txn2), WT_CONNECTION.close: [WT_VERB_RTS][WARNING]: skipped shutdown RTS due to disagg
"
======================================================================
[pid:118520]: FAIL: test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write2.txn2)
----------------------------------------------------------------------
[pid:118520]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/wttest.py", line 570, in tearDown
    self.captureout.check(self)
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/../py_utility/abstract_test_case.py", line 111, in check
    testcase.fail('unexpected ' + self.desc + ', contains: "' +
  File "/opt/mongodbtoolchain/revisions/79c9b62fe59b85252bd716333ebea111b4d03a12/stow/python3-v5.pJI/lib/python3.10/unittest/case.py", line 675, in fail
    raise self.failureException(msg)
AssertionError: unexpected standard output, contains: "[1751931197:057803][118747:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write2.txn2), txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
[1751931270:902720][118747:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write2.txn2), file:test_truncate.wt_stable, WT_CURSOR.search: [WT_VERB_EVICTION][WARNING]: Eviction took more than 1 minute (73341487us). Building disk image took 73306207us. History store wrapup took 6395us.
[1751931271:400864][118747:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write2.txn2), WT_CONNECTION.close: [WT_VERB_RTS][WARNING]: skipped shutdown RTS due to disagg
"
======================================================================
[pid:118520]: FAIL: test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.string.ovfl1.read2.write1.txn2)
----------------------------------------------------------------------
[pid:118520]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/wttest.py", line 570, in tearDown
    self.captureout.check(self)
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/../py_utility/abstract_test_case.py", line 111, in check
    testcase.fail('unexpected ' + self.desc + ', contains: "' +
  File "/opt/mongodbtoolchain/revisions/79c9b62fe59b85252bd716333ebea111b4d03a12/stow/python3-v5.pJI/lib/python3.10/unittest/case.py", line 675, in fail
    raise self.failureException(msg)
AssertionError: unexpected standard output, contains: "[1751931278:462943][118540:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.string.ovfl1.read2.write1.txn2), txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
[1751931364:721005][118540:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.string.ovfl1.read2.write1.txn2), file:test_truncate.wt_stable, WT_CURSOR.search: [WT_VERB_EVICTION][WARNING]: Eviction took more than 1 minute (85761560us). Building disk image took 85725344us. History store wrapup took 8454us.
[1751931364:823847][118540:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.string.ovfl1.read2.write1.txn2), WT_CONNECTION.close: [WT_VERB_RTS][WARNING]: skipped shutdown RTS due to disagg
"
======================================================================
[pid:118520]: FAIL: test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write4.txn1)
----------------------------------------------------------------------
[pid:118520]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/wttest.py", line 570, in tearDown
    self.captureout.check(self)
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/../py_utility/abstract_test_case.py", line 111, in check
    testcase.fail('unexpected ' + self.desc + ', contains: "' +
  File "/opt/mongodbtoolchain/revisions/79c9b62fe59b85252bd716333ebea111b4d03a12/stow/python3-v5.pJI/lib/python3.10/unittest/case.py", line 675, in fail
    raise self.failureException(msg)
AssertionError: unexpected standard output, contains: "[1751931211:131646][118856:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write4.txn1), txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
[1751931286:056127][118856:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write4.txn1), file:test_truncate.wt_stable, WT_CURSOR.search: [WT_VERB_EVICTION][WARNING]: Eviction took more than 1 minute (74319552us). Building disk image took 74288928us. History store wrapup took 6385us.
[1751931286:547839][118856:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl1.read3.write4.txn1), WT_CONNECTION.close: [WT_VERB_RTS][WARNING]: skipped shutdown RTS due to disagg
"
======================================================================
[pid:118520]: FAIL: test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl2.read2.write2.txn2)
----------------------------------------------------------------------
[pid:118520]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/wttest.py", line 570, in tearDown
    self.captureout.check(self)
  File "/data/mci/174c45c27f788b79c10fd973556a711d/wiredtiger/test/suite/../py_utility/abstract_test_case.py", line 111, in check
    testcase.fail('unexpected ' + self.desc + ', contains: "' +
  File "/opt/mongodbtoolchain/revisions/79c9b62fe59b85252bd716333ebea111b4d03a12/stow/python3-v5.pJI/lib/python3.10/unittest/case.py", line 675, in fail
    raise self.failureException(msg)
AssertionError: unexpected standard output, contains: "[1751931279:403128][118557:0x7f023a525cc0], test_truncate02.test_truncate_fast_delete.test_truncate_fast_delete(palm.layered.integer.ovfl2.read2.write2.txn2), txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
[1751931363:118600][118557:0x7f0

logs

is related to

WT-14340 Make conn->flags atomic

Closed

WT-14980 Disagg table ID namespacing not correctly feature-gated

Closed

SERVER-106431 Update version cursor config to new format

Closed

WT-14697 Merge disagg testing code into develop

Closed

WT-14978 Add diagnostic information to durable timestamp assertion

Closed

WT-9931 Reader took an order of magnitude longer for when all history store records were invisible

Closed

WT-14953 test_layered17 spinlock abort - pthread_mutex_lock: (null): Invalid argument

Closed

WT-14955 failed: format-failure-configs-test on ubuntu2004 [wiredtiger @ a4f10c8e]

Closed

WT-14956 AssertionError in test_rollback01.py: no rollback occurred on cursor->next() for disagg

Closed

related to

WT-14653 Add logs/stats to reconciliation for tracking HS updates

Closed

WT-14750 Failure in __wt_page_inmem: "encountered an illegal file format or internal value: 0x0"

Closed

WT-14848 Fix missing WT_RET in live_restore_fs.c

Closed

WT-14864 Remove duplicate TSAN warnings from metric script

Closed

WT-14872 clang-analyzer gives misleading output

Closed

WT-14919 Coverity analysis defect 175312: Unused value

Closed

WT-14929 Coverity analysis defect 174890: Resource leak

Closed

WT-14935 Solve: SUMMARY: ThreadSanitizer: data race /home/ec2-user/work/git/wiredtiger-arm/src/support/mtx_rw.c:168:71 in __read_blocked

Closed

WT-14980 Disagg table ID namespacing not correctly feature-gated

Closed

WT-14619 Merge layered tables into develop

Closed

WT-14865 Create a parser script for wiredtiger config string in turtle files

Closed

WT-14562 Dump all extent list blocks when we do a corrupt block dump

Closed

WT-14695 Merge page deltas into develop

Closed

WT-14696 Merge precise checkpoint into develop

Closed

WT-14698 Merge remaining disagg code into develop

Closed

WT-14826 Write the prepare timestamp and prepared id to disk with preserve prepared config

Closed

WT-14828 Ensure we set the prepare id when preparing a transaction if preserve prepare config is on

Closed

WT-14833 Fix TCMalloc build/propagation for some stress tests

Closed

WT-14858 Forbid to prepare a transaction before the stable timestamp if preserve_prepare config is on

Closed

WT-14869 Pack prepared ts and prepared id correctly to cell format and unpack them accordingly

Closed

WT-14878 Assign prepared id and prepard ts on page deltas

Closed

WT-14901 Enable all examples regular testing with TSAN by suppressing all the warnings

Closed

WT-14951 Merge newer disagg code into develop

Closed

WT-14837 Add metric to measure execution time of block_first_srch()

Closed

WT-14727 update the workgen latency metrics to print the bucket count for us, ms and secs

Closed

WT-14832 Add read operations to test/model

Closed

WT-12337 Review and fix WT_ASSERTs in packing_inline.h

Closed

WT-13985 Did not run a sweep for 60 minutes in test_prepare_hs01 for CS

Closed

WT-14648 Fix log subsystem returning EBUSY from conn->close()

Closed

WT-14719 Update cache workloads to adapt to stat name change for cache_eviction_trigger_clean_reached

Closed

WT-14896 Failed: s-outdated-fixmes on ~ Infrequent checks [WiredTiger (develop) @ 2b0ed0cf]

Closed

WT-14946 Disable incompatible tests between disagg and tiered

Closed

WT-14947 Suppress perf critical warnings

Closed

WT-14953 test_layered17 spinlock abort - pthread_mutex_lock: (null): Invalid argument

Closed

WT-14955 failed: format-failure-configs-test on ubuntu2004 [wiredtiger @ a4f10c8e]

Closed

WT-14956 AssertionError in test_rollback01.py: no rollback occurred on cursor->next() for disagg

Closed

WT-13038 task-timed-out: csuite-timestamp-abort-test-s3 on ubuntu2004

Closed

(4 is related to, 37 related to)

Assignee:: Monica Ng
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 5 Start watching this issue

Created:: Jul 08 2025 03:43:32 AM UTC
Updated:: Jul 15 2025 05:33:33 AM UTC
Resolved:: Jul 15 2025 12:21:17 AM UTC

Details

Description

Attachments

Issue Links

Activity

People

Dates