Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Unresolved
Priority: Major - P3
Fix Version/s: None
Affects Version/s: None
Component/s: None
Labels:
- BB-Tools

Assigned Teams:

Storage Engines - Transactions
Sprint:
SE Transactions - 2025-12-05
Story Points:
3
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
Failing Tasks:
First Failing Revision:
- 5600e1273d01457b55f5a05f8497126e8a1d56b6(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-15901
Count of Linked BFGs (Last 30 days):
4

unit-test on ubuntu2004-arm64-release-nonstandalone

Host: i-0e012566ba9cc8bbc
Project: wiredtiger
Commit: 5600e127
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task unit-test

unit-test task_log

Logs:

[pid:2917]: test_layered47.test_layered47.test_checkpoint_order_mismatch -s 0 (palite): starting
[pid:2917]: test_layered47.test_layered47.test_checkpoint_order_mismatch -s 0 (palite): 0.77 seconds
[pid:2916/2917]: test_layered47.test_layered47.test_checkpoint_order_mismatch(palite) ... ok

logs

unit-test task_log

Logs:

"[1760671200:309632][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), file:test_verify_disagg.wt_stable, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __time_value_validate_parent, 432: value time window has a start time before its parent's oldest start time; time window start: (0, 15508)/(0, 15508)/(0, 0)/0/0 | stop: (0, 0)/(4294967295, 4294967295)/(0, 0)/0/18446744073709551605, parent newest_durable: (0, 25544)/(0, 0) | oldest_start: (0, 20053)/0 | newest_stop: (4294967295, 4294967295)/18446744073709551605: Invalid argument
[1760671200:309701][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), file:test_verify_disagg.wt_stable, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __verify_page_content_leaf, 1374: cell 579 on page at address:[114, 1, 77, 33, 1032, 505700659], time-window: newest_durable: (0, 25544)/(0, 0) | oldest_start: (0, 20053)/0 | newest_stop: (4294967295, 4294967295)/18446744073709551605 failed timestamp validation: Invalid argument
[1760671200:309757][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), layered:test_verify_disagg, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __schema_layered_worker_verify, 109: Verify (layered): file:test_verify_disagg.wt_stable stable table verification failed : Invalid argument
[1760671200:310346][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __time_value_validate_parent, 432: Error at src/support/timestamp.c:432: "EINVAL" failed: Invalid argument
[1760671200:310368][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_page_content_leaf, 1374: Error at src/btree/bt_vrfy.c:1374: "ret" failed: Invalid argument
[1760671200:310379][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_tree, 686: Error at src/btree/bt_vrfy.c:686: "__verify_page_content_leaf(session, ref, addr_unpack, vs)" failed: Invalid argument
[1760671200:310390][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_tree, 887: Error at src/btree/bt_vrfy.c:887: "ret" failed: Invalid argument
[1760671200:310399][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_verify, 364: Error at src/btree/bt_vrfy.c:364: "ret" failed: Invalid argument
[1760671200:310409][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_schema_worker, 188: Error at src/schema/schema_worker.c:188: "__wti_execute_handle_operation(session, uri, file_func, cfg, open_flags)" failed: Invalid argument
[1760671200:310419][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __schema_layered_worker_verify, 109: Error at src/schema/schema_worker.c:109: "stable_ret" failed: Invalid argument
[1760671200:310428][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_schema_worker, 244: Error at src/schema/schema_worker.c:244: "__schema_layered_worker_verify(session, uri, file_func, name_func, cfg, open_flags)" failed: Invalid argument
[1760671200:310437][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __session_verify, 1819: Error at src/session/session_api.c:1819: "ret" failed: Invalid argument
AssertionError: unexpected error output, contains: "[1760671200:309632][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), file:test_verify_disagg.wt_stable, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __time_value_validate_parent, 432: value time window has a start time before its parent's oldest start time; time window start: (0, 15508)/(0, 15508)/(0, 0)/0/0 | stop: (0, 0)/(4294967295, 4294967295)/(0, 0)/0/18446744073709551605, parent newest_durable: (0, 25544)/(0, 0) | oldest_start: (0, 20053)/0 | newest_stop: (4294967295, 4294967295)/18446744073709551605: Invalid argument
[1760671200:309701][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), file:test_verify_disagg.wt_stable, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __verify_page_content_leaf, 1374: cell 579 on page at address:[114, 1, 77, 33, 1032, 505700659], time-window: newest_durable: (0, 25544)/(0, 0) | oldest_start: (0, 20053)/0 | newest_stop: (4294967295, 4294967295)/18446744073709551605 failed timestamp validation: Invalid argument
[1760671200:309757][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), layered:test_verify_disagg, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __schema_layered_worker_verify, 109: Verify (layered): file:test_verify_disagg.wt_stable stable table verification failed : Invalid argument
[1760671200:310346][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __time_value_validate_parent, 432: Error at src/support/timestamp.c:432: "EINVAL" failed: Invalid argument
[1760671200:310368][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_page_content_leaf, 1374: Error at src/btree/bt_vrfy.c:1374: "ret" failed: Invalid argument
[1760671200:310379][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_tree, 686: Error at src/btree/bt_vrfy.c:686: "__verify_page_content_leaf(session, ref, addr_unpack, vs)" failed: Invalid argument
[1760671200:310390][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_tree, 887: Error at src/btree/bt_vrfy.c:887: "ret" failed: Invalid argument
[1760671200:310399][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_verify, 364: Error at src/btree/bt_vrfy.c:364: "ret" failed: Invalid argument
[1760671200:310409][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_schema_worker, 188: Error at src/schema/schema_worker.c:188: "__wti_execute_handle_operation(session, uri, file_func, cfg, open_flags)" failed: Invalid argument

logs

unit-test task_log

Logs:

[pid:2916]: ERROR: test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite)
----------------------------------------------------------------------
[pid:2916]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/43ffdfaa157e97c588bfeb88cae01a1d/wiredtiger/test/suite/wttest.py", line 283, in _callTestMethod
    method()
  File "/data/mci/43ffdfaa157e97c588bfeb88cae01a1d/wiredtiger/test/suite/test_verify_disagg.py", line 126, in test_verify_disagg
    self.verify([self.session])
  File "/data/mci/43ffdfaa157e97c588bfeb88cae01a1d/wiredtiger/test/suite/test_verify_disagg.py", line 79, in verify
    self.verifyUntilSuccess(session)
  File "/data/mci/43ffdfaa157e97c588bfeb88cae01a1d/wiredtiger/test/suite/wttest.py", line 878, in verifyUntilSuccess
    return self.retryEBUSY(session, lambda: session.verify(uri, config), **kwargs)
  File "/data/mci/43ffdfaa157e97c588bfeb88cae01a1d/wiredtiger/test/suite/wttest.py", line 851, in retryEBUSY
    raise err
  File "/data/mci/43ffdfaa157e97c588bfeb88cae01a1d/wiredtiger/test/suite/wttest.py", line 848, in retryEBUSY
    return func()
  File "/data/mci/43ffdfaa157e97c588bfeb88cae01a1d/wiredtiger/test/suite/wttest.py", line 878, in <lambda>
    return self.retryEBUSY(session, lambda: session.verify(uri, config), **kwargs)
_wiredtiger.WiredTigerError: Invalid argument
----------------------------------------------------------------------
Ran 14402 tests in 4460.089s

logs

unit-test task_log

Logs:

[1760671200:310419][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __schema_layered_worker_verify, 109: Error at src/schema/schema_worker.c:109: "stable_ret" failed: Invalid argument
[1760671200:310428][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_schema_worker, 244: Error at src/schema/schema_worker.c:244: "__schema_layered_worker_verify(session, uri, file_func, name_func, cfg, open_flags)" failed: Invalid argument
[1760671200:310437][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __session_verify, 1819: Error at src/session/session_api.c:1819: "ret" failed: Invalid argument
[1760671200:309632][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), file:test_verify_disagg.wt_stable, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __time_value_validate_parent, 432: value time window has a start time before its parent's oldest start time; time window start: (0, 15508)/(0, 15508)/(0, 0)/0/0 | stop: (0, 0)/(4294967295, 4294967295)/(0, 0)/0/18446744073709551605, parent newest_durable: (0, 25544)/(0, 0) | oldest_start: (0, 20053)/0 | newest_stop: (4294967295, 4294967295)/18446744073709551605: Invalid argument
[1760671200:309701][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), file:test_verify_disagg.wt_stable, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __verify_page_content_leaf, 1374: cell 579 on page at address:[114, 1, 77, 33, 1032, 505700659], time-window: newest_durable: (0, 25544)/(0, 0) | oldest_start: (0, 20053)/0 | newest_stop: (4294967295, 4294967295)/18446744073709551605 failed timestamp validation: Invalid argument
[1760671200:309757][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), layered:test_verify_disagg, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __schema_layered_worker_verify, 109: Verify (layered): file:test_verify_disagg.wt_stable stable table verification failed : Invalid argument
[1760671200:310346][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __time_value_validate_parent, 432: Error at src/support/timestamp.c:432: "EINVAL" failed: Invalid argument
[1760671200:310368][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_page_content_leaf, 1374: Error at src/btree/bt_vrfy.c:1374: "ret" failed: Invalid argument
[1760671200:310379][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_tree, 686: Error at src/btree/bt_vrfy.c:686: "__verify_page_content_leaf(session, ref, addr_unpack, vs)" failed: Invalid argument
[1760671200:310390][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_tree, 887: Error at src/btree/bt_vrfy.c:887: "ret" failed: Invalid argument
[1760671200:310399][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_verify, 364: Error at src/btree/bt_vrfy.c:364: "ret" failed: Invalid argument
[1760671200:310409][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_schema_worker, 188: Error at src/schema/schema_worker.c:188: "__wti_execute_handle_operation(session, uri, file_func, cfg, open_flags)" failed: Invalid argument
[1760671200:310419][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __schema_layered_worker_verify, 109: Error at src/schema/schema_worker.c:109: "stable_ret" failed: Invalid argument
[1760671200:310428][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_schema_worker, 244: Error at src/schema/schema_worker.c:244: "__schema_layered_worker_verify(session, uri, file_func, name_func, cfg, open_flags)" failed: Invalid argument
[1760671200:310437][2918:0xffffa93987c0], test_verify_disagg.test_verify_disagg.test_verify_disagg(populated.palite), WT_CONNECTION.dump_error_log: [WT_VERB_ERROR_RETURNS][ERROR]: __session_verify, 1819: Error at src/session/session_api.c:1819: "ret" failed: Invalid argument

logs

is related to

WT-15619 Implement rewriting leaf page deltas directly into a full page

In Code Review

Assignee:: [DO NOT USE] Backlog - Storage Engines Team
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 3 Start watching this issue

Created:: Oct 29 2025 11:15:31 PM UTC
Updated:: Dec 01 2025 09:11:40 AM UTC

Details

Description

Attachments

Issue Links

Activity

People

Dates