Loading...

Type: Build Failure
Resolution: Fixed
Priority: Major - P3
Fix Version/s: WT12.0.0, 8.3.0-rc0
Affects Version/s: None
Component/s: Reconciliation
Labels:
- BB-Tools

Epic Link:
SPM-4331
Assigned Teams:

Storage Engines, Storage Engines - Transactions
Sprint:
SE Transactions - 2025-08-29
Story Points:
3
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- rhel8-zseries
Failing Tasks:
- unit-test
First Failing Revision:
- a6111090f3351d841d087d4db71d8b66105118b8(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-15252
Count of Linked BFGs (Last 30 days):
7

Host: rhel8-medium-11.z.devprod.mongodb.com
Project: wiredtiger
Commit: a6111090
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task unit-test

unit-test task_log

Logs:

"[1755852205:723730][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_internal_only), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
"[1755852211:847117][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_both), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
"[1755852221:637697][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_leaf_only), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
"[1755852227:707868][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_none), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
AssertionError: unexpected error output, contains: "[1755852205:723730][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_internal_only), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
AssertionError: unexpected error output, contains: "[1755852211:847117][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_both), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
AssertionError: unexpected error output, contains: "[1755852221:637697][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_leaf_only), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
"[1755852229:108509][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_internal_only), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
"[1755852237:341545][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_both), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
"[1755852262:141405][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_leaf_only), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
AssertionError: unexpected error output, contains: "[1755852227:707868][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_none), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
AssertionError: unexpected error output, contains: "[1755852229:108509][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_internal_only), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
AssertionError: unexpected error output, contains: "[1755852237:341545][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_both), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
"[1755852266:248136][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_none), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
"[1755852267:159126][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_internal_only), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
"[1755852272:235030][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_both), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
"[1755852283:510390][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_leaf_only), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
AssertionError: unexpected error output, contains: "[1755852262:141405][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_leaf_only), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=2098, lsn=1999, flags=0, matches.backlink_lsn=0, last_lsn=2117
AssertionError: unexpected error output, contains: "[1755852266:248136][1384749:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_none), file:test_layered32, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=33, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
AssertionError: unexpected error output, contains: "[1755852267:159126][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_internal_only), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=1091, lsn=992, flags=0, matches.backlink_lsn=0, last_lsn=1054
AssertionError: unexpected error output, contains: "[1755852272:235030][1384748:0x3ff878f5440], test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_both), file:test_layered32.wt_stable, WT_CURSOR.search: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_get:930: Delta chain validation failed at position 1: matches.backlink_lsn != last_lsn. Page details: table_id=41, page_id=2098, lsn=1999, flags=0, matches.bac

logs

unit-test task_log

Logs:

[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_internal_only)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_both)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_leaf_only)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.layered.non-ts.write_none)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_internal_only)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_both)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_leaf_only)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.none.palm.btree.non-ts.write_none)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_internal_only)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_both)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_leaf_only)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", line 243, in _callTestMethod
    method()
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 162, in test_internal_page_delta_simple
    self.verify(kv_modfied, inital_value)
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/test_layered32.py", line 124, in verify
    cursor.search()
_wiredtiger.WiredTigerError: WT_ERROR: non-specific WiredTiger error
======================================================================
[pid:1384747]: ERROR: test_layered32.test_layered32.test_internal_page_delta_simple(none.snappy.palm.layered.non-ts.write_none)
----------------------------------------------------------------------
[pid:1384747]: testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/8359866e9f7b34fa941e1956dc3233fe/wiredtiger/test/suite/wttest.py", l

logs

is related to

WT-15246 Re-enable prepared testing that depends on new delta data format

Open

WT-15267 Change python test test_prepare34 to trigger WT_UPDATE_MODIFY

Closed

related to

WT-15209 Add a feature flag for eviction changes.

Closed

WT-14989 Dump transaction information if timestamp validation failed in commit

Closed

WT-15230 Fix test_prepare_discover01

Closed

WT-15168 Understand empty "extractor" configuration strings

Closed

(1 related to)

Details

Description

Attachments

Issue Links

Forms

Activity

People

Dates