Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Unresolved
Priority: Major - P3
Fix Version/s: None
Affects Version/s: None
Component/s: PALI
Labels:
- BB-Tools

Assigned Teams:

Storage Engines - Persistence
Total Hours with Assigned Team:
93.398
Sprint:
None
Story Points:
None
Evergreen Project:
- wiredtiger
- wiredtiger-disagg
Failure Type:
- failed
Failing Buildvariants:
Failing Tasks:
First Failing Revision:
- 9048e54ab70842d22f6328db4d4287eb70290b72(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-17594
Count of Linked BFGs (Last 30 days):
4

format-stress-test-disagg-switch-2 on amazon2023-stress-tests-arm64

Host: i-0ea6a2c40266d3dc4
Project: wiredtiger
Commit: 9048e54a
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task format-stress-test-disagg-switch-2

format-stress-test-disagg-switch-2 task_log

Logs:

[1779248607:115553][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Mismatch in the number of page IDs found from PALI and btree walk: PALI 141959 Btree walk 140500
[1779248607:120427][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70322] 114796
[1779248607:120446][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70323] 114799
[1779248607:120448][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70324] 114802
[1779248607:120450][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70325] 114805
[1779248607:120452][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70326] 114808
[1779248607:120454][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70327] 114811
[1779248607:120455][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70328] 114814
[1779248607:120457][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70329] 114817
[1779248607:120459][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70330] 114820
[1779248607:120460][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70331] 114823
[1779248607:120462][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70332] 114826
[1779248607:120464][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70333] 114829
[1779248607:120465][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70334] 114832
[1779248607:120467][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70335] 114835
[1779248607:120468][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70336] 114838
[1779248607:120470][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70337] 114841
[1779248607:120472][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70338] 114844
[1779248607:120474][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70339] 114847
[1779248607:120475][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70340] 114850
[1779248607:120477][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70341] 114853
[1779248607:120479][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70342] 114856
[1779248607:120480][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70343] 114859
[1779248607:120482][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70344] 114862
[1779248607:120484][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70345] 114865
[1779248607:120485][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70346] 114868
[1779248607:120487][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70347] 114871
[1779248607:120489][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70348] 114874
[1779248607:120490][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70349] 114877
[1779248607:120492][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70350] 114880
[1779248607:120494][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70351] 114883
[1779248607:120495][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70352] 114886
[1779248607:120497][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70353] 114889
[1779248607:120499][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70354] 114892
[1779248607:120500][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70355] 114895
[1779248607:120502][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70356] 114898
[1779248607:120504][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70357] 114901
[1779248607:120505][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70358] 114904
[1779248607:120508][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70359] 114907
[1779248607:120509][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70360] 114910
[1779248607:120511][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70361] 114913
[1779248607:120515][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70362] 114916
[1779248607:120516][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70363] 114919
[1779248607:120518][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70364] 114922
[1779248607:120520][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70365] 114925
[1779248607:120521][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70366] 114928
[1779248607:120523][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70367] 114931
[1779248607:120525][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70368] 114934
[1779248607:120526][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70369] 114937
[1779248607:120528][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70370] 114940
[1779248607:120530][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70371] 114943
[1779248607:120531][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70372] 114947
[1779248607:120533][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70373] 114950
[1779248607:120535][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70374] 114953
[1779248607:120536][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70375] 114956
[1779248607:120538][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70376] 114959
[1779248607:120539][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70377] 114962
[1779248607:120541][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70378] 114965
[1779248607:120543][23883:0xffff93ef2040], t, file:T00003.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Unreferenced page was not discarded: PALI[70

logs

format-stress-test-disagg-switch-2 task_log

Logs:

t: FAILED: table_verify/54: ret == 0 || ret == EBUSY || (g.disagg_storage_config && !g.disagg_leader && ret == ENOENT)

logs

format-stress-test-disagg-switch-2 task_log

Logs:

t: process aborting
WiredTiger Error: __wt_abort, 29: aborting WiredTiger library

logs

format-stress-test-disagg-switch-2 task_log

Logs:

#0  0x0000ffff926c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
#0  0x0000ffff926c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
#1  0x0000ffff9267b320 [PAC] in raise () from /lib64/libc.so.6
#2  0x0000ffff92662224 [PAC] in abort () from /lib64/libc.so.6
#3  0x0000ffff92a4bff4 [PAC] in __wt_abort (session=session@entry=0x0) at /data/mci/a0d9047db6fc4219c1babff4d9aba017/wiredtiger/src/os_common/os_abort.c:32
#4  0x0000000000425840 in testutil_die (e=e@entry=0, fmt=fmt@entry=0x4276a8 "%s/%d: %s") at /data/mci/a0d9047db6fc4219c1babff4d9aba017/wiredtiger/test/utility/misc.c:75
#5  0x000000000041c47c in table_verify (table=0x135e7fc1a000, arg=0x135e7fc1c000) at /data/mci/a0d9047db6fc4219c1babff4d9aba017/wiredtiger/test/format/verify.c:54
#6  0x000000000041c358 in tables_apply (func=func@entry=0x41c378 <table_verify>, arg=arg@entry=0x135e7fc1c000) at /data/mci/a0d9047db6fc4219c1babff4d9aba017/wiredtiger/test/format/format_inline.h:186
#7  0x000000000041d954 in wts_verify (conn=0x135e7fc1c000, mirror_check=mirror_check@entry=true) at /data/mci/a0d9047db6fc4219c1babff4d9aba017/wiredtiger/test/format/verify.c:390
#8  0x000000000041ba58 in main (argc=<optimized out>, argv=<optimized out>) at /data/mci/a0d9047db6fc4219c1babff4d9aba017/wiredtiger/test/format/t.c:426

logs

Repro Artifacts:

CONFIG

is related to

WT-17430 Multiple discarded pages in chain in PALite (test/format) Pt 2

Open

Assignee:: [DO NOT USE] Backlog - Storage Engines Team
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 3 Start watching this issue

Created:: May 20 2026 03:41:06 PM UTC
Updated:: May 24 2026 06:40:35 AM UTC

Details

Description

Attachments

Issue Links

Activity

People

Dates