Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Unresolved
Priority: Major - P3
Fix Version/s: None
Affects Version/s: None
Component/s: None
Labels:
- BB-Tools

Assigned Teams:

Storage Engines, Storage Engines - Transactions
Sprint:
None
Story Points:
None
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
Failing Tasks:
First Failing Revision:
- 1d838d1985ffea93e0f1c5d4e65ffe0fafe13193(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-15365
Count of Linked BFGs (Last 30 days):
6

format-failure-configs-test on ubuntu2004

Host: i-0632578624c609de6
Project: wiredtiger
Commit: 1d838d19
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task format-failure-configs-test

format-failure-configs-test task_log

Logs:

[1756956816:427128][4643:0x7f1908c45700], t, file:F00001, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle F00001 by session 7: Device or resource busy
[1756956826:427514][4643:0x7f1908c45700], t, file:F00001, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle F00001 by session 7: Device or resource busy
[1756956836:427865][4643:0x7f1908c45700], t, file:F00001, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle F00001 by session 7: Device or resource busy
[1756956846:428106][4643:0x7f1908c45700], t, file:F00001, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle F00001 by session 7: Device or resource busy
[1756958152:551988][6010:0x7f126bf55700], t, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_background_compact_signal, 812: Background compact is busy processing a previous command: Device or resource busy
[1756959570:406014][14419:0x7f119c1a2700], t, file:T00002.wt, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle T00002.wt by session 38: Device or resource busy

format-failure-configs-test task_log

Logs:

0x33753fcee000:transaction state dump
0x33753fcee000:current ID: 851
0x33753fcee000:last running ID: 851
0x33753fcee000:metadata_pinned ID: 851
0x33753fcee000:oldest ID: 851
0x33753fcee000:durable timestamp: (0, 10402781)
0x33753fcee000:oldest timestamp: (0, 10402647)
0x33753fcee000:pinned timestamp: (0, 10402647)
0x33753fcee000:stable timestamp: (0, 10402647)
0x33753fcee000:has_durable_timestamp: yes
0x33753fcee000:has_oldest_timestamp: yes
0x33753fcee000:has_pinned_timestamp: yes
0x33753fcee000:has_stable_timestamp: yes
0x33753fcee000:oldest_is_pinned: yes
0x33753fcee000:stable_is_pinned: yes
0x33753fcee000:checkpoint running: no
0x33753fcee000:checkpoint generation: 22
0x33753fcee000:checkpoint pinned ID: 0
0x33753fcee000:checkpoint txn ID: 0
0x33753fcee000:session count: 23
0x33753fcee000:Transaction state of active sessions:
0x33753fcee000:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
0x33753fcee000:cache dump
0x33753fcee000:cache full: no
0x33753fcee000:cache clean check: no (79.346%)
0x33753fcee000:cache dirty check: yes (20.349%)
0x33753fcee000:cache updates check: no (1.687%)
format run more than 15 minutes past the maximum time
format run dumping cache and transaction state, then aborting the process
0x33753fcee000:file:F00003(checkpoint=WiredTigerCheckpoint.20):
0x33753fcee000:internal: 27 pages, 5792.55 KB, 27/0 clean/dirty pages, 5792.55/0.00 clean / dirty KB, 318.45 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 7650 pages, 38680.87 KB, 7650/0 clean/dirty pages, 38680.87 /0.00 /0.00 clean/dirty/updates KB, 5.91 KB max page, 0.00 KB max dirty page
0x33753fcee000:file:T00002.wt(checkpoint=WiredTigerCheckpoint.20):
0x33753fcee000:internal: 1 pages, 2.32 KB, 1/0 clean/dirty pages, 2.32/0.00 clean / dirty KB, 2.32 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 0 pages
0x33753fcee000:file:T00001.wt(checkpoint=WiredTigerCheckpoint.20):
0x33753fcee000:internal: 1 pages, 741.25 KB, 1/0 clean/dirty pages, 741.25/0.00 clean / dirty KB, 741.25 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 0 pages
0x33753fcee000:file:WiredTigerHS.wt(checkpoint=WiredTigerCheckpoint.9):
0x33753fcee000:internal: 1 pages, 0.40 KB, 1/0 clean/dirty pages, 0.40/0.00 clean / dirty KB, 0.40 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 0 pages
0x33753fcee000:file:WiredTigerHS.wt(checkpoint=mine.2):
0x33753fcee000:internal: 1 pages, 0.45 KB, 1/0 clean/dirty pages, 0.45/0.00 clean / dirty KB, 0.45 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 0 pages
0x33753fcee000:file:WiredTigerHS.wt(checkpoint=mine.1):
0x33753fcee000:internal: 1 pages, 0.40 KB, 1/0 clean/dirty pages, 0.40/0.00 clean / dirty KB, 0.40 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 0 pages
0x33753fcee000:file:F00003(<live>):
0x33753fcee000:internal: 31 pages, 9295.30 KB, 1/30 clean/dirty pages, 5.96/9289.34 clean / dirty KB, 331.73 KB max page, 331.73 KB max dirty page
0x33753fcee000:leaf: 133 pages, 842.97 KB, 0/133 clean/dirty pages, 0.00 /842.97 /138.62 clean/dirty/updates KB, 10.33 KB max page, 10.33 KB max dirty page
0x33753fcee000:file:T00002.wt(<live>):
0x33753fcee000:internal: 12 pages, 681.75 KB, 1/11 clean/dirty pages, 2.54/679.21 clean / dirty KB, 67.32 KB max page, 67.32 KB max dirty page
0x33753fcee000:leaf: 125 pages, 9289.91 KB, 0/125 clean/dirty pages, 0.00 /9289.91 /756.13 clean/dirty/updates KB, 153.86 KB max page, 153.86 KB max dirty page
0x33753fcee000:file:T00001.wt(<live>):
0x33753fcee000:internal: 1 pages, 741.01 KB, 0/1 clean/dirty pages, 0.00/741.01 clean / dirty KB, 741.01 KB max page, 741.01 KB max dirty page
0x33753fcee000:leaf: 126 pages, 9161.07 KB, 0/126 clean/dirty pages, 0.00 /9161.07 /704.71 clean/dirty/updates KB, 75.99 KB max page, 75.99 KB max dirty page
0x33753fcee000:file:WiredTigerHS.wt(<live>):
0x33753fcee000:internal: 1 pages, 0.72 KB, 1/0 clean/dirty pages, 0.72/0.00 clean / dirty KB, 0.72 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 0 pages
0x33753fcee000:file:WiredTiger.wt(<live>):
0x33753fcee000:internal: 1 pages, 0.76 KB, 1/0 clean/dirty pages, 0.76/0.00 clean / dirty KB, 0.76 KB max page, 0.00 KB max dirty page
0x33753fcee000:leaf: 0 pages
0x33753fcee000:cache dump: total found: 79.35 MB vs tracked inuse 73.47 MB
0x33753fcee000:total dirty bytes: 29.30 MB vs tracked dirty 29.30 MB

format-failure-configs-test task_log

Logs:

WiredTiger Error: __wt_abort, 29: aborting WiredTiger library

format-failure-configs-test task_log

Logs:

format run more than 15 minutes past the maximum time

format-failure-configs-test task_log

Logs:

format run dumping cache and transaction state, then aborting the process

format-failure-configs-test task_log

Logs:

0x139ebfc6e000:transaction state dump
0x139ebfc6e000:current ID: 4188
0x139ebfc6e000:last running ID: 4188
0x139ebfc6e000:metadata_pinned ID: 4188
0x139ebfc6e000:oldest ID: 4188
0x139ebfc6e000:durable timestamp: (0, 7205189)
0x139ebfc6e000:oldest timestamp: (0, 7205184)
0x139ebfc6e000:pinned timestamp: (0, 7205184)
0x139ebfc6e000:stable timestamp: (0, 7205184)
0x139ebfc6e000:has_durable_timestamp: yes
0x139ebfc6e000:has_oldest_timestamp: yes
0x139ebfc6e000:has_pinned_timestamp: yes
0x139ebfc6e000:has_stable_timestamp: yes
0x139ebfc6e000:oldest_is_pinned: yes
0x139ebfc6e000:stable_is_pinned: yes
0x139ebfc6e000:checkpoint running: no
0x139ebfc6e000:checkpoint generation: 29
0x139ebfc6e000:checkpoint pinned ID: 0
0x139ebfc6e000:checkpoint txn ID: 0
0x139ebfc6e000:session count: 34
0x139ebfc6e000:Transaction state of active sessions:
0x139ebfc6e000:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
0x139ebfc6e000:cache dump
0x139ebfc6e000:cache full: no
0x139ebfc6e000:cache clean check: no (78.673%)
0x139ebfc6e000:cache dirty check: yes (47.804%)
0x139ebfc6e000:cache updates check: yes (19.412%)
0x139ebfc6e000:file:T00003.wt(checkpoint=WiredTigerCheckpoint.27):
0x139ebfc6e000:internal: 3 pages, 185.49 KB, 3/0 clean/dirty pages, 185.49/0.00 clean / dirty KB, 81.68 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:T00002.wt(checkpoint=WiredTigerCheckpoint.27):
0x139ebfc6e000:internal: 2997 pages, 8654.43 KB, 2997/0 clean/dirty pages, 8654.43/0.00 clean / dirty KB, 3.50 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:T00001.wt(checkpoint=WiredTigerCheckpoint.27):
0x139ebfc6e000:internal: 1 pages, 0.64 KB, 1/0 clean/dirty pages, 0.64/0.00 clean / dirty KB, 0.64 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:WiredTigerHS.wt(checkpoint=WiredTigerCheckpoint.6):
0x139ebfc6e000:internal: 1 pages, 0.70 KB, 1/0 clean/dirty pages, 0.70/0.00 clean / dirty KB, 0.70 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:T00003.wt(checkpoint=mine.2):
0x139ebfc6e000:internal: 1 pages, 81.25 KB, 1/0 clean/dirty pages, 81.25/0.00 clean / dirty KB, 81.25 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:T00002.wt(checkpoint=mine.2):
0x139ebfc6e000:internal: 1 pages, 0.83 KB, 1/0 clean/dirty pages, 0.83/0.00 clean / dirty KB, 0.83 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:WiredTigerHS.wt(checkpoint=mine.2):
0x139ebfc6e000:internal: 1 pages, 0.70 KB, 1/0 clean/dirty pages, 0.70/0.00 clean / dirty KB, 0.70 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:T00001.wt(checkpoint=mine.2):
0x139ebfc6e000:internal: 1 pages, 0.64 KB, 1/0 clean/dirty pages, 0.64/0.00 clean / dirty KB, 0.64 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:T00003.wt(<live>):
0x139ebfc6e000:internal: 38 pages, 1618.61 KB, 12/26 clean/dirty pages, 1009.14/609.47 clean / dirty KB, 163.75 KB max page, 28.22 KB max dirty page
0x139ebfc6e000:leaf: 1869 pages, 6352.90 KB, 0/1869 clean/dirty pages, 0.00 /6352.90 /2970.05 clean/dirty/updates KB, 82.67 KB max page, 82.67 KB max dirty page
0x139ebfc6e000:file:T00002.wt(<live>):
0x139ebfc6e000:internal: 101 pages, 321.54 KB, 27/74 clean/dirty pages, 82.79/238.75 clean / dirty KB, 4.73 KB max page, 4.73 KB max dirty page
0x139ebfc6e000:leaf: 879 pages, 5374.27 KB, 0/879 clean/dirty pages, 0.00 /5374.27 /1877.69 clean/dirty/updates KB, 87.33 KB max page, 87.33 KB max dirty page
0x139ebfc6e000:file:T00001.wt(<live>):
0x139ebfc6e000:internal: 52 pages, 819.92 KB, 11/41 clean/dirty pages, 160.00/659.92 clean / dirty KB, 22.12 KB max page, 22.12 KB max dirty page
0x139ebfc6e000:leaf: 2577 pages, 6383.37 KB, 0/2577 clean/dirty pages, 0.00 /6383.37 /2507.05 clean/dirty/updates KB, 81.90 KB max page, 81.90 KB max dirty page
0x139ebfc6e000:file:WiredTigerHS.wt(<live>):
0x139ebfc6e000:internal: 1 pages, 1.06 KB, 1/0 clean/dirty pages, 1.06/0.00 clean / dirty KB, 1.06 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 0 pages
0x139ebfc6e000:file:WiredTiger.wt(<live>):
0x139ebfc6e000:internal: 1 pages, 0.76 KB, 1/0 clean/dirty pages, 0.76/0.00 clean / dirty KB, 0.76 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:leaf: 1 pages, 14.86 KB, 1/0 clean/dirty pages, 14.86 /0.00 /0.00 clean/dirty/updates KB, 14.86 KB max page, 0.00 KB max dirty page
0x139ebfc6e000:cache dump: total found: 31.44 MB vs tracked inuse 29.14 MB
0x139ebfc6e000:total dirty bytes: 19.16 MB vs tracked dirty 19.18 MB

format-failure-configs-test task_log

Logs:

WiredTiger Error: __wt_abort, 29: aborting WiredTiger library

format-failure-configs-test task_log

Logs:

#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#1  0x00007f210a6ec859 in __GI_abort () at abort.c:79
#2  0x00007f210aad6780 in __wt_abort (session=session@entry=0x0) at /data/mci/3d2bec81bfd9caa4cbaf65ee73b4d3cc/wiredtiger/src/os_common/os_abort.c:31
#3  0x00000000004161a5 in operations (ops_seconds=<optimized out>, ops_seconds@entry=215, run_current=run_current@entry=1, run_total=run_total@entry=3) at /data/mci/3d2bec81bfd9caa4cbaf65ee73b4d3cc/wiredtiger/test/format/ops.c:454
#4  0x0000000000419c1f in main (argc=<optimized out>, argv=<optimized out>) at /data/mci/3d2bec81bfd9caa4cbaf65ee73b4d3cc/wiredtiger/test/format/t.c:384
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#1  0x00007fce0e6dd859 in __GI_abort () at abort.c:79
#2  0x00007fce0eac7780 in __wt_abort (session=session@entry=0x0) at /data/mci/3d2bec81bfd9caa4cbaf65ee73b4d3cc/wiredtiger/src/os_common/os_abort.c:31
#3  0x00000000004161a5 in operations (ops_seconds=<optimized out>, ops_seconds@entry=215, run_current=run_current@entry=1, run_total=run_total@entry=3) at /data/mci/3d2bec81bfd9caa4cbaf65ee73b4d3cc/wiredtiger/test/format/ops.c:454
#4  0x0000000000419c1f in main (argc=<optimized out>, argv=<optimized out>) at /data/mci/3d2bec81bfd9caa4cbaf65ee73b4d3cc/wiredtiger/test/format/t.c:384

Assignee:: [DO NOT USE] Backlog - Storage Engines Team
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 2 Start watching this issue

Created:: Sep 04 2025 05:37:42 AM UTC
Updated:: Sep 12 2025 03:48:46 AM UTC