-
Type:
Bug
-
Resolution: Unresolved
-
Priority:
Major - P3
-
None
-
Affects Version/s: None
-
Component/s: Test Format
-
None
-
Storage Engines
-
2
-
8
-
StorEng - 2024-11-12, StorEng - 2024-11-26, StorEng - 2024-12-10, StorEng - 2024-12-24
As part of migrating the zSeries distros, we have hit a mirror mismatch error on row-store. I have attached a patch diff that consistently reproduces the error on evergreen after every run. Each run takes roughly ~2 hours.
[2024/10/29 19:52:16.589] format.sh: job in /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7 failed
[2024/10/29 19:52:16.591] t: process 1185996 running
[2024/10/29 19:52:16.591] mirror: 569780/569780 mismatch: table:T00001: {0000569780.00/opqrstuv}/{0000569780/bMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOP}, table:T00002: {0000569780.00/opqrstuvwxyzabcde}/{0000569780/bMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOP}
[2024/10/29 19:52:16.591] last successful match was 569779
[2024/10/29 19:52:16.591] mirror error: base cursor (table 1): dumping to /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7/FAIL.pagedump.1
[2024/10/29 19:52:16.591] mirror error: table cursor (table 2): dumping to /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7/FAIL.pagedump.2
[2024/10/29 19:52:16.591] mirror error: base key number 569780 in table 3: dumping to /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7/FAIL.pagedump.3
[2024/10/29 19:52:16.591] mirror error: base key number 569780 in table 4: dumping to /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7/FAIL.pagedump.4
[2024/10/29 19:52:16.591] mirror error: base key number 569780 in table 5: dumping to /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7/FAIL.pagedump.5
[2024/10/29 19:52:16.591] mirror error: base key number 569780 in table 6: dumping to /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7/FAIL.pagedump.6
[2024/10/29 19:52:16.591] mirror error: base key number 569780 in table 7: dumping to /data/mci/42ef3332f3a97e0c971b627182263647/wiredtiger/cmake_build/test/format/RUNDIR.7/FAIL.pagedump.7
[2024/10/29 19:52:16.591] mirror: 569800/569800 mismatch: table:T00001: {0000569800.00/opqrstuv}/{0000569800/iMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQR}, table:T00002: {0000569800.00/opqrstuvwxyzabcdefghijklmnopq}/{0000569800/iMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQR}
[2024/10/29 19:52:16.591] last successful match was 569799
[2024/10/29 19:52:16.591] mirror: 569820/569820 mismatch: table:T00001: {0000569820.00/opqrstuv}/{0000569820/iMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLMNOPQRSTUVWXYZABCDEFGHIJKLM}, table:T00002: {0000569820.00/opqrstuvwxyzabcde}/{0000569820/iMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLMNOPQRSTUVWXYZMNCDEFGHIJKLM}
[2024/10/29 19:52:16.591] last successful match was 569819
[2024/10/29 19:52:16.591] t: FAILED: table_verify_mirror/416: failures == 0
[2024/10/29 19:52:16.591] t: run FAILED
[2024/10/29 19:52:16.593] t: process aborting
[2024/10/29 19:52:16.593] WiredTiger Error: __wt_abort, 28: aborting WiredTiger library
We will need to investigate what is causing this mirror mismatch issue.
- related to
-
WT-13527 Migrating to new IBM-hosted zSeries hosts
-
- Closed
-