[Salvage] Panic in __wti_rec_split: page too large during col-var salvage [mongo-v8.0]

XMLWordPrintableJSON

    • Type: Build Failure
    • Resolution: Duplicate
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Column Store, Salvage

      format-stress-test-no-barrier on ubuntu2004-stress-tests

      Host: i-0de13afdaa383b4c4
      Project: wiredtiger-mongo-v8.0
      Commit: 3e4dad4b
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-test-no-barrier task_log

      Logs:

          [1778119201:212468][75598:0x7f8e0c7f8700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119205:287824][75598:0x7f8e037fe700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119206:640879][75598:0x7f8e0aff5700], t, file:T00004.wt, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119206:643224][75598:0x7f8e0effd700], t, file:T00004.wt, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119206:679626][75598:0x7f8e0e7fc700], t, file:T00004.wt, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119206:695183][75598:0x7f8e4d459700], t, file:T00004.wt, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119206:743718][75598:0x7f8e09ff3700], t, file:T00004.wt, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119209:156992][75598:0x7f8e0ffff700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119209:902735][75598:0x7f8e4e45b700], t, file:T00004.wt, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119217:575118][75598:0x7f8e0cff9700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119217:577311][75598:0x7f8e027fc700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119217:577787][75598:0x7f8e0e7fc700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119217:585419][75598:0x7f8e0a7f4700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119217:595115][75598:0x7f8e0d7fa700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119217:657623][75598:0x7f8e0c7f8700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119219:466044][75598:0x7f8e0effd700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119221:699905][75598:0x7f8e177fe700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119221:734806][75598:0x7f8e17fff700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119221:736281][75598:0x7f8e0cff9700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119221:743741][75598:0x7f8e01ffb700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119222:100202][75598:0x7f8e02ffd700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119222:116580][75598:0x7f8e4e45b700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119222:117176][75598:0x7f8e01ffb700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119222:147599][75598:0x7f8e0cff9700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119222:189546][75598:0x7f8e0d7fa700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119222:196986][75598:0x7f8e0effd700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119222:325420][75598:0x7f8e4cc58700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119223:87960][75598:0x7f8e4cc58700], t, file:T00004.wt, WT_CURSOR.search: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119223:330934][75598:0x7f8e17fff700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119223:411763][75598:0x7f8e157fa700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119223:580739][75598:0x7f8e0c7f8700], t, file:T00004.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119224:848707][75598:0x7f8e0effd700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119224:897285][75598:0x7f8e4dc5a700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119225:501949][75598:0x7f8e14ff9700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119225:659993][75598:0x7f8e017fa700], t, file:T00004.wt, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_modify_reconstruct_from_upd_list, 476: Read-uncommitted readers do not support reconstructing a record with modifies.: WT_ROLLBACK: conflict between concurrent operations
          [1778119226:311751][75598:0x7f8e167fc700], 
      

      logs

      format-stress-test-no-barrier task_log

      Logs:

          /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.11.3.0(__wt_panic_func+0x173)[0x7f8e5c9b9377]
      
      

      logs

      format-stress-test-no-barrier task_log

      Logs:

      test/format run configuration highlights
      

      logs

      format-stress-test-no-barrier task_log

      Logs:

      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #1  0x00007f8e5c50c859 in __GI_abort () at abort.c:79
      #2  0x00007f8e5c91f54f in __wt_abort (session=session@entry=0x2461880) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/os_common/os_abort.c:30
      #3  0x00007f8e5c9b9377 in __wt_panic_func (session=session@entry=0x2461880, error=error@entry=-31804, func=func@entry=0x7f8e5ca2eac0 <__PRETTY_FUNCTION__.14> "__wti_rec_split", line=line@entry=1475, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0x7f8e5ca2e5c0 "%s page too large, attempted split during salvage") at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/support/err.c:572
      #4  0x00007f8e5c964e78 in __wti_rec_split (session=session@entry=0x2461880, r=r@entry=0xe2dbf20, next_len=<optimized out>) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/reconcile/rec_write.c:1475
      #5  0x00007f8e5c9654e5 in __wti_rec_split_crossing_bnd (session=session@entry=0x2461880, r=r@entry=0xe2dbf20, next_len=<optimized out>) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/reconcile/rec_write.c:1631
      #6  0x00007f8e5c93cfd9 in __rec_col_var_helper (session=session@entry=0x2461880, r=r@entry=0xe2dbf20, salvage=salvage@entry=0x7ffe29547870, value=<optimized out>, tw=tw@entry=0x7ffe29546ed8, rle=rle@entry=1, deleted=false, dictionary=true, ovfl_usedp=0x0) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/reconcile/rec_col.c:1168
      #7  0x00007f8e5c942d1b in __wti_rec_col_var (session=session@entry=0x2461880, r=r@entry=0xe2dbf20, pageref=pageref@entry=0x13f06b0, salvage=salvage@entry=0x7ffe29547870) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/reconcile/rec_col.c:1477
      #8  0x00007f8e5c9634c8 in __reconcile (session=session@entry=0x2461880, ref=ref@entry=0x13f06b0, salvage=salvage@entry=0x7ffe29547870, flags=flags@entry=1024, page_lockedp=page_lockedp@entry=0x7ffe2954780f) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/reconcile/rec_write.c:261
      #9  0x00007f8e5c962a6c in __wt_reconcile (session=session@entry=0x2461880, ref=ref@entry=0x13f06b0, salvage=salvage@entry=0x7ffe29547870, flags=flags@entry=1024) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/reconcile/rec_write.c:96
      #10 0x00007f8e5c7d5afe in __slvg_col_build_leaf (session=session@entry=0x2461880, trk=trk@entry=0x18d1670, ref=ref@entry=0x13f06b0) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/btree/bt_slvg.c:1350
      #11 0x00007f8e5c7d5cf4 in __slvg_col_build_internal (session=session@entry=0x2461880, leaf_cnt=leaf_cnt@entry=1662, ss=ss@entry=0x7ffe29547940) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/btree/bt_slvg.c:1249
      #12 0x00007f8e5c7d8aea in __wt_salvage (session=0x2461880, cfg=<optimized out>) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/btree/bt_slvg.c:368
      #13 0x00007f8e5c979843 in __wti_execute_handle_operation (session=session@entry=0x2461880, uri=uri@entry=0x130f1e0 "file:T00001.wt", file_func=file_func@entry=0x7f8e5c7d8870 <__wt_salvage>, cfg=cfg@entry=0x7ffe295483d0, open_flags=open_flags@entry=2097168) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/schema/schema_worker.c:32
      #14 0x00007f8e5c979a60 in __wt_schema_worker (session=0x2461880, uri=0x130f1e0 "file:T00001.wt", file_func=0x7f8e5c7d8870 <__wt_salvage>, name_func=0x0, cfg=0x7ffe295483d0, open_flags=2097168) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/schema/schema_worker.c:108
      #15 0x00007f8e5c979d1c in __wt_schema_worker (session=session@entry=0x2461880, uri=uri@entry=0x69e194 "table:T00001", file_func=0x7f8e5c7d8870 <__wt_salvage>, name_func=name_func@entry=0x0, cfg=cfg@entry=0x7ffe295483d0, open_flags=open_flags@entry=2097168) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/schema/schema_worker.c:144
      #16 0x00007f8e5c97a96d in __session_salvage_worker (session=session@entry=0x2461880, uri=uri@entry=0x69e194 "table:T00001", cfg=cfg@entry=0x7ffe295483d0) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/session/session_api.c:1528
      #17 0x00007f8e5c981eff in __session_salvage (wt_session=0x2461880, uri=0x69e194 "table:T00001", config=<optimized out>) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/src/session/session_api.c:1560
      #18 0x000000000040c258 in wts_salvage (table=0x69e190, arg=<optimized out>) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/test/format/format_salvage.c:154
      #19 0x0000000000419584 in tables_apply (func=0x40c04a <wts_salvage>, arg=arg@entry=0x0) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/test/format/format_inline.h:186
      #20 0x000000000041a062 in main (argc=<optimized out>, argv=<optimized out>) at /data/mci/153c0e7e39d6eeaf5bf61829c5606044/wiredtiger/test/format/t.c:414
      

      logs

      Repro Artifacts:

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: