ASAN Failure: AddressSanitizer: container-overflow

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Engines, Storage Engines - Server Integration
    • SE Persistence - 2025-11-21
    • None

      In SLS-2875, we are adding an ASAN suite for disagg that is currently failing with this error:

      ERROR: AddressSanitizer: container-overflow on address 0x5020001076f8 at pc 0x7fcc6e5ae908 bp 0x7fcbe97a1830 sp 0x7fcbe97a1828
      

      Stack trace:

      [js_test:hello_with_standby] d20297|     #0 0x7fcc6e5ae907 in mongo::disagg::(anonymous namespace)::paliHandleGet(__wt_page_log_handle*, __wt_session*, unsigned long, unsigned long, __wt_page_log_get_args*, __wt_item*, unsigned int*) src/mongo/db/modules/atlas/src/disagg_storage/pali_callbacks.cpp:277:83
      [js_test:hello_with_standby] d20297|     #1 0x7fcc8137f290 in __wti_block_disagg_read_multiple src/third_party/wiredtiger/src/block_disagg/block_disagg_read.c:139:9
      [js_test:hello_with_standby] d20297|     #2 0x7fcc81366c8e in __wt_blkcache_read_multi src/third_party/wiredtiger/src/block_cache/block_io.c:472:9
      [js_test:hello_with_standby] d20297|     #3 0x7fcc8148164d in __wt_page_in_func src/third_party/wiredtiger/src/btree/bt_read.c:240:5
      [js_test:hello_with_standby] d20297|     #4 0x7fcc8152b788 in __wt_page_swap_func src/third_party/wiredtiger/src/include/btree_inline.h:2374:11
      [js_test:hello_with_standby] d20297|     #5 0x7fcc81526036 in __tree_walk_internal src/third_party/wiredtiger/src/btree/bt_walk.c:337:19
      [js_test:hello_with_standby] d20297|     #6 0x7fcc8139ca35 in __wt_btcur_next src/third_party/wiredtiger/src/btree/bt_curnext.c:953:13
      [js_test:hello_with_standby] d20297|     #7 0x7fcc8167fcfa in __curfile_next src/third_party/wiredtiger/src/cursor/cur_file.c:185:5
      [js_test:hello_with_standby] d20297|     #8 0x7fcc816fa8bf in __clayered_iterate_constituent src/third_party/wiredtiger/src/cursor/cur_layered.c:766:9
      [js_test:hello_with_standby] d20297|     #9 0x7fcc816d571f in __clayered_next src/third_party/wiredtiger/src/cursor/cur_layered.c:809:9
      [js_test:hello_with_standby] d20297|     #10 0x7fcc8218cf44 in mongo::WiredTigerRecordStoreCursorBase::nextIdCommon() src/mongo/db/storage/wiredtiger/wiredtiger_prepare_conflict.h:74:15
      [js_test:hello_with_standby] d20297|     #11 0x7fcc8218c4c6 in mongo::WiredTigerRecordStoreCursorBase::next() src/mongo/db/storage/wiredtiger/wiredtiger_record_store.cpp:1673:15
      [js_test:hello_with_standby] d20297|     #12 0x7fcc7994bcf7 in mongo::(anonymous namespace)::listDurableCatalog(mongo::OperationContext*, mongo::StringData, std::deque<mongo::BSONObj, std::allocator<mongo::BSONObj>>*, std::vector<mongo::NamespaceStringOrUUID, std::allocator<mongo::NamespaceStringOrUUID>>*) src/mongo/db/pipeline/process_interface/common_mongod_process_interface.cpp:235:34
      [js_test:hello_with_standby] d20297|     #13 0x7fcc79949631 in mongo::CommonMongodProcessInterface::listCatalog(mongo::OperationContext*) const src/mongo/db/pipeline/process_interface/common_mongod_process_interface.cpp:503:13
      [js_test:hello_with_standby] d20297|     #14 0x7fcc9031129f in mongo::exec::agg::ListCatalogStage::doGetNext() src/mongo/db/exec/agg/list_catalog_stage.cpp:62:54
      [js_test:hello_with_standby] d20297|     #15 0x7fcc901f441a in mongo::exec::agg::Stage::getNext() src/mongo/db/exec/agg/stage.h:185:20
      [js_test:hello_with_standby] d20297|     #16 0x7fcc9033f46f in mongo::exec::agg::MatchStage::doGetNext() src/mongo/db/exec/agg/match_stage.cpp:62:31
      [js_test:hello_with_standby] d20297|     #17 0x7fcc901f441a in mongo::exec::agg::Stage::getNext() src/mongo/db/exec/agg/stage.h:185:20
      [js_test:hello_with_standby] d20297|     #18 0x7fcc9027b5a2 in mongo::exec::agg::Pipeline::getNext() src/mongo/db/exec/agg/exec_pipeline.cpp:61:39
      [js_test:hello_with_standby] d20297|     #19 0x7fcc86b5a967 in mongo::PlanExecutorPipeline::_tryGetNext() src/mongo/db/pipeline/plan_executor_pipeline.cpp:148:27
      [js_test:hello_with_standby] d20297|     #20 0x7fcc86b59dff in mongo::PlanExecutorPipeline::_getNext() src/mongo/db/pipeline/plan_executor_pipeline.cpp:128:20
      
      [js_test:hello_with_standby] d20297| 0x5020001076f8 is located 8 bytes inside of 16-byte region [0x5020001076f0,0x502000107700)
      [js_test:hello_with_standby] d20297| allocated by thread T140 here:
      [js_test:hello_with_standby] d20297|     #0 0x561913cd06fd in operator new(unsigned long) /data/mci/6fc617b00a4218b9970b209d4517c50b/toolchain-builder/tmp/build-llvm-v5.sh-02L/llvm-project-llvmorg/compiler-rt/lib/asan/asan_new_delete.cpp:86:3
      [js_test:hello_with_standby] d20297|     #1 0x7fcc964d6284 in google::protobuf::RepeatedField<unsigned long>::GrowNoAnnotate(int, int) src/third_party/protobuf/dist/src/google/protobuf/port.h:86:11
      [js_test:hello_with_standby] d20297|     #2 0x7fcc964d5e87 in google::protobuf::RepeatedField<unsigned long>::Grow(int, int) src/third_party/protobuf/dist/src/google/protobuf/repeated_field.h:999:3
      [js_test:hello_with_standby] d20297|     #3 0x7fcc896b32d3 in google::protobuf::RepeatedField<unsigned long>::RepeatedField(google::protobuf::internal::InternalVisibility, google::protobuf::Arena*, google::protobuf::RepeatedField<unsigned long> const&) bazel-out/k8-dbg/bin/external/protobuf~/src/google/protobuf/_virtual_includes/protobuf_lite/google/protobuf/repeated_field.h:484:5
      [js_test:hello_with_standby] d20297|     #4 0x7fcc6e3e8ac3 in pageservice::v1::Page::Impl_::Impl_(google::protobuf::internal::InternalVisibility, google::protobuf::Arena*, pageservice::v1::Page::Impl_ const&) bazel-out/k8-dbg/bin/src/mongo/db/modules/atlas/src/disagg_storage/sls-proto/_virtual_imports/page_service_proto/pageservice/v1/page_service.pb.cc:1777:9
      [js_test:hello_with_standby] d20297|     #5 0x7fcc6e3d9d40 in pageservice::v1::Page::Page(google::protobuf::Arena*, pageservice::v1::Page const&) bazel-out/k8-dbg/bin/src/mongo/db/modules/atlas/src/disagg_storage/sls-proto/_virtual_imports/page_service_proto/pageservice/v1/page_service.pb.cc:1792:17
      [js_test:hello_with_standby] d20297|     #6 0x7fcc6e3db2f6 in pageservice::v1::GetPageAtLSNResponse::GetPageAtLSNResponse(google::protobuf::Arena*, pageservice::v1::GetPageAtLSNResponse const&) bazel-out/k8-dbg/bin/external/protobuf~/src/google/protobuf/_virtual_includes/protobuf_lite/google/protobuf/arena.h:518:18
      [js_test:hello_with_standby] d20297|     #7 0x7fcc6e54ff8d in mongo::disagg::PageServerReader::_waitForFuture(mongo::SharedSemiFuture<pageservice::v1::GetPageAtLSNResponse>&, std::shared_ptr<mongo::disagg::PageServerReader::PageServer>, unsigned long, unsigned long, unsigned long, mongo::Timer) bazel-out/k8-dbg/bin/src/mongo/db/modules/atlas/src/disagg_storage/sls-proto/_virtual_includes/page_service_proto/pageservice/v1/page_service.pb.h:8181:9
      [js_test:hello_with_standby] d20297|     #8 0x7fcc6e5517fa in mongo::disagg::PageServerReader::_attemptPageRequest(unsigned long, unsigned long, unsigned long, std::shared_ptr<mongo::disagg::PageServerReader::PageServer>) src/mongo/db/modules/atlas/src/disagg_storage/page_server_reader.cpp:463:12
      [js_test:hello_with_standby] d20297|     #9 0x7fcc6e55237f in mongo::disagg::PageServerReader::sendPageRequestSync(unsigned long, unsigned long, unsigned long) src/mongo/db/modules/atlas/src/disagg_storage/page_server_reader.cpp:492:25
      [js_test:hello_with_standby] d20297|     #10 0x7fcc6e5ac7ec in mongo::disagg::(anonymous namespace)::paliHandleGet(__wt_page_log_handle*, __wt_session*, unsigned long, unsigned long, __wt_page_log_get_args*, __wt_item*, unsigned int*) src/mongo/db/modules/atlas/src/disagg_storage/pali_callbacks.cpp:210:45
      [js_test:hello_with_standby] d20297|     #11 0x7fcc8137f290 in __wti_block_disagg_read_multiple src/third_party/wiredtiger/src/block_disagg/block_disagg_read.c:139:9
      ...
      

      Link to logs
      Link to evg task

            Assignee:
            Unassigned
            Reporter:
            Xuerui Fa
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: