Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-9590

S3 extension python tests core with TCMALLOC enabled

    • 1
    • Storage Engines - 2022-08-22, Storage Engines - 2022-09-05

      When the S3 extension python tests are run with TCMALLOC a core is produced with the following stack trace:

       

      [2022/07/15 03:32:02.619] ------------------------------------------------------------------------------------ [2022/07/15 03:32:02.620] | WT_TEST/test_tiered06.test_tiered06.test_ss_file_systems_s3/dump_python3.51475.core | [2022/07/15 03:32:02.620] ------------------------------------------------------------------------------------ [2022/07/15 03:32:02.898] [New LWP 51475] [2022/07/15 03:32:02.898] [Thread debugging using libthread_db enabled] [2022/07/15 03:32:02.899] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [2022/07/15 03:32:03.339] Core was generated by `python3 ../test/suite/run.py -j 4 tiered06'. [2022/07/15 03:32:03.339] Program terminated with signal SIGSEGV, Segmentation fault. [2022/07/15 03:32:03.339] #0 0x00007f2245be8722 in _GI_libc_free (mem=<optimized out>) at malloc.c:3124 [2022/07/15 03:32:03.504] Thread 1 (Thread 0x7f2245982740 (LWP 51475)): [2022/07/15 03:32:03.504] #0 0x00007f2245be8722 in __GI__libc_free (mem=<optimized out>) at malloc.c:3124 [2022/07/15 03:32:03.504] #1 0x00007f22430e43c3 in Aws::Config::ConfigAndCredentialsCacheManager::ConfigAndCredentialsCacheManager() () from /data/mci/b420e477591a59a7030c6dd51fe01dbd/wiredtiger/cmake_build/aws-sdk-cpp/install/lib/libaws-cpp-sdk-core.so [2022/07/15 03:32:03.504] #2 0x00007f22430ec12a in Aws::Config::InitConfigAndCredentialsCacheManager() () from /data/mci/b420e477591a59a7030c6dd51fe01dbd/wiredtiger/cmake_build/aws-sdk-cpp/install/lib/libaws-cpp-sdk-core.so [2022/07/15 03:32:03.504] #3 0x00007f224311d733 in Aws::InitAPI(Aws::SDKOptions const&) () from /data/mci/b420e477591a59a7030c6dd51fe01dbd/wiredtiger/cmake_build/aws-sdk-cpp/install/lib/libaws-cpp-sdk-core.so [2022/07/15 03:32:03.504] #4 0x00007f2244e8bffd in AwsManager::InitInternal (this=0x7f2244ea1500 <AwsManager::aws_instance>) at ../ext/storage_sources/s3_store/s3_aws_manager.h:76 [2022/07/15 03:32:03.504] #5 AwsManager::Init () at ../ext/storage_sources/s3_store/s3_aws_manager.h:53 [2022/07/15 03:32:03.504] #6 wiredtiger_extension_init (connection=0x1e10000, config=<optimized out>) at ../ext/storage_sources/s3_store/s3_storage_source.cpp:886 [2022/07/15 03:32:03.504] #7 0x00007f2244c07cab in __conn_load_extension_int (session=session@entry=0x1e58000, path=<optimized out>, cfg=cfg@entry=0x7fff6cfc58a0, early_load=early_load@entry=false) at ../src/conn/conn_api.c:977 [2022/07/15 03:32:03.504] #8 0x00007f2244c0812a in __conn_load_extensions (session=session@entry=0x1e58000, cfg=cfg@entry=0x7fff6cfc5a80, early_load=early_load@entry=false) at ../src/conn/conn_api.c:1040 [2022/07/15 03:32:03.504] #9 0x00007f2244c14949 in wiredtiger_open (home=<optimized out>, home@entry=0x21d1210 ".", event_handler=event_handler@entry=0x7f2244f55b20 <pyApiEventHandler>, config=config@entry=0x1f0a1c0 "create,error_prefix=\"test_tiered06.test_tiered06.test_ss_file_systems(s3)\",,extensions=[\"/data/mci/b420e477591a59a7030c6dd51fe01dbd/wiredtiger/cmake_build/ext/storage_sources/s3_store/libwiredtiger_s3"..., connectionp=connectionp@entry=0x7fff6cfc5c38) at ../src/conn/conn_api.c:2943 [2022/07/15 03:32:03.504] #10 0x00007f2244f3273d in _wrap_wiredtiger_open (self=<optimized out>, args=<optimized out>) at lang/python/wiredtigerPYTHON_wrap.c:9041 [2022/07/15 03:32:03.504] #11 0x00000000005f3a2a in PyCFunction_Call () [2022/07/15 03:32:03.504] #12 0x00000000005f3e1e in _PyObject_MakeTpCall () [2022/07/15 03:32:03.504] #13 0x0000000000570674 in _PyEval_EvalFrameDefault () [2022/07/15 03:32:03.504] #14 0x000000000056939a in _PyEval_EvalCodeWithName () [2022/07/15 03:32:03.504] #15 0x00000000005f6a13 in _PyFunction_Vectorcall () [2022/07/15 03:32:03.504] #16 0x000000000056b1da in _PyEval_EvalFrameDefault () [2022/07/15 03:32:03.504] #17 0x00000000005f6836 in _PyFunction_Vectorcall () [2022/07/15 03:32:03.504] #18 0x000000000056b1da in _PyEval_EvalFrameDefault () [2022/07/15 03:32:03.504] #19 0x00000000005f6836 in _PyFunction_Vectorcall () [2022/07/15 03:32:03.504] #20 0x000000000056b1da in _PyEval_EvalFrameDefault () [2022/07/15 03:32:03.504] #21 0x00000000005f6836 in _PyFunction_Vectorcall () [2022/07/15 03:32:03.504] #22 0x000000000056b1da in _PyEval_EvalFrameDefault () [2022/07/15 03:32:03.504] #23 0x000000000056939a in _PyEval_EvalCodeWithName () [2022/07/15 03:32:03.504] #24 0x00000000005f6a13 in _PyFunction_Vectorcall () [2022/07/15 03:32:03.504] #25 0x000000000050aa2c in ?? () [2022/07/15 03:32:03.504] #26 0x00000000005f3547 in PyObject_Call () [2022/07/15 03:32:03.504] #27 0x000000000056c8cd in _PyEval_EvalFrameDefault () [2022/07/15 03:32:03.504] #28 0x000000000056939a in _PyEval_EvalCodeWithName () [2022/07/15 03:32:03.504] #29 0x00000000005f6a13 in _PyFunction_Vectorcall () [2022/07/15 03:32:04.224] 3124 malloc.c: No such file or directory. [2022/07/15 03:32:04.224] 3124 malloc.c: No such file or directory.

       

      This was found in a patch build with changes to cmake/evergreen. Here is the patch:

      https://spruce.mongodb.com/task/wiredtiger_ubuntu2004_tiered_test_small_patch_f0f7617d61d91d5ebb175c5b59daf009d71b7d91_62d0ddd19ccd4e7060557f96_22_07_15_03_24_49/logs?execution=0

       

            Assignee:
            mick.graham@mongodb.com Mick Graham
            Reporter:
            mick.graham@mongodb.com Mick Graham
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: