With standby, primary seems to crash

    • Type: Task
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Engines - Transactions
    • None
    • None

      Seems to have started with this [commit|https://spruce.mongodb.com/version/sys_perf_c122b0ea6e6971d59f57e6b0c91f4caaa36fb765/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC.]   

       

       

      Here is an example performance run.  (https://spruce.mongodb.com/task/sys_perf_disagg_perf_11_node.arm.aws_ycsb.out_of_cache.100read.2024_05_c122b0ea6e6971d59f57e6b0c91f4caaa36fb765_26_02_03_04_11_35/tests?execution=0&sorts=STATUS%3AASC)

      The error usually contains the following error in mongod.log.

       

      {"t":

      {"$date":"2026-02-04T20:22:31.809+00:00"}

      ,"s":"F",  "c":"CONTROL",  "id":6384300, "ctx":"TimestampMonitor","msg":"Writing fatal message","attr":{"message":"Invalid access at address: 0\n"}}

      {"t":

      {"$date":"2026-02-04T20:22:31.809+00:00"}

      ,"s":"F",  "c":"CONTROL",  "id":6384300, "ctx":"TimestampMonitor","msg":"Writing fatal message","attr":{"message":"Dumping siginfo (si_code=1): 0b 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00\n"}}

      {"t":

      {"$date":"2026-02-04T20:22:31.809+00:00"}

      ,"s":"F",  "c":"CONTROL",  "id":6384300, "ctx":"TimestampMonitor","msg":"Writing fatal message","attr":{"message":"Got signal: 11 (Segmentation fault).\n"}}

      {"t":

      {"$date":"2026-02-04T20:22:31.813+00:00"}

      ,"s":"I",  "c":"NETWORK",  "id":6788700, "ctx":"conn28","msg":"Received first command on ingress connection since session start or auth handshake","attr":{"elapsedMillis":15}}

      {"t":

      {"$date":"2026-02-04T20:22:31.814+00:00"}

      ,"s":"I",  "c":"ACCESS",   "id":5286306, "ctx":"conn29","msg":"Successfully authenticated","attr":{"client":"10.2.4.28:56558","isSpeculative":true,"isClusterMember":false,"mechanism":"SCRAM-SHA-256","user":"username","db":"admin","result":0,"metrics":{"conversation_duration":{"micros":10750,"summary":{"0":

      {"step":1,"step_total":2,"duration_micros":34}

      ,"1":{"step":2,"step_total":2,"duration_micros":14}}}},"doc":{"driver":

      {"name":"mongo-java-driver|sync","version":"4.7.0"}

      ,"os":{"type":"Linux","name":"Linux","architecture":"aarch64","version":"6.1.141-155.222.2.mdb.amzn2023.aarch64"},"platform":"Java/Oracle Corporation/19.0.1+10-21"},"extraInfo":{}}}

      {"t":

      {"$date":"2026-02-04T20:22:31.818+00:00"}

      ,"s":"I",  "c":"NETWORK",  "id":6788700, "ctx":"conn29","msg":"Received first command on ingress connection since session start or auth handshake","attr":{"elapsedMillis":3}}

      {"t":

      {"$date":"2026-02-04T20:22:31.825+00:00"}

      ,"s":"I",  "c":"CONTROL",  "id":31380,   "ctx":"TimestampMonitor","msg":"BACKTRACE","attr":{"bt":{"backtrace":[

      {"a":"AAAAB13ADA0C","b":"AAAAAAAA0000","o":"690DA0C","s":"_ZN5mongo25printStructuredStackTraceEv","C":"mongo::printStructuredStackTrace()","s+":"40"}

      ,{"a":"AAAAB139E284","b":"AAAAAAAA0000","o":"68FE284","s":"ZN5mongo12_GLOBAL_N_115printErrorBlockEv","C":"mongo::(anonymous namespace)::printErrorBlock()","s+":"2C"},{"a":"AAAAB139E744","b":"AAAAAAAA0000","o":"68FE744","s":"abruptQuitWithAddrSignal","s+":"12C"},{"a":"FFFFF7FFB830","b":"FFFFF7FFB000","o":"830","s":"__kernel_rt_sigreturn","s+":"0"}],"processInfo":{"mongodbVersion":"8.3.0-alpha3-363-ga0fa927-patch-69828d5df1eade00078b0a30","gitVersion":"a0fa9275f9f09d247adbe3fb14a64188e1138544","compiledModules":["enterprise"],"uname":

      {"sysname":"Linux","release":"6.1.141-155.222.2.mdb.amzn2023.aarch64","version":"#1 SMP Mon Jun 23 20:16:09 UTC 2025","machine":"aarch64"}

      ,"somap":[

      {"b":"AAAAAAAA0000","path":"/media/ebs/workdir/mongodb/bin/mongod","elfType":3,"buildId":"C04FFDF0C04FFDF023C0CA53"}

      ,

      {"b":"FFFFF7FFB000","path":"linux-vdso.so.1","elfType":3,"buildId":"49FCD88F39E948CBDCD355DF8AA87C30A1D7EC39"}

      ]}}},"tags":[]}

      {"t":

      {"$date":"2026-02-04T20:22:31.825+00:00"}

      ,"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"TimestampMonitor","msg":"Frame","attr":{"frame":

      {"a":"AAAAB13ADA0C","b":"AAAAAAAA0000","o":"690DA0C","s":"_ZN5mongo25printStructuredStackTraceEv","C":"mongo::printStructuredStackTrace()","s+":"40"}

      }}

      {"t":

      {"$date":"2026-02-04T20:22:31.825+00:00"}

      ,"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"TimestampMonitor","msg":"Frame","attr":{"frame":

      {"a":"AAAAB139E284","b":"AAAAAAAA0000","o":"68FE284","s":"_ZN5mongo12_GLOBAL__N_115printErrorBlockEv","C":"mongo::(anonymous namespace)::printErrorBlock()","s+":"2C"}

      }}

      {"t":

      {"$date":"2026-02-04T20:22:31.825+00:00"}

      ,"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"TimestampMonitor","msg":"Frame","attr":{"frame":

      {"a":"AAAAB139E744","b":"AAAAAAAA0000","o":"68FE744","s":"abruptQuitWithAddrSignal","s+":"12C"}

      }}

      {"t":

      {"$date":"2026-02-04T20:22:31.825+00:00"}

      ,"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"TimestampMonitor","msg":"Frame","attr":{"frame":

      {"a":"FFFFF7FFB830","b":"FFFFF7FFB000","o":"830","s":"__kernel_rt_sigreturn","s+":"0"}

      }}

      {"t":

      {"$date":"2026-02-04T20:22:31.825+00:00"}

      ,"s":"F",  "c":"CONTROL",  "id":6384300, "ctx":"TimestampMonitor","msg":"Writing fatal message","attr":{"message":"\n"}}

      {"t":

      {"$date":"2026-02-04T20:22:31.825+00:00"}

      ,"s":"F",  "c":"CONTROL",  "id":6384300, "ctx":"TimestampMonitor","msg":"Writing fatal message","attr":{"message":"\n"}}

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Jagadish Nallapaneni
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: