Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-47179

Requesting 'oplog' serverStatus section crashes mongod when there is no oplog

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Critical - P2
    • Resolution: Fixed
    • 4.3.5
    • 4.4.0-rc0, 4.7.0
    • Replication
    • None
    • Fully Compatible
    • ALL
    • v4.4
    • Hide

      Our end to end suite is reproducing this regularly. They use a single windows-64-vs2017-compile host.

      • Create a 4.3.5 Replica Set using Cloud Manager
      • Wait for the item to be monitored by the MongoDB Agent.

      Our tests are failing since we do not receive the expected monitoring data within our usual timeframe.

      Show
      Our end to end suite is reproducing this regularly. They use a single windows-64-vs2017-compile host. Create a 4.3.5 Replica Set using Cloud Manager Wait for the item to be monitored by the MongoDB Agent. Our tests are failing since we do not receive the expected monitoring data within our usual timeframe.
    • Repl 2020-04-20

    Description

      We're seeing backtraces during our windows testing of 4.3.5.

      The tests use a single windows-64-vs2017 host to create standalones, replica sets, and sharded clusters with the latest version of MongoDB 4.3. The crash seems to occur periodically while those items are being monitored by the Cloud Manager MongoDB Agent.

      Snippet of logs:

      {"t":{"$date":"2020-03-30T14:35:15.623+00:00"},"s":"I", "c":"CONTROL", "id":31380,"ctx":"conn103","msg":"BACKTRACE: {bt}","attr":{"bt":{"backtrace":[{"a":"7FF6F768FDBD","module":"mongod.exe","file":".../src/mongo/db/repl/replication_info.cpp","line":267,"s":"mongo::repl::`anonymous namespace'::OplogInfoServerStatus::generateSection","s+":"1FD"},{"a":"7FF6F7566F31","module":"mongod.exe","file":".../src/mongo/db/commands/server_status.h","line":100,"s":"mongo::ServerStatusSection::appendSection","s+":"21"},{"a":"7FF6F7CEA6A9","module":"mongod.exe","file":".../src/mongo/db/commands/server_status.cpp","line":127,"s":"mongo::CmdServerStatus::run","s+":"6A9"},{"a":"7FF6F762C817","module":"mongod.exe","file":".../src/mongo/db/commands.h","line":803,"s":"mongo::BasicCommand::runWithReplyBuilder","s+":"57"},{"a":"7FF6F7E7E8F1","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":771,"s":"mongo::BasicCommandWithReplyBuilderInterface::Invocation::run","s+":"111"},{"a":"7FF6F7E7ED03","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":187,"s":"mongo::CommandHelpers::runCommandInvocation","s+":"83"},{"a":"7FF6F762B335","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":803,"s":"mongo::`anonymous namespace'::runCommandImpl","s+":"145"},{"a":"7FF6F7626387","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1126,"s":"mongo::`anonymous namespace'::execCommandDatabase","s+":"19B7"},{"a":"7FF6F7621240","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1299,"s":"<lambda_058cab8c39a04572e0ffda27b896392f>::operator()","s+":"580"},{"a":"7FF6F76293E8","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1321,"s":"mongo::`anonymous namespace'::receivedCommands","s+":"A8"},{"a":"7FF6F7627F2C","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_common.cpp","line":1609,"s":"mongo::ServiceEntryPointCommon::handleRequest","s+":"91C"},{"a":"7FF6F7616A02","module":"mongod.exe","file":".../src/mongo/db/service_entry_point_mongod.cpp","line":288,"s":"mongo::ServiceEntryPointMongod::handleRequest","s+":"32"},{"a":"7FF6F761913E","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":470,"s":"mongo::ServiceStateMachine::_processMessage","s+":"1BE"},{"a":"7FF6F761964E","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":549,"s":"mongo::ServiceStateMachine::_runNextInGuard","s+":"9E"},{"a":"7FF6F7618874","module":"mongod.exe","file":"C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Tools/MSVC/14.25.28610/include/functional","line":926,"s":"std::_Func_impl_no_alloc<<lambda_b23af5efc3b61ab25bff0c3bcd13382b>,void>::_Do_call","s+":"54"},{"a":"7FF6F85BF3C6","module":"mongod.exe","file":".../src/mongo/transport/service_executor_synchronous.cpp","line":108,"s":"mongo::transport::ServiceExecutorSynchronous::schedule","s+":"106"},{"a":"7FF6F761982A","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":595,"s":"mongo::ServiceStateMachine::_scheduleNextWithGuard","s+":"CA"},{"a":"7FF6F7619EC9","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":373,"s":"mongo::ServiceStateMachine::_sourceCallback","s+":"A9"},{"a":"7FF6F76173CC","module":"mongod.exe","file":".../src/mongo/util/future_impl.h","line":237,"s":"mongo::future_details::call<<lambda_666573ec54ca1c645fa7bbc72952f9b3> &,mongo::StatusWith<mongo::Message> >","s+":"BC"},{"a":"7FF6F761853D","module":"mongod.exe","file":".../src/mongo/util/future_impl.h","line":851,"s":"<lambda_ffb7fc866e28718edba5fd77072ab046>::operator()","s+":"4D"},{"a":"7FF6F7617934","module":"mongod.exe","file":".../src/mongo/util/future_impl.h","line":1163,"s":"mongo::future_details::FutureImpl<mongo::Message>::generalImpl<<lambda_ffb7fc866e28718edba5fd77072ab046>,<lambda_7f7540703838fafe7784f645352ec5c4>,<lambda_8f9bb8790eb696dc1ef642ec835e8067> >","s+":"34"},{"a":"7FF6F761A4BA","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":324,"s":"mongo::ServiceStateMachine::_sourceMessage","s+":"12A"},{"a":"7FF6F761967A","module":"mongod.exe","file":".../src/mongo/transport/service_state_machine.cpp","line":545,"s":"mongo::ServiceStateMachine::_runNextInGuard","s+":"CA"},{"a":"7FF6F7618874","module":"mongod.exe","file":"C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Tools/MSVC/14.25.28610/include/functional","line":926,"s":"std::_Func_impl_no_alloc<<lambda_b23af5efc3b61ab25bff0c3bcd13382b>,void>::_Do_call","s+":"54"},{"a":"7FF6F85BF002","module":"mongod.exe","file":".../src/mongo/transport/service_executor_synchronous.cpp","line":125,"s":"<lambda_472996f9e6b00ec91d31b43a6cde81f7>::operator()","s+":"152"},{"a":"7FF6F8736FC6","module":"mongod.exe","file":"C:/Program Files (x86)/Microsoft Visual Studio/2019/Professional/VC/Tools/MSVC/14.25.28610/include/thread","line":43,"s":"std::thread::_Invoke<std::tuple<<lambda_30130984df28a890937aeb9eb32385d9> >,0>","s+":"36"},{"a":"7FFF60E9F4A0","module":"ucrtbase.dll","s":"o__realloc_base","s+":"60"},{"a":"7FFF617284D4","module":"KERNEL32.DLL","s":"BaseThreadInitThunk","s+":"14"}]}}}
      {"t":{"$date":"2020-03-30T14:35:15.623+00:00"},"s":"I", "c":"CONTROL", "id":31445,"ctx":"conn103","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FF6F768FDBD","module":"mongod.exe","file":".../src/mongo/db/repl/replication_info.cpp","line":267,"s":"mongo::repl::`anonymous namespace'::OplogInfoServerStatus::generateSection","s+":"1FD"}}}
      {"t":{"$date":"2020-03-30T14:35:15.623+00:00"},"s":"I", "c":"CONTROL", "id":31445,"ctx":"conn103","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FF6F7566F31","module":"mongod.exe","file":".../src/mongo/db/commands/server_status.h","line":100,"s":"mongo::ServerStatusSection::appendSection","s+":"21"}}}
      {"t":{"$date":"2020-03-30T14:35:15.623+00:00"},"s":"I", "c":"CONTROL", "id":31445,"ctx":"conn103","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FF6F7CEA6A9","module":"mongod.exe","file":".../src/mongo/db/commands/server_status.cpp","line":127,"s":"mongo::CmdServerStatus::run","s+":"6A9"}}}
      {"t":{"$date":"2020-03-30T14:35:15.623+00:00"},"s":"I", "c":"CONTROL", "id":31445,"ctx":"conn103","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FF6F762C817","module":"mongod.exe","file":".../src/mongo/db/commands.h","line":803,"s":"mongo::BasicCommand::runWithReplyBuilder","s+":"57"}}}
      {"t":{"$date":"2020-03-30T14:35:15.623+00:00"},"s":"I", "c":"CONTROL", "id":31445,"ctx":"conn103","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FF6F7E7E8F1","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":771,"s":"mongo::BasicCommandWithReplyBuilderInterface::Invocation::run","s+":"111"}}}
      {"t":{"$date":"2020-03-30T14:35:15.623+00:00"},"s":"I", "c":"CONTROL", "id":31445,"ctx":"conn103","msg":"  Frame: {frame}","attr":{"frame":{"a":"7FF6F7E7ED03","module":"mongod.exe","file":".../src/mongo/db/commands.cpp","line":187,"s":"mongo::CommandHelpers::runCommandInvocation","s+":"83"}}}
      

      Attachments

        1. mongodb.log.2020-03-30T14-35-18
          110 kB
          Dennis Kuczynski

        Issue Links

          Activity

            People

              lingzhi.deng@mongodb.com Lingzhi Deng
              dennis.kuczynski@mongodb.com Dennis Kuczynski
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: