Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-46245

Separate MongoDB Table Server got down

    XMLWordPrintable

    Details

    • Type: Question
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Done
    • Affects Version/s: 3.4.1
    • Fix Version/s: None
    • Component/s: WiredTiger
    • Labels:
      None

      Description

      This issue is very new for me.

      This scenario is about Production as per I have kept some large tables on other server.

      for a month The Server was going smooth but after one month it got down eventually.

      Not able to find any clue. cause there was no load on this server.

      Sharing Error If any one have opinion please share.

      MongoDB version 3.4.1.

      The Error is as per below,

       

       

      2020-02-18T18:11:35.463+0530 E STORAGE [conn6845] WiredTiger error (0) [1582029695:462530][852:140716463446480], file:ReconDB/collection-568-83659051179547653.wt, WT_SESSION.open_cursor: D:\MongoDBData\Data\ReconDB/collection-568-83659051179547653.wt: handle-open: CreateFileW: The process cannot access the file because it is being used by another process. 
      2020-02-18T18:11:35.503+0530 I - [conn6845] Invariant failure: ret resulted in status UnknownError: 16: Resource device at src\mongo\db\storage\wiredtiger\wiredtiger_session_cache.cpp 95
      2020-02-18T18:11:35.504+0530 I - [conn6845]
      ***aborting after invariant() failure
       
      2020-02-18T18:11:43.166+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\util\stacktrace_windows.cpp(239) mongo::printStackTrace+0x43
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\util\signal_handlers_synchronous.cpp(180) mongo::`anonymous namespace'::printSignalAndBacktrace+0x74
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\util\signal_handlers_synchronous.cpp(236) mongo::`anonymous namespace'::abruptQuit+0x85
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] ucrtbase.dll raise+0x1e7
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] ucrtbase.dll abort+0x31
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\util\assert_util.cpp(165) mongo::invariantOKFailed+0x1e9
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_session_cache.cpp(95) mongo::WiredTigerSession::getCursor+0xf1
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_recovery_unit.cpp(261) mongo::WiredTigerCursor::WiredTigerCursor+0x6e
      2020-02-18T18:11:43.167+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_record_store.cpp(1266) mongo::WiredTigerRecordStore::_insertRecords+0xfb
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_record_store.cpp(1250) mongo::WiredTigerRecordStore::insertRecords+0x29
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\catalog\collection.cpp(523) mongo::Collection::_insertDocuments+0x324
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\catalog\collection.cpp(415) mongo::Collection::insertDocuments+0x631
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\ops\write_ops_exec.cpp(308) mongo::insertDocuments+0xd9
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\ops\write_ops_exec.cpp(354) mongo::insertBatchAndHandleErrors+0x126
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\ops\write_ops_exec.cpp(456) mongo::performInserts+0x5a3
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\write_commands\write_commands.cpp(259) mongo::CmdInsert::runImpl+0x74
      2020-02-18T18:11:43.168+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\write_commands\write_commands.cpp(218) mongo::`anonymous namespace'::WriteCommand::run+0x29
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\dbcommands.cpp(1539) mongo::Command::run+0x6e4
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\dbcommands.cpp(1442) mongo::Command::execCommand+0xb9d
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\run_commands.cpp(73) mongo::runCommands+0x4e4
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\instance.cpp(236) mongo::`anonymous namespace'::receivedCommand+0x1d4
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\instance.cpp(614) mongo::assembleResponse+0x7ba
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\service_entry_point_mongod.cpp(135) mongo::ServiceEntryPointMongod::_sessionLoop+0x159
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe c:\program files (x86)\microsoft visual studio 14.0\vc\include\functional(212) std::_Func_impl<<lambda_0476eb5123845e42a2f452f2efde6866>,std::allocator<int>,void,std::shared_ptr<mongo::transport::Session> const & __ptr64>::_Do_call+0x43
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\transport\service_entry_point_utils.cpp(78) mongo::`anonymous namespace'::runFunc+0x1b3
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe c:\program files (x86)\microsoft visual studio 14.0\vc\include\thr\xthread(247) std::_LaunchPad<std::unique_ptr<std::tuple<std::_Binder<std::_Unforced,void * __ptr64 (__cdecl&)(void * __ptr64),mongo::`anonymous namespace'::Context * __ptr64> >,std::default_delete<std::tuple<std::_Binder<std::_Unforced,void * __ptr64 (__cdecl&)(void * __ptr64),mongo::`anonymous namespace'::Context * __ptr64> > > > >::_Run+0x75
      2020-02-18T18:11:43.169+0530 I CONTROL [conn6845] mongod.exe c:\program files (x86)\microsoft visual studio 14.0\vc\include\thr\xthread(210) std::_Pad::_Call_func+0x9
      2020-02-18T18:11:43.170+0530 I CONTROL [conn6845] ucrtbase.dll o__realloc_base+0x60
      2020-02-18T18:11:43.170+0530 I CONTROL [conn6845] KERNEL32.DLL BaseThreadInitThunk+0x14
      2020-02-18T18:11:43.170+0530 F - [conn6845] Got signal: 22 (SIGABRT).
      2020-02-18T18:11:43.171+0530 I CONTROL [conn6845] *** unhandled exception 0x0000000E at 0x00007FFB18C74078, terminating
      2020-02-18T18:11:43.171+0530 I CONTROL [conn6845] *** stack trace for unhandled exception:
      2020-02-18T18:11:43.221+0530 I CONTROL [conn6845] KERNELBASE.dll RaiseException+0x68
      2020-02-18T18:11:43.221+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\util\signal_handlers_synchronous.cpp(237) mongo::`anonymous namespace'::abruptQuit+0x9d
      2020-02-18T18:11:43.221+0530 I CONTROL [conn6845] ucrtbase.dll raise+0x1e7
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] ucrtbase.dll abort+0x31
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\util\assert_util.cpp(165) mongo::invariantOKFailed+0x1e9
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_session_cache.cpp(95) mongo::WiredTigerSession::getCursor+0xf1
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_recovery_unit.cpp(261) mongo::WiredTigerCursor::WiredTigerCursor+0x6e
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_record_store.cpp(1266) mongo::WiredTigerRecordStore::_insertRecords+0xfb
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\storage\wiredtiger\wiredtiger_record_store.cpp(1250) mongo::WiredTigerRecordStore::insertRecords+0x29
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\catalog\collection.cpp(523) mongo::Collection::_insertDocuments+0x324
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\catalog\collection.cpp(415) mongo::Collection::insertDocuments+0x631
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\ops\write_ops_exec.cpp(308) mongo::insertDocuments+0xd9
      2020-02-18T18:11:43.222+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\ops\write_ops_exec.cpp(354) mongo::insertBatchAndHandleErrors+0x126
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\ops\write_ops_exec.cpp(456) mongo::performInserts+0x5a3
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\write_commands\write_commands.cpp(259) mongo::CmdInsert::runImpl+0x74
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\write_commands\write_commands.cpp(218) mongo::`anonymous namespace'::WriteCommand::run+0x29
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\dbcommands.cpp(1539) mongo::Command::run+0x6e4
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\commands\dbcommands.cpp(1442) mongo::Command::execCommand+0xb9d
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\run_commands.cpp(73) mongo::runCommands+0x4e4
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\instance.cpp(236) mongo::`anonymous namespace'::receivedCommand+0x1d4
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\instance.cpp(614) mongo::assembleResponse+0x7ba
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\db\service_entry_point_mongod.cpp(135) mongo::ServiceEntryPointMongod::_sessionLoop+0x159
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe c:\program files (x86)\microsoft visual studio 14.0\vc\include\functional(212) std::_Func_impl<<lambda_0476eb5123845e42a2f452f2efde6866>,std::allocator<int>,void,std::shared_ptr<mongo::transport::Session> const & __ptr64>::_Do_call+0x43
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe ...\src\mongo\transport\service_entry_point_utils.cpp(78) mongo::`anonymous namespace'::runFunc+0x1b3
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe c:\program files (x86)\microsoft visual studio 14.0\vc\include\thr\xthread(247) std::_LaunchPad<std::unique_ptr<std::tuple<std::_Binder<std::_Unforced,void * __ptr64 (__cdecl&)(void * __ptr64),mongo::`anonymous namespace'::Context * __ptr64> >,std::default_delete<std::tuple<std::_Binder<std::_Unforced,void * __ptr64 (__cdecl&)(void * __ptr64),mongo::`anonymous namespace'::Context * __ptr64> > > > >::_Run+0x75
      2020-02-18T18:11:43.223+0530 I CONTROL [conn6845] mongod.exe c:\program files (x86)\microsoft visual studio 14.0\vc\include\thr\xthread(210) std::_Pad::_Call_func+0x9
      2020-02-18T18:11:43.224+0530 I CONTROL [conn6845] ucrtbase.dll o__realloc_base+0x60
      2020-02-18T18:11:43.224+0530 I CONTROL [conn6845] KERNEL32.DLL BaseThreadInitThunk+0x14
      2020-02-18T18:11:43.224+0530 I - [conn6845] 
      2020-02-18T18:11:43.225+0530 I CONTROL [conn6845] writing minidump diagnostic file C:\Program Files\MongoDB\Server\3.2020-02-18T12-41-43.mdmp
      2020-02-18T18:11:44.696+0530 I CONTROL [conn6845] *** immediate exit due to unhandled exception
      

       

       

      Thankyou in advance.

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            yogeshtj889@gmail.com Yogesh Jadhav
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: