-
Type:
Bug
-
Resolution: Incomplete
-
Priority:
Major - P3
-
None
-
Affects Version/s: 3.0.5
-
Component/s: Storage
-
None
-
Environment:See attachment.
db version v3.0.5
git version: 8bc4ae20708dbb493cb09338d9e7be6698e4a3a3
-
Windows
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Apparently there was an unclean shutdown in a production system, after which the MongoDB server does not start.
Trying to run with --repair gives:
2015-09-06T11:49:15.856+0300 I CONTROL Hotfix KB2731284 or later update is not installed, will zero-out data files 2015-09-06T11:49:15.872+0300 W - [initandlisten] Detected unclean shutdown - C:\Program Files\MongoDB\Server\3.0\db\mongod.lock is not empty. 2015-09-06T11:49:15.872+0300 I STORAGE [initandlisten] ************** You specified --repair but there are dirty journal files. Please restart without --repair to allow the journal files to be replayed. If you wish to repair all databases, please shutdown cleanly and run with --repair again. ************** 2015-09-06T11:49:15.872+0300 I STORAGE [initandlisten] exception in initAndListen: 12596 old lock file, terminating 2015-09-06T11:49:15.872+0300 I CONTROL [initandlisten] dbexit: rc: 100
Running without --repair gives:
2015-09-06T11:49:54.375+0300 I CONTROL Hotfix KB2731284 or later update is not installed, will zero-out data files
2015-09-06T11:49:54.375+0300 W - [initandlisten] Detected unclean shutdown - C:\Program Files\MongoDB\Server\3.0\db\mongod.lock is not empty.
2015-09-06T11:49:54.390+0300 I JOURNAL [initandlisten] journal dir=C:\Program Files\MongoDB\Server\3.0\db\journal
2015-09-06T11:49:54.390+0300 I JOURNAL [initandlisten] recover begin
2015-09-06T11:49:54.390+0300 I JOURNAL [initandlisten] info no lsn file in journal/ directory
2015-09-06T11:49:54.390+0300 I JOURNAL [initandlisten] recover lsn: 0
2015-09-06T11:49:54.390+0300 I JOURNAL [initandlisten] recover C:\Program Files\MongoDB\Server\3.0\db\journal\j._0
2015-09-06T11:49:54.390+0300 I JOURNAL [initandlisten] recover cleaning up
2015-09-06T11:49:54.390+0300 I JOURNAL [initandlisten] removeJournalFiles
2015-09-06T11:49:54.406+0300 I JOURNAL [initandlisten] recover done
2015-09-06T11:49:54.432+0300 I JOURNAL [durability] Durability thread started
2015-09-06T11:49:54.432+0300 I JOURNAL [journal writer] Journal writer thread started
2015-09-06T11:49:54.445+0300 I CONTROL [initandlisten] MongoDB starting : pid=5952 port=27017 dbpath=C:\Program Files\MongoDB\Server\3.0\db 64-bit host=RockSense
2015-09-06T11:49:54.445+0300 I CONTROL [initandlisten] targetMinOS: Windows 7/Windows Server 2008 R2
2015-09-06T11:49:54.445+0300 I CONTROL [initandlisten] db version v3.0.5
2015-09-06T11:49:54.445+0300 I CONTROL [initandlisten] git version: 8bc4ae20708dbb493cb09338d9e7be6698e4a3a3
2015-09-06T11:49:54.445+0300 I CONTROL [initandlisten] build info: windows sys.getwindowsversion(major=6, minor=1, build=7601, platform=2, service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49
2015-09-06T11:49:54.445+0300 I CONTROL [initandlisten] allocator: tcmalloc
2015-09-06T11:49:54.445+0300 I CONTROL [initandlisten] options: { config: "C:\Program Files\MongoDB\Server\3.0\bin\mongod.cfg", storage: { dbPath: "C:\Program Files\MongoDB\Server\3.0\db" }, systemLog: { destination: "file", path: "C:\Program Files\MongoDB\Server\3.0\log\mongod.log" } }
2015-09-06T11:49:54.452+0300 I - [initandlisten] Invariant failure details src\mongo\db\storage\mmap_v1\mmap_v1_database_catalog_entry.cpp 732
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\util\stacktrace_win.cpp(175) mongo::printStackTrace+0x43
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\util\log.cpp(135) mongo::logContext+0x97
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\util\assert_util.cpp(147) mongo::invariantFailed+0xf0
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\storage\mmap_v1\mmap_v1_database_catalog_entry.cpp(732) mongo::MMAPV1DatabaseCatalogEntry::_insertInCache+0x69
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\storage\mmap_v1\mmap_v1_database_catalog_entry.cpp(626) mongo::MMAPV1DatabaseCatalogEntry::_init+0xae0
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\storage\mmap_v1\mmap_v1_database_catalog_entry.cpp(185) mongo::MMAPV1DatabaseCatalogEntry::MMAPV1DatabaseCatalogEntry+0x262
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\storage\mmap_v1\mmap_v1_engine.cpp(272) mongo::MMAPV1Engine::getDatabaseCatalogEntry+0x1a4
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\catalog\database_holder.cpp(128) mongo::DatabaseHolder::openDb+0x242
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\db.cpp(373) mongo::repairDatabasesAndCheckVersion+0x42f
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\db.cpp(549) mongo::_initAndListen+0xc26
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\db.cpp(651) mongo::initAndListen+0x27
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\db.cpp(896) mongoDbMain+0x206
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe ...\src\mongo\db\db.cpp(694) wmain+0x35
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] mongod.exe f:\dd\vctools\crt\crtw32\dllstuff\crtexe.c(623) __tmainCRTStartup+0x10f
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten] kernel32.dll BaseThreadInitThunk+0xd
2015-09-06T11:49:54.965+0300 I CONTROL [initandlisten]
2015-09-06T11:49:54.965+0300 I - [initandlisten]
***aborting after invariant() failure
In addition to bug fixes, any ideas (workarounds) how to fix a production server would be appreciated.