[SERVER-14751] Assertion failure a <= 512*1024*1024 src\mongo\util\alignedbuilder.cpp 104 Created: 31/Jul/14  Updated: 24/Jan/15  Resolved: 23/Jan/15

Status: Closed
Project: Core Server
Component/s: Performance, Stability
Affects Version/s: 2.6.0
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Peter Assignee: Thomas Rueckstiess
Resolution: Incomplete Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates SERVER-6786 Can't get lock to commit journal in l... Closed
Related
Operating System: ALL
Participants:

 Description   

My Server just crashed and this is the log, can anybody imagine why?
Maybe it wans't a good idea to insert data and create an index at the same time?

    2014-07-31T19:34:06.759+0200 [initandlisten] connection accepted from 127.0.0.1:58438 #16 (16 connections now open)
    2014-07-31T19:34:06.850+0200 [conn15] build index on: local.geos properties: { v: 1, key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 }, name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos" }
    2014-07-31T19:34:06.913+0200 [conn15]    building index using bulk method
    2014-07-31T19:34:09.021+0200 [conn15]           Index Build: 133200/14479222    0%
    2014-07-31T19:34:12.000+0200 [conn15]           Index Build: 372200/14479222    2%
    2014-07-31T19:34:15.001+0200 [conn15]           Index Build: 648500/14479222    4%
    2014-07-31T19:34:18.000+0200 [conn15]           Index Build: 950500/14479222    6%
    2014-07-31T19:34:21.000+0200 [conn15]           Index Build: 1258000/14479222   8%
    2014-07-31T19:34:28.822+0200 [conn15]           Index Build: 1519700/14479222   10%
    2014-07-31T19:34:31.000+0200 [conn15]           Index Build: 1677700/14479222   11%
    2014-07-31T19:34:34.098+0200 [conn15]           Index Build: 1762500/14479222   12%
    2014-07-31T19:34:37.001+0200 [conn15]           Index Build: 1938300/14479222   13%
    2014-07-31T19:34:40.000+0200 [conn15]           Index Build: 2128100/14479222   14%
    2014-07-31T19:34:43.000+0200 [conn15]           Index Build: 2283900/14479222   15%
    2014-07-31T19:34:46.000+0200 [conn15]           Index Build: 2485400/14479222   17%
    2014-07-31T19:34:49.000+0200 [conn15]           Index Build: 2713200/14479222   18%
    2014-07-31T19:34:52.000+0200 [conn15]           Index Build: 2909500/14479222   20%
    2014-07-31T19:34:58.464+0200 [conn15]           Index Build: 3039400/14479222   20%
    2014-07-31T19:35:01.029+0200 [conn15]           Index Build: 3209800/14479222   22%
    2014-07-31T19:35:04.021+0200 [conn15]           Index Build: 3386900/14479222   23%
    2014-07-31T19:35:07.000+0200 [conn15]           Index Build: 3589800/14479222   24%
    2014-07-31T19:35:10.000+0200 [conn15]           Index Build: 3790100/14479222   26%
    2014-07-31T19:35:13.000+0200 [conn15]           Index Build: 4017900/14479222   27%
    2014-07-31T19:35:16.000+0200 [conn15]           Index Build: 4259100/14479222   29%
    2014-07-31T19:35:19.019+0200 [conn15]           Index Build: 4530300/14479222   31%
    2014-07-31T19:35:24.400+0200 [conn15]           Index Build: 4559100/14479222   31%
    2014-07-31T19:35:27.001+0200 [conn15]           Index Build: 4832400/14479222   33%
    2014-07-31T19:35:30.002+0200 [conn15]           Index Build: 5002200/14479222   34%
    2014-07-31T19:35:33.000+0200 [conn15]           Index Build: 5191300/14479222   35%
    2014-07-31T19:35:36.010+0200 [conn15]           Index Build: 5375900/14479222   37%
    2014-07-31T19:35:39.000+0200 [conn15]           Index Build: 5637400/14479222   38%
    2014-07-31T19:35:42.000+0200 [conn15]           Index Build: 5909900/14479222   40%
    2014-07-31T19:35:48.989+0200 [conn15]           Index Build: 6078800/14479222   41%
    2014-07-31T19:35:51.001+0200 [conn15]           Index Build: 6267300/14479222   43%
    2014-07-31T19:35:54.001+0200 [conn15]           Index Build: 6531500/14479222   45%
    2014-07-31T19:35:57.000+0200 [conn15]           Index Build: 6763600/14479222   46%
    2014-07-31T19:36:00.000+0200 [conn15]           Index Build: 6947900/14479222   47%
    2014-07-31T19:36:03.052+0200 [conn15]           Index Build: 7182200/14479222   49%
    2014-07-31T19:36:06.000+0200 [conn15]           Index Build: 7350900/14479222   50%
    2014-07-31T19:36:13.936+0200 [conn15]           Index Build: 7598400/14479222   52%
    2014-07-31T19:36:16.000+0200 [conn15]           Index Build: 7768300/14479222   53%
    2014-07-31T19:36:19.000+0200 [conn15]           Index Build: 8009600/14479222   55%
    2014-07-31T19:36:22.000+0200 [conn15]           Index Build: 8261200/14479222   57%
    2014-07-31T19:36:25.001+0200 [conn15]           Index Build: 8488400/14479222   58%
    2014-07-31T19:36:28.000+0200 [conn15]           Index Build: 8735800/14479222   60%
    2014-07-31T19:36:31.000+0200 [conn15]           Index Build: 8989400/14479222   62%
    2014-07-31T19:36:37.815+0200 [conn15]           Index Build: 9118100/14479222   62%
    2014-07-31T19:36:40.000+0200 [conn15]           Index Build: 9295900/14479222   64%
    2014-07-31T19:36:43.000+0200 [conn15]           Index Build: 9533800/14479222   65%
    2014-07-31T19:36:46.000+0200 [conn15]           Index Build: 9748500/14479222   67%
    2014-07-31T19:36:49.004+0200 [conn15]           Index Build: 9957400/14479222   68%
    2014-07-31T19:36:52.007+0200 [conn15]           Index Build: 10184400/14479222  70%
    2014-07-31T19:36:55.000+0200 [conn15]           Index Build: 10383100/14479222  71%
    2014-07-31T19:37:02.789+0200 [conn15]           Index Build: 10637800/14479222  73%
    2014-07-31T19:37:05.002+0200 [conn15]           Index Build: 10819000/14479222  74%
    2014-07-31T19:37:08.000+0200 [conn15]           Index Build: 11071700/14479222  76%
    2014-07-31T19:37:11.000+0200 [conn15]           Index Build: 11310700/14479222  78%
    2014-07-31T19:37:14.001+0200 [conn15]           Index Build: 11571300/14479222  79%
    2014-07-31T19:37:17.003+0200 [conn15]           Index Build: 11830200/14479222  81%
    2014-07-31T19:37:20.000+0200 [conn15]           Index Build: 12087100/14479222  83%
    2014-07-31T19:37:25.670+0200 [conn15]           Index Build: 12157500/14479222  83%
    2014-07-31T19:37:28.000+0200 [conn15]           Index Build: 12332600/14479222  85%
    2014-07-31T19:37:31.001+0200 [conn15]           Index Build: 12575700/14479222  86%
    2014-07-31T19:37:34.001+0200 [conn15]           Index Build: 12786900/14479222  88%
    2014-07-31T19:37:37.000+0200 [conn15]           Index Build: 13037600/14479222  90%
    2014-07-31T19:37:40.000+0200 [conn15]           Index Build: 13301500/14479222  91%
    2014-07-31T19:37:43.000+0200 [conn15]           Index Build: 13556500/14479222  93%
    2014-07-31T19:37:50.327+0200 [conn15]           Index Build: 13677100/14479222  94%
    2014-07-31T19:37:53.000+0200 [conn15]           Index Build: 13780800/14479222  95%
    2014-07-31T19:37:56.002+0200 [conn15]           Index Build: 13930200/14479222  96%
    2014-07-31T19:37:59.000+0200 [conn15]           Index Build: 14098700/14479222  97%
    2014-07-31T19:38:02.001+0200 [conn15]           Index Build: 14259000/14479222  98%
    2014-07-31T19:38:05.000+0200 [conn15]           Index Build: 14434200/14479222  99%
    2014-07-31T19:38:19.000+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 1501500/14479222 10%
    2014-07-31T19:38:24.442+0200 [conn15] warning: DR102 too much data written uncommitted 314.577MB
    2014-07-31T19:38:44.840+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:44.841+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:44.842+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:44.844+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:44.846+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:44.847+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:44.848+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:44.848+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:44.849+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:44.850+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:44.851+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:44.852+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:44.853+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:44.854+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:44.855+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:44.856+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:44.857+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:44.858+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:44.859+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:44.860+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:44.860+0200 [conn15]
    2014-07-31T19:38:44.878+0200 [conn15] warning: DR102 too much data written uncommitted 314.581MB
    2014-07-31T19:38:45.228+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:45.228+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:45.229+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:45.230+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:45.230+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:45.231+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:45.231+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:45.232+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:45.232+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:45.233+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:45.233+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:45.234+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:45.234+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:45.235+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:45.235+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:45.236+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:45.236+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:45.237+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:45.237+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:45.238+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:45.238+0200 [conn15]
    2014-07-31T19:38:45.239+0200 [conn15] warning: DR102 too much data written uncommitted 314.585MB
    2014-07-31T19:38:45.571+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:45.571+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:45.572+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:45.573+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:45.573+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:45.574+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:45.574+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:45.575+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:45.576+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:45.578+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:45.579+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:45.579+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:45.580+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:45.580+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:45.581+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:45.581+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:45.582+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:45.582+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:45.583+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:45.583+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:45.584+0200 [conn15]
    2014-07-31T19:38:45.584+0200 [conn15] warning: DR102 too much data written uncommitted 314.593MB
    2014-07-31T19:38:45.915+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:45.916+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:45.916+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:45.917+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:45.917+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:45.919+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:45.919+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:45.920+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:45.920+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:45.921+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:45.922+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:45.922+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:45.923+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:45.923+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:45.924+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:45.926+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:45.927+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:45.927+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:45.928+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:45.928+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:45.929+0200 [conn15]
    2014-07-31T19:38:45.929+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 2428800/14479222 16%
    2014-07-31T19:38:46.004+0200 [conn15] warning: DR102 too much data written uncommitted 314.597MB
    2014-07-31T19:38:46.376+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:46.376+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:46.377+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:46.378+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:46.379+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:46.379+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:46.379+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:46.380+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:46.380+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:46.381+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:46.381+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:46.382+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:46.382+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:46.383+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:46.383+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:46.384+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:46.384+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:46.384+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:46.385+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:46.385+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:46.386+0200 [conn15]
    2014-07-31T19:38:46.386+0200 [conn15] warning: DR102 too much data written uncommitted 314.601MB
    2014-07-31T19:38:46.715+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:46.715+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:46.716+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:46.717+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:46.717+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:46.718+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:46.718+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:46.719+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:46.720+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:46.720+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:46.721+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:46.721+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:46.722+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:46.722+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:46.723+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:46.723+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:46.723+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:46.724+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:46.724+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:46.725+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:46.725+0200 [conn15]
    2014-07-31T19:38:46.726+0200 [conn15] warning: DR102 too much data written uncommitted 314.61MB
    2014-07-31T19:38:47.055+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:47.055+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:47.056+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:47.057+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:47.058+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:47.058+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:47.059+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:47.060+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:47.060+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:47.061+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:47.061+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:47.062+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:47.063+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:47.063+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:47.064+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:47.064+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:47.064+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:47.065+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:47.066+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:47.066+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:47.067+0200 [conn15]
    2014-07-31T19:38:47.067+0200 [conn15] warning: DR102 too much data written uncommitted 314.614MB
    2014-07-31T19:38:47.400+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:47.400+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:47.401+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:47.402+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:47.402+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:47.402+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:47.403+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:47.403+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:47.404+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:47.404+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:47.405+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:47.405+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:47.406+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:47.406+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:47.407+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:47.407+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:47.407+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:47.408+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:47.408+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:47.409+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:47.409+0200 [conn15]
    2014-07-31T19:38:47.410+0200 [conn15] warning: DR102 too much data written uncommitted 314.618MB
    2014-07-31T19:38:47.740+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:47.740+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:47.741+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:47.742+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:47.743+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:47.743+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:47.744+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:47.745+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:47.745+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:47.746+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:47.746+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:47.746+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:47.747+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:47.747+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:47.748+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:47.748+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:47.749+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:47.749+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:47.749+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:47.750+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:47.750+0200 [conn15]
    2014-07-31T19:38:47.751+0200 [conn15] warning: DR102 too much data written uncommitted 314.626MB
    2014-07-31T19:38:48.080+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:48.081+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:48.082+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:48.082+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:48.083+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:48.083+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:48.084+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:48.084+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:48.085+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:48.085+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:48.085+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:48.086+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:48.086+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:48.087+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:48.087+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:48.088+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:48.088+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:48.088+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:48.089+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:48.089+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:48.090+0200 [conn15]
    2014-07-31T19:38:48.091+0200 [conn15] warning: DR102 too much data written uncommitted 314.63MB
    2014-07-31T19:38:48.091+0200 [conn15] warning: DR102 too much data written uncommitted 314.634MB
    2014-07-31T19:38:48.091+0200 [conn15] warning: DR102 too much data written uncommitted 314.642MB
    2014-07-31T19:38:48.091+0200 [conn15] warning: DR102 too much data written uncommitted 314.647MB
    2014-07-31T19:38:48.092+0200 [conn15] warning: DR102 too much data written uncommitted 314.651MB
    2014-07-31T19:38:48.093+0200 [conn15] warning: DR102 too much data written uncommitted 314.659MB
    2014-07-31T19:38:48.093+0200 [conn15] warning: DR102 too much data written uncommitted 314.663MB
    2014-07-31T19:38:48.093+0200 [conn15] warning: DR102 too much data written uncommitted 314.667MB
    2014-07-31T19:38:48.094+0200 [conn15] warning: DR102 too much data written uncommitted 314.675MB
    2014-07-31T19:38:48.095+0200 [conn15] warning: DR102 too much data written uncommitted 314.679MB
    2014-07-31T19:38:48.430+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:48.430+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:48.431+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:48.432+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:48.433+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:48.434+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:48.434+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:48.434+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:48.435+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:48.435+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:48.436+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:48.436+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:48.437+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:48.437+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:48.438+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:48.438+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:48.439+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:48.439+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:48.440+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:48.442+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:48.443+0200 [conn15]
    2014-07-31T19:38:48.443+0200 [conn15] warning: DR102 too much data written uncommitted 314.683MB
    2014-07-31T19:38:48.444+0200 [conn15] warning: DR102 too much data written uncommitted 314.692MB
    2014-07-31T19:38:48.444+0200 [conn15] warning: DR102 too much data written uncommitted 314.696MB
    2014-07-31T19:38:48.445+0200 [conn15] warning: DR102 too much data written uncommitted 314.7MB
    2014-07-31T19:38:48.445+0200 [conn15] warning: DR102 too much data written uncommitted 314.708MB
    2014-07-31T19:38:48.446+0200 [conn15] warning: DR102 too much data written uncommitted 314.712MB
    2014-07-31T19:38:48.446+0200 [conn15] warning: DR102 too much data written uncommitted 314.716MB
    2014-07-31T19:38:48.447+0200 [conn15] warning: DR102 too much data written uncommitted 314.724MB
    2014-07-31T19:38:48.448+0200 [conn15] warning: DR102 too much data written uncommitted 314.728MB
    2014-07-31T19:38:48.448+0200 [conn15] warning: DR102 too much data written uncommitted 314.733MB
    2014-07-31T19:38:48.780+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:48.781+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:48.781+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:48.782+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:48.782+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:48.783+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:48.783+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:48.784+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:48.784+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:48.785+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:48.785+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:48.786+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:48.786+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:48.786+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:48.787+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:48.787+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:48.788+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:48.788+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:48.788+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:48.789+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:48.789+0200 [conn15]
    2014-07-31T19:38:48.790+0200 [conn15] warning: DR102 too much data written uncommitted 314.741MB
    2014-07-31T19:38:48.790+0200 [conn15] warning: DR102 too much data written uncommitted 314.745MB
    2014-07-31T19:38:48.791+0200 [conn15] warning: DR102 too much data written uncommitted 314.749MB
    2014-07-31T19:38:48.791+0200 [conn15] warning: DR102 too much data written uncommitted 314.757MB
    2014-07-31T19:38:48.792+0200 [conn15] warning: DR102 too much data written uncommitted 314.761MB
    2014-07-31T19:38:48.792+0200 [conn15] warning: DR102 too much data written uncommitted 314.765MB
    2014-07-31T19:38:48.792+0200 [conn15] warning: DR102 too much data written uncommitted 314.774MB
    2014-07-31T19:38:48.793+0200 [conn15] warning: DR102 too much data written uncommitted 314.778MB
    2014-07-31T19:38:48.793+0200 [conn15] warning: DR102 too much data written uncommitted 314.782MB
    2014-07-31T19:38:48.793+0200 [conn15] warning: DR102 too much data written uncommitted 314.79MB
    2014-07-31T19:38:49.126+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:49.127+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:49.127+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:49.128+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:49.128+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:49.129+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:49.130+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:49.131+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:49.131+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:49.132+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:49.132+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:49.132+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:49.133+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:49.133+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:49.134+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:49.134+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:49.135+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:49.135+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:49.135+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:49.136+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:49.136+0200 [conn15]
    2014-07-31T19:38:49.137+0200 [conn15] warning: DR102 too much data written uncommitted 314.794MB
    2014-07-31T19:38:49.137+0200 [conn15] warning: DR102 too much data written uncommitted 314.798MB
    2014-07-31T19:38:49.138+0200 [conn15] warning: DR102 too much data written uncommitted 314.806MB
    2014-07-31T19:38:49.138+0200 [conn15] warning: DR102 too much data written uncommitted 314.81MB
    2014-07-31T19:38:49.139+0200 [conn15] warning: DR102 too much data written uncommitted 314.814MB
    2014-07-31T19:38:49.139+0200 [conn15] warning: DR102 too much data written uncommitted 314.819MB
    2014-07-31T19:38:49.139+0200 [conn15] warning: DR102 too much data written uncommitted 314.827MB
    2014-07-31T19:38:49.140+0200 [conn15] warning: DR102 too much data written uncommitted 314.831MB
    2014-07-31T19:38:49.140+0200 [conn15] warning: DR102 too much data written uncommitted 314.835MB
    2014-07-31T19:38:49.140+0200 [conn15] warning: DR102 too much data written uncommitted 314.843MB
    2014-07-31T19:38:49.468+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:49.469+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:49.469+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:49.470+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:49.470+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:49.471+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:49.472+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:49.473+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:49.473+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:49.474+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:49.474+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:49.474+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:49.475+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:49.475+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:49.476+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:49.476+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:49.477+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:49.477+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:49.477+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:49.478+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:49.478+0200 [conn15]
    2014-07-31T19:38:49.479+0200 [conn15] warning: DR102 too much data written uncommitted 314.847MB
    2014-07-31T19:38:49.479+0200 [conn15] warning: DR102 too much data written uncommitted 314.851MB
    2014-07-31T19:38:49.480+0200 [conn15] warning: DR102 too much data written uncommitted 314.86MB
    2014-07-31T19:38:49.483+0200 [conn15] warning: DR102 too much data written uncommitted 314.864MB
    2014-07-31T19:38:49.483+0200 [conn15] warning: DR102 too much data written uncommitted 314.868MB
    2014-07-31T19:38:49.483+0200 [conn15] warning: DR102 too much data written uncommitted 314.876MB
    2014-07-31T19:38:49.484+0200 [conn15] warning: DR102 too much data written uncommitted 314.88MB
    2014-07-31T19:38:49.484+0200 [conn15] warning: DR102 too much data written uncommitted 314.884MB
    2014-07-31T19:38:49.484+0200 [conn15] warning: DR102 too much data written uncommitted 314.892MB
    2014-07-31T19:38:49.485+0200 [conn15] warning: DR102 too much data written uncommitted 314.896MB
    2014-07-31T19:38:49.813+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:49.813+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:49.814+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:49.815+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:49.815+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:49.816+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:49.817+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:49.817+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:49.818+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:49.819+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:49.819+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:49.819+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:49.820+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:49.820+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:49.821+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:49.821+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:49.821+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:49.822+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:49.822+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:49.823+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:49.823+0200 [conn15]
    2014-07-31T19:38:49.824+0200 [conn15] warning: DR102 too much data written uncommitted 314.9MB
    2014-07-31T19:38:49.824+0200 [conn15] warning: DR102 too much data written uncommitted 314.909MB
    2014-07-31T19:38:49.824+0200 [conn15] warning: DR102 too much data written uncommitted 314.913MB
    2014-07-31T19:38:49.825+0200 [conn15] warning: DR102 too much data written uncommitted 314.917MB
    2014-07-31T19:38:49.825+0200 [conn15] warning: DR102 too much data written uncommitted 314.925MB
    2014-07-31T19:38:49.826+0200 [conn15] warning: DR102 too much data written uncommitted 314.929MB
    2014-07-31T19:38:49.826+0200 [conn15] warning: DR102 too much data written uncommitted 314.933MB
    2014-07-31T19:38:49.827+0200 [conn15] warning: DR102 too much data written uncommitted 314.941MB
    2014-07-31T19:38:49.827+0200 [conn15] warning: DR102 too much data written uncommitted 314.946MB
    2014-07-31T19:38:49.827+0200 [conn15] warning: DR102 too much data written uncommitted 314.95MB
    2014-07-31T19:38:50.159+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:50.159+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:50.160+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:50.160+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:50.161+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:50.162+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:50.162+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:50.163+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:50.163+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:50.164+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:50.165+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:50.165+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:50.166+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:50.166+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:50.167+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:50.167+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:50.168+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:50.168+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:50.169+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:50.169+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:50.170+0200 [conn15]
    2014-07-31T19:38:50.170+0200 [conn15] warning: DR102 too much data written uncommitted 314.958MB
    2014-07-31T19:38:50.171+0200 [conn15] warning: DR102 too much data written uncommitted 314.962MB
    2014-07-31T19:38:50.171+0200 [conn15] warning: DR102 too much data written uncommitted 314.966MB
    2014-07-31T19:38:50.172+0200 [conn15] warning: DR102 too much data written uncommitted 314.974MB
    2014-07-31T19:38:50.172+0200 [conn15] warning: DR102 too much data written uncommitted 314.978MB
    2014-07-31T19:38:50.173+0200 [conn15] warning: DR102 too much data written uncommitted 314.982MB
    2014-07-31T19:38:50.173+0200 [conn15] warning: DR102 too much data written uncommitted 314.991MB
    2014-07-31T19:38:50.174+0200 [conn15] warning: DR102 too much data written uncommitted 314.995MB
    2014-07-31T19:38:50.175+0200 [conn15] warning: DR102 too much data written uncommitted 314.999MB
    2014-07-31T19:38:50.175+0200 [conn15] warning: DR102 too much data written uncommitted 315.007MB
    2014-07-31T19:38:50.507+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:50.507+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:50.508+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:50.509+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:50.509+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:50.511+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:50.511+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:50.512+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:50.512+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:50.513+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:50.514+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:50.514+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:50.515+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:50.515+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:50.516+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:50.516+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:50.517+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:50.517+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:50.518+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:50.518+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:50.519+0200 [conn15]
    2014-07-31T19:38:50.519+0200 [conn15] warning: DR102 too much data written uncommitted 315.011MB
    2014-07-31T19:38:50.519+0200 [conn15] warning: DR102 too much data written uncommitted 315.015MB
    2014-07-31T19:38:50.520+0200 [conn15] warning: DR102 too much data written uncommitted 315.023MB
    2014-07-31T19:38:50.521+0200 [conn15] warning: DR102 too much data written uncommitted 315.027MB
    2014-07-31T19:38:50.521+0200 [conn15] warning: DR102 too much data written uncommitted 315.032MB
    2014-07-31T19:38:50.521+0200 [conn15] warning: DR102 too much data written uncommitted 315.04MB
    2014-07-31T19:38:50.522+0200 [conn15] warning: DR102 too much data written uncommitted 315.044MB
    2014-07-31T19:38:50.522+0200 [conn15] warning: DR102 too much data written uncommitted 315.048MB
    2014-07-31T19:38:50.523+0200 [conn15] warning: DR102 too much data written uncommitted 315.056MB
    2014-07-31T19:38:50.524+0200 [conn15] warning: DR102 too much data written uncommitted 315.06MB
    2014-07-31T19:38:50.854+0200 [conn15] mongod.exe  ...\src\mongo\util\stacktrace.cpp(169)                     mongo::printStackTrace+0x43
    2014-07-31T19:38:50.855+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(286)                    mongo::dur::CommitJob::note+0x1ae
    2014-07-31T19:38:50.855+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(73)                     mongo::dur::ThreadLocalIntents::_unspool+0x4f
    2014-07-31T19:38:50.856+0200 [conn15] mongod.exe  ...\src\mongo\db\dur_commitjob.cpp(133)                    mongo::dur::unspoolWriteIntents+0x62
    2014-07-31T19:38:50.856+0200 [conn15] mongod.exe  ...\src\mongo\db\dur.cpp(355)                              mongo::dur::DurableImpl::commitIfNeeded+0x47
    2014-07-31T19:38:50.858+0200 [conn15] mongod.exe  ...\src\mongo\db\structure\btree\btreebuilder.cpp(120)     mongo::BtreeBuilder<mongo::BtreeData_V1>::addKey+0x425
    2014-07-31T19:38:50.858+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(438)  mongo::BtreeBulk::commit<mongo::BtreeData_V1>+0x2e2
    2014-07-31T19:38:50.859+0200 [conn15] mongod.exe  ...\src\mongo\db\index\btree_based_access_method.cpp(583)  mongo::BtreeBasedAccessMethod::commitBulk+0x1e8
    2014-07-31T19:38:50.859+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_create.cpp(266)             mongo::buildAnIndex+0x6ba
    2014-07-31T19:38:50.860+0200 [conn15] mongod.exe  ...\src\mongo\db\catalog\index_catalog.cpp(341)            mongo::IndexCatalog::createIndex+0x776
    2014-07-31T19:38:50.860+0200 [conn15] mongod.exe  ...\src\mongo\db\commands\create_indexes.cpp(187)          mongo::CmdCreateIndex::run+0x12e9
    2014-07-31T19:38:50.861+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1357)                      mongo::_execCommand+0x5e
    2014-07-31T19:38:50.861+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1545)                      mongo::Command::execCommand+0xd45
    2014-07-31T19:38:50.864+0200 [conn15] mongod.exe  ...\src\mongo\db\dbcommands.cpp(1677)                      mongo::_runCommands+0x4a7
    2014-07-31T19:38:50.864+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(120)                   mongo::runCommands+0x41
    2014-07-31T19:38:50.865+0200 [conn15] mongod.exe  ...\src\mongo\db\query\new_find.cpp(423)                   mongo::newRunQuery+0x49d
    2014-07-31T19:38:50.865+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(269)                         mongo::receivedQuery+0x44f
    2014-07-31T19:38:50.866+0200 [conn15] mongod.exe  ...\src\mongo\db\instance.cpp(434)                         mongo::assembleResponse+0x30b
    2014-07-31T19:38:50.866+0200 [conn15] mongod.exe  ...\src\mongo\db\db.cpp(202)                               mongo::MyMessageHandler::process+0x111
    2014-07-31T19:38:50.866+0200 [conn15] mongod.exe  ...\src\mongo\util\net\message_server_port.cpp(210)        mongo::PortMessageServer::handleIncomingMsg+0x677
    2014-07-31T19:38:50.867+0200 [conn15]
    2014-07-31T19:38:50.867+0200 [conn15] warning: DR102 too much data written uncommitted 315.064MB
    2014-07-31T19:38:50.868+0200 [conn15] warning: DR102 too much data written uncommitted 315.073MB
    2014-07-31T19:38:50.868+0200 [conn15] warning: DR102 too much data written uncommitted 315.077MB
    2014-07-31T19:38:50.869+0200 [conn15] warning: DR102 too much data written uncommitted 315.081MB
    2014-07-31T19:38:50.869+0200 [conn15] warning: DR102 too much data written uncommitted 315.085MB
    2014-07-31T19:38:50.869+0200 [conn15] warning: DR102 too much data written uncommitted 315.093MB
    2014-07-31T19:38:50.870+0200 [conn15] warning: DR102 too much data written uncommitted 315.097MB
    2014-07-31T19:38:50.870+0200 [conn15] warning: DR102 too much data written uncommitted 315.101MB
    2014-07-31T19:38:50.870+0200 [conn15] warning: DR102 too much data written uncommitted 315.109MB
    2014-07-31T19:38:55.021+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 3058900/14479222 21%
    2014-07-31T19:39:05.024+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 4772700/14479222 32%
    2014-07-31T19:39:15.012+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 6467300/14479222 44%
    2014-07-31T19:39:25.010+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 8299400/14479222 57%
    2014-07-31T19:39:35.000+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 10152600/14479222        70%
    2014-07-31T19:39:45.008+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 12183800/14479222        84%
    2014-07-31T19:39:50.009+0200 [conn15] warning: DR102 too much data written uncommitted 1750.08MB
    2014-07-31T19:39:55.000+0200 [conn15]           Index: (2/3) BTree Bottom Up Progress: 14066300/14479222        97%
    2014-07-31T19:39:56.969+0200 [conn15]    done building bottom layer, going to commit
    2014-07-31T19:39:57.093+0200 [conn15] build index done.  scanned 14479222 total records. 350.231 secs
    2014-07-31T19:39:57.635+0200 [conn15] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bott
    2014-07-31T19:39:57.668+0200 [conn16] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bott
    2014-07-31T19:39:57.668+0200 [conn12] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bott
    2014-07-31T19:39:57.668+0200 [conn14] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bott
    2014-07-31T19:39:57.668+0200 [conn13] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bott
    2014-07-31T19:39:57.941+0200 [conn2] query local.geos query: { $and: [ { id: 1762973893 }, { type: "node" } ] } planSummary: IXSCAN { id: 1 } ntoskip:0 nscanned:1 nscannedObjects:1 keyUpdates:0 numYields:2 locks(micros) r:509865 nreturne
    2014-07-31T19:39:57.942+0200 [conn15] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "id_1", ns: "local.geos", key: { id: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:49 reslen:95 294ms
    2014-07-31T19:39:57.942+0200 [conn16] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "id_1", ns: "local.geos", key: { id: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:25 reslen:95 267ms
    2014-07-31T19:39:57.942+0200 [conn12] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "id_1", ns: "local.geos", key: { id: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:17 reslen:95 267ms
    2014-07-31T19:39:57.942+0200 [conn13] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "id_1", ns: "local.geos", key: { id: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:39 reslen:95 267ms
    2014-07-31T19:39:57.942+0200 [conn14] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "id_1", ns: "local.geos", key: { id: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:12 reslen:95 267ms
    2014-07-31T19:39:57.955+0200 [conn11] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bott
    2014-07-31T19:39:58.950+0200 [journal] warning assertion failure a <= 256*1024*1024 src\mongo\util\alignedbuilder.cpp 103
    2014-07-31T19:40:09.591+0200 [conn2] query local.geos query: { $and: [ { id: 513881 }, { type: "node" } ] } planSummary: IXSCAN { id: 1 } ntoskip:0 nscanned:1 nscannedObjects:1 keyUpdates:0 numYields:1 locks(micros) r:212034 nreturned:1
    2014-07-31T19:40:32.656+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                           mongo::printStackTrace+0x43
    2014-07-31T19:40:32.656+0200 [journal] mongod.exe    ...\src\mongo\util\log.cpp(127)                                  mongo::logContext+0x9c
    2014-07-31T19:40:32.658+0200 [journal] mongod.exe    ...\src\mongo\util\assert_util.cpp(102)                          mongo::wasserted+0x1b4
    2014-07-31T19:40:32.659+0200 [journal] mongod.exe    ...\src\mongo\util\alignedbuilder.cpp(104)                       mongo::AlignedBuilder::growReallocate+0x75
    2014-07-31T19:40:32.660+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(114)                      mongo::dur::prepBasicWrite_inlock+0x2ba
    2014-07-31T19:40:32.661+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(161)                      mongo::dur::prepBasicWrites+0xea
    2014-07-31T19:40:32.662+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(202)                      mongo::dur::PREPLOGBUFFER+0x84
    2014-07-31T19:40:32.663+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(608)                                    mongo::dur::_groupCommitWithLimitedLocks+0xeb
    2014-07-31T19:40:32.664+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                    mongo::dur::groupCommitWithLimitedLocks+0x27
    2014-07-31T19:40:32.665+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                    mongo::dur::durThreadGroupCommit+0x6d
    2014-07-31T19:40:32.666+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                    mongo::dur::durThread+0x27a
    2014-07-31T19:40:32.666+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)  boost::`anonymous namespace'::thread_start_function+0x21
    2014-07-31T19:40:32.667+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
    2014-07-31T19:40:32.668+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
    2014-07-31T19:40:32.669+0200 [journal] kernel32.dll                                                                   BaseThreadInitThunk+0xd
    2014-07-31T19:40:32.669+0200 [journal]
    2014-07-31T19:40:33.306+0200 [journal] warning assertion failure a <= 256*1024*1024 src\mongo\util\alignedbuilder.cpp 103
    2014-07-31T19:40:42.031+0200 [clientcursormon] mem (MB) res:6579 virt:33394
    2014-07-31T19:40:42.031+0200 [clientcursormon]  mapped (incl journal view):32658
    2014-07-31T19:40:42.033+0200 [clientcursormon]  connections:16
    2014-07-31T19:40:51.658+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                           mongo::printStackTrace+0x43
    2014-07-31T19:40:51.658+0200 [journal] mongod.exe    ...\src\mongo\util\log.cpp(127)                                  mongo::logContext+0x9c
    2014-07-31T19:40:51.659+0200 [journal] mongod.exe    ...\src\mongo\util\assert_util.cpp(102)                          mongo::wasserted+0x1b4
    2014-07-31T19:40:51.660+0200 [journal] mongod.exe    ...\src\mongo\util\alignedbuilder.cpp(104)                       mongo::AlignedBuilder::growReallocate+0x75
    2014-07-31T19:40:51.661+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(114)                      mongo::dur::prepBasicWrite_inlock+0x2ba
    2014-07-31T19:40:51.662+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(161)                      mongo::dur::prepBasicWrites+0xea
    2014-07-31T19:40:51.663+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(202)                      mongo::dur::PREPLOGBUFFER+0x84
    2014-07-31T19:40:51.664+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(608)                                    mongo::dur::_groupCommitWithLimitedLocks+0xeb
    2014-07-31T19:40:51.666+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                    mongo::dur::groupCommitWithLimitedLocks+0x27
    2014-07-31T19:40:51.667+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                    mongo::dur::durThreadGroupCommit+0x6d
    2014-07-31T19:40:51.668+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                    mongo::dur::durThread+0x27a
    2014-07-31T19:40:51.669+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)  boost::`anonymous namespace'::thread_start_function+0x21
    2014-07-31T19:40:51.670+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
    2014-07-31T19:40:51.671+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
    2014-07-31T19:40:51.673+0200 [journal] kernel32.dll                                                                   BaseThreadInitThunk+0xd
    2014-07-31T19:40:51.674+0200 [journal]
    2014-07-31T19:40:52.483+0200 [journal] warning assertion failure a <= 256*1024*1024 src\mongo\util\alignedbuilder.cpp 103
    2014-07-31T19:40:52.834+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                           mongo::printStackTrace+0x43
    2014-07-31T19:40:52.834+0200 [journal] mongod.exe    ...\src\mongo\util\log.cpp(127)                                  mongo::logContext+0x9c
    2014-07-31T19:40:52.835+0200 [journal] mongod.exe    ...\src\mongo\util\assert_util.cpp(102)                          mongo::wasserted+0x1b4
    2014-07-31T19:40:52.835+0200 [journal] mongod.exe    ...\src\mongo\util\alignedbuilder.cpp(104)                       mongo::AlignedBuilder::growReallocate+0x75
    2014-07-31T19:40:52.836+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(114)                      mongo::dur::prepBasicWrite_inlock+0x2ba
    2014-07-31T19:40:52.836+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(161)                      mongo::dur::prepBasicWrites+0xea
    2014-07-31T19:40:52.837+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(202)                      mongo::dur::PREPLOGBUFFER+0x84
    2014-07-31T19:40:52.837+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(608)                                    mongo::dur::_groupCommitWithLimitedLocks+0xeb
    2014-07-31T19:40:52.838+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                    mongo::dur::groupCommitWithLimitedLocks+0x27
    2014-07-31T19:40:52.838+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                    mongo::dur::durThreadGroupCommit+0x6d
    2014-07-31T19:40:52.839+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                    mongo::dur::durThread+0x27a
    2014-07-31T19:40:52.839+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)  boost::`anonymous namespace'::thread_start_function+0x21
    2014-07-31T19:40:52.840+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
    2014-07-31T19:40:52.840+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
    2014-07-31T19:40:52.840+0200 [journal] kernel32.dll                                                                   BaseThreadInitThunk+0xd
    2014-07-31T19:40:52.841+0200 [journal]
    2014-07-31T19:40:53.572+0200 [journal] rate limiting wassert
    2014-07-31T19:40:54.276+0200 [journal] Assertion failure a <= 512*1024*1024 src\mongo\util\alignedbuilder.cpp 104
    2014-07-31T19:40:54.625+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                           mongo::printStackTrace+0x43
    2014-07-31T19:40:54.626+0200 [journal] mongod.exe    ...\src\mongo\util\log.cpp(127)                                  mongo::logContext+0x9c
    2014-07-31T19:40:54.626+0200 [journal] mongod.exe    ...\src\mongo\util\assert_util.cpp(115)                          mongo::verifyFailed+0x14a
    2014-07-31T19:40:54.627+0200 [journal] mongod.exe    ...\src\mongo\util\alignedbuilder.cpp(104)                       mongo::AlignedBuilder::growReallocate+0xc5
    2014-07-31T19:40:54.628+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(114)                      mongo::dur::prepBasicWrite_inlock+0x2ba
    2014-07-31T19:40:54.629+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(161)                      mongo::dur::prepBasicWrites+0xea
    2014-07-31T19:40:54.629+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(202)                      mongo::dur::PREPLOGBUFFER+0x84
    2014-07-31T19:40:54.630+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(608)                                    mongo::dur::_groupCommitWithLimitedLocks+0xeb
    2014-07-31T19:40:54.630+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                    mongo::dur::groupCommitWithLimitedLocks+0x27
    2014-07-31T19:40:54.631+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                    mongo::dur::durThreadGroupCommit+0x6d
    2014-07-31T19:40:54.632+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                    mongo::dur::durThread+0x27a
    2014-07-31T19:40:54.632+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)  boost::`anonymous namespace'::thread_start_function+0x21
    2014-07-31T19:40:54.633+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
    2014-07-31T19:40:54.633+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
    2014-07-31T19:40:54.634+0200 [journal] kernel32.dll                                                                   BaseThreadInitThunk+0xd
    2014-07-31T19:40:54.634+0200 [journal]
    2014-07-31T19:40:54.717+0200 [journal] dbexception in groupCommitLL causing immediate shutdown: 0 assertion src\mongo\util\alignedbuilder.cpp:104
    2014-07-31T19:40:54.746+0200 [journal] SEVERE: dur1
    2014-07-31T19:40:54.830+0200 [conn12] Assertion failure a <= 512*1024*1024 src\mongo\util\alignedbuilder.cpp 104
    2014-07-31T19:40:55.224+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                                      mongo::printStackTrace+0x43
    2014-07-31T19:40:55.224+0200 [journal] mongod.exe    ...\src\mongo\util\signal_handlers.cpp(107)                                 mongo::`anonymous namespace'::abruptQuit+0xf2
    2014-07-31T19:40:55.226+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\winsig.c(593)                   raise+0x1ed
    2014-07-31T19:40:55.226+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\abort.c(81)                     abort+0x18
    2014-07-31T19:40:55.228+0200 [journal] mongod.exe    ...\src\mongo\db\instance.cpp(342)                                          mongo::mongoAbort+0x6e
    2014-07-31T19:40:55.229+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(647)                                               `mongo::dur::groupCommitWithLimitedLocks'::`1'::catch$0+0x97
    2014-07-31T19:40:55.229+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\SELF_64_amd64\crt\prebuild\eh\amd64\handlers.asm(44)  _CallSettingFrame+0x20
    2014-07-31T19:40:55.230+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\prebuild\eh\frame.cpp(1337)         __CxxCallCatchBlock+0xeb
    2014-07-31T19:40:55.231+0200 [journal] ntdll.dll                                                                                 RtlRestoreContext+0x2e2
    2014-07-31T19:40:55.232+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                               mongo::dur::groupCommitWithLimitedLocks+0x27
    2014-07-31T19:40:55.233+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                               mongo::dur::durThreadGroupCommit+0x6d
    2014-07-31T19:40:55.233+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                               mongo::dur::durThread+0x27a
    2014-07-31T19:40:55.234+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)             boost::`anonymous namespace'::thread_start_function+0x21
    2014-07-31T19:40:55.235+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)                 _callthreadstartex+0x17
    2014-07-31T19:40:55.235+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)                 _threadstartex+0x7f
    2014-07-31T19:40:55.236+0200 [journal] kernel32.dll                                                                              BaseThreadInitThunk+0xd
    2014-07-31T19:40:55.237+0200 [journal] SEVERE: Got signal: 22 (SIGABRT).
    Backtrace:



 Comments   
Comment by Ramon Fernandez Marina [ 24/Sep/14 ]

wutzebaer, we haven't heard back from you from some time. If this is still an issue for you, can you please check Thomas' question above and provide the information he requested?

Thanks,
Ramón.

Comment by Thomas Rueckstiess [ 13/Aug/14 ]

Hi Peter,

It shouldn't be a problem, but unfortunately the "local" database has some special behavior which lead to the bug described in SERVER-6786. As it is not fixed yet, we'll have to work around it.

Can you repeat your tests but use a different database? You don't even need to "create" it, you can just start writing to it and it will be created automatically. So in your code, just change "local" to "test" or something else.

Can you let us know if you are able to build the index successfully on the large dataset when you use a different database? That would be a confirmation that you're hitting SERVER-6786.

Thanks,
Thomas

Comment by Peter [ 13/Aug/14 ]

Hi i did not write to the database and there are no replicas, it's running standalone at the moment. The database contained 20Million Documents when i started to change the Index.

There is no reason why i use the local database, i just was to lazy to create one for my tests. Is that a Problem?

Comment by Thomas Rueckstiess [ 13/Aug/14 ]

Hi Peter,

After discussion with one of our engineers, we believe the cause for the journal buffer overflow is that you write to the local database, which has special case code around locking behavior and there is a known issue SERVER-6786 with locking for journal commits.

Can I ask what the reason is to use the local database, which is primarily meant for replication purposes? Notice that writes to the local database do not replicate to your secondary nodes. Is that your intention?

Writing to a different database should avoid the issue you are seeing. If that is not an option for you, you could try building the index with the {background: true} option. This should cause the index build to yield frequently and prevent the journal buffer to overflow.

I'll go ahead and mark this ticket as a duplicate of SERVER-6786. You can watch that ticket if you want to stay informed about the progress. Also feel free to vote for the issue to increase priority.

Regards,
Thomas

Comment by Peter [ 02/Aug/14 ]

creating the data first an index after worked... but i think that is not a good solution... sometimes an index of a huge database must be changed

Comment by Peter [ 01/Aug/14 ]

i winn now try to create the index first and then to insert the data

Comment by Peter [ 01/Aug/14 ]

even lowering the journalCommitInterval to 10 didnt help

2014-08-02T00:05:46.752+0200 [conn11] build index done.  scanned 15604772 total records. 395.916 secs
2014-08-02T00:05:47.341+0200 [conn11] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:26 w:396499735 reslen:113 396504ms
2014-08-02T00:05:47.377+0200 [conn10] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:52604 reslen:95 396556ms
2014-08-02T00:05:47.377+0200 [conn12] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:93 reslen:95 396556ms
2014-08-02T00:05:47.378+0200 [conn14] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:92 reslen:95 396555ms
2014-08-02T00:05:47.379+0200 [conn16] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:260 reslen:95 396553ms
2014-08-02T00:05:47.380+0200 [conn17] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:104 reslen:95 396553ms
2014-08-02T00:05:47.384+0200 [conn20] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:252 reslen:95 383788ms
2014-08-02T00:05:47.384+0200 [conn21] command local.$cmd command: createIndexes { createIndexes: "geos", indexes: [ { name: "bb.left_1_bb.right_1_bb.top_1_bb.bottom_1", ns: "local.geos", key: { bb.left: 1, bb.right: 1, bb.top: 1, bb.bottom: 1 } } ] } keyUpdates:0 numYields:0 locks(micros) r:88 reslen:95 383788ms
2014-08-02T00:05:48.796+0200 [journal] warning assertion failure a <= 256*1024*1024 src\mongo\util\alignedbuilder.cpp 103
2014-08-02T00:05:59.426+0200 [clientcursormon] mem (MB) res:6337 virt:33334
2014-08-02T00:05:59.427+0200 [clientcursormon]  mapped (incl journal view):32658
2014-08-02T00:05:59.427+0200 [clientcursormon]  connections:20
2014-08-02T00:06:07.355+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                           mongo::printStackTrace+0x43
2014-08-02T00:06:07.356+0200 [journal] mongod.exe    ...\src\mongo\util\log.cpp(127)                                  mongo::logContext+0x9c
2014-08-02T00:06:07.356+0200 [journal] mongod.exe    ...\src\mongo\util\assert_util.cpp(102)                          mongo::wasserted+0x1b4
2014-08-02T00:06:07.357+0200 [journal] mongod.exe    ...\src\mongo\util\alignedbuilder.cpp(104)                       mongo::AlignedBuilder::growReallocate+0x75
2014-08-02T00:06:07.357+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(114)                      mongo::dur::prepBasicWrite_inlock+0x2ba
2014-08-02T00:06:07.357+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(161)                      mongo::dur::prepBasicWrites+0xea
2014-08-02T00:06:07.357+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(202)                      mongo::dur::PREPLOGBUFFER+0x84
2014-08-02T00:06:07.357+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(608)                                    mongo::dur::_groupCommitWithLimitedLocks+0xeb
2014-08-02T00:06:07.358+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                    mongo::dur::groupCommitWithLimitedLocks+0x27
2014-08-02T00:06:07.358+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                    mongo::dur::durThreadGroupCommit+0x6d
2014-08-02T00:06:07.358+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                    mongo::dur::durThread+0x27a
2014-08-02T00:06:07.359+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)  boost::`anonymous namespace'::thread_start_function+0x21
2014-08-02T00:06:07.359+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
2014-08-02T00:06:07.359+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
2014-08-02T00:06:07.360+0200 [journal] kernel32.dll                                                                   BaseThreadInitThunk+0xd
2014-08-02T00:06:07.360+0200 [journal]
2014-08-02T00:06:08.338+0200 [journal] warning assertion failure a <= 256*1024*1024 src\mongo\util\alignedbuilder.cpp 103
2014-08-02T00:06:08.664+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                           mongo::printStackTrace+0x43
2014-08-02T00:06:08.664+0200 [journal] mongod.exe    ...\src\mongo\util\log.cpp(127)                                  mongo::logContext+0x9c
2014-08-02T00:06:08.664+0200 [journal] mongod.exe    ...\src\mongo\util\assert_util.cpp(102)                          mongo::wasserted+0x1b4
2014-08-02T00:06:08.665+0200 [journal] mongod.exe    ...\src\mongo\util\alignedbuilder.cpp(104)                       mongo::AlignedBuilder::growReallocate+0x75
2014-08-02T00:06:08.665+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(114)                      mongo::dur::prepBasicWrite_inlock+0x2ba
2014-08-02T00:06:08.665+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(161)                      mongo::dur::prepBasicWrites+0xea
2014-08-02T00:06:08.665+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(202)                      mongo::dur::PREPLOGBUFFER+0x84
2014-08-02T00:06:08.665+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(608)                                    mongo::dur::_groupCommitWithLimitedLocks+0xeb
2014-08-02T00:06:08.665+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                    mongo::dur::groupCommitWithLimitedLocks+0x27
2014-08-02T00:06:08.666+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                    mongo::dur::durThreadGroupCommit+0x6d
2014-08-02T00:06:08.668+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                    mongo::dur::durThread+0x27a
2014-08-02T00:06:08.668+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)  boost::`anonymous namespace'::thread_start_function+0x21
2014-08-02T00:06:08.670+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
2014-08-02T00:06:08.670+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
2014-08-02T00:06:08.672+0200 [journal] kernel32.dll                                                                   BaseThreadInitThunk+0xd
2014-08-02T00:06:08.672+0200 [journal]
2014-08-02T00:06:09.123+0200 [journal] rate limiting wassert
2014-08-02T00:06:09.997+0200 [journal] Assertion failure a <= 512*1024*1024 src\mongo\util\alignedbuilder.cpp 104
2014-08-02T00:06:28.562+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                           mongo::printStackTrace+0x43
2014-08-02T00:06:28.562+0200 [journal] mongod.exe    ...\src\mongo\util\log.cpp(127)                                  mongo::logContext+0x9c
2014-08-02T00:06:28.563+0200 [journal] mongod.exe    ...\src\mongo\util\assert_util.cpp(115)                          mongo::verifyFailed+0x14a
2014-08-02T00:06:28.563+0200 [journal] mongod.exe    ...\src\mongo\util\alignedbuilder.cpp(104)                       mongo::AlignedBuilder::growReallocate+0xc5
2014-08-02T00:06:28.563+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(114)                      mongo::dur::prepBasicWrite_inlock+0x2ba
2014-08-02T00:06:28.564+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(161)                      mongo::dur::prepBasicWrites+0xea
2014-08-02T00:06:28.566+0200 [journal] mongod.exe    ...\src\mongo\db\dur_preplogbuffer.cpp(202)                      mongo::dur::PREPLOGBUFFER+0x84
2014-08-02T00:06:28.566+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(608)                                    mongo::dur::_groupCommitWithLimitedLocks+0xeb
2014-08-02T00:06:28.566+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                    mongo::dur::groupCommitWithLimitedLocks+0x27
2014-08-02T00:06:28.567+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                    mongo::dur::durThreadGroupCommit+0x6d
2014-08-02T00:06:28.567+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                    mongo::dur::durThread+0x27a
2014-08-02T00:06:28.568+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)  boost::`anonymous namespace'::thread_start_function+0x21
2014-08-02T00:06:28.568+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)      _callthreadstartex+0x17
2014-08-02T00:06:28.569+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)      _threadstartex+0x7f
2014-08-02T00:06:28.570+0200 [journal] kernel32.dll                                                                   BaseThreadInitThunk+0xd
2014-08-02T00:06:28.571+0200 [journal]
2014-08-02T00:06:28.651+0200 [journal] dbexception in groupCommitLL causing immediate shutdown: 0 assertion src\mongo\util\alignedbuilder.cpp:104
2014-08-02T00:06:28.666+0200 [journal] SEVERE: dur1
2014-08-02T00:06:28.782+0200 [conn11] warning assertion failure a <= 256*1024*1024 src\mongo\util\alignedbuilder.cpp 103
2014-08-02T00:06:29.192+0200 [journal] mongod.exe    ...\src\mongo\util\stacktrace.cpp(169)                                      mongo::printStackTrace+0x43
2014-08-02T00:06:29.192+0200 [journal] mongod.exe    ...\src\mongo\util\signal_handlers.cpp(107)                                 mongo::`anonymous namespace'::abruptQuit+0xf2
2014-08-02T00:06:29.192+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\winsig.c(593)                   raise+0x1ed
2014-08-02T00:06:29.193+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\abort.c(81)                     abort+0x18
2014-08-02T00:06:29.193+0200 [journal] mongod.exe    ...\src\mongo\db\instance.cpp(342)                                          mongo::mongoAbort+0x6e
2014-08-02T00:06:29.193+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(647)                                               `mongo::dur::groupCommitWithLimitedLocks'::`1'::catch$0+0x97
2014-08-02T00:06:29.193+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\SELF_64_amd64\crt\prebuild\eh\amd64\handlers.asm(44)  _CallSettingFrame+0x20
2014-08-02T00:06:29.194+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\prebuild\eh\frame.cpp(1337)         __CxxCallCatchBlock+0xeb
2014-08-02T00:06:29.194+0200 [journal] ntdll.dll                                                                                 RtlRestoreContext+0x2e2
2014-08-02T00:06:29.194+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(643)                                               mongo::dur::groupCommitWithLimitedLocks+0x27
2014-08-02T00:06:29.195+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(783)                                               mongo::dur::durThreadGroupCommit+0x6d
2014-08-02T00:06:29.196+0200 [journal] mongod.exe    ...\src\mongo\db\dur.cpp(855)                                               mongo::dur::durThread+0x27a
2014-08-02T00:06:29.197+0200 [journal] mongod.exe    ...\src\third_party\boost\libs\thread\src\win32\thread.cpp(185)             boost::`anonymous namespace'::thread_start_function+0x21
2014-08-02T00:06:29.197+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(314)                 _callthreadstartex+0x17
2014-08-02T00:06:29.200+0200 [journal] mongod.exe    f:\dd\vctools\crt_bld\self_64_amd64\crt\src\threadex.c(292)                 _threadstartex+0x7f
2014-08-02T00:06:29.202+0200 [journal] kernel32.dll                                                                              BaseThreadInitThunk+0xd
2014-08-02T00:06:29.202+0200 [journal] SEVERE: Got signal: 22 (SIGABRT).
Backtrace:
 
E:\programme\MongoDB 2.6 Standard\bin>mongod.exe

Comment by Peter [ 01/Aug/14 ]

retried to create the index after inserting the data which resulted into a similar result

now i lowered the commit interval:

db.getSiblingDB("admin").runCommand(

{ setParameter: 1, journalCommitInterval: 100 }

)

but still the same result, the collection contains 20.000.000 documents and my final database will contain much more

why do you thik moving the journal to another disk or using a faster disk should help?

Comment by Ramon Fernandez Marina [ 31/Jul/14 ]

wutzebaer, the DR102 message means that the journal is not able to keep up with the write load. If your machine is not powerful enough to handle your write needs here are some things you can try:

Also, are you using the local database for your collections? If so, please be aware that this is not recommended.

Can you please try lowering the journalCommitInterval and see if the problem still persists? While you do this, you may want to monitor the load on your system with commands like top and iostat (assuming you're running on GNU/Linux).

Generated at Thu Feb 08 03:35:52 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.