Hi,

As a bit of background, we are using Mongo in journalling mode on a single server. The collection is capped and limited to 20Gb on a machine with a 75Gb hard disk. We recently updated our indexes which are now very large, the indexes for a full database take up roughly 27Gb. Every now and then (this has so far happened twice in a week), assertions fail on the indexes. This all seems to happen after the log line:

VirtualProtect failed 10441050000000 4000000 errno:1455 The paging file is too small for this operation to complete.

As I am aware, Windows will use all available hard disk space for a paging file if required. What is the limit that I am hitting?

Below is the log:

Thu Aug 18 17:06:51 [conn153] query ds3000.logevents ntoreturn:5000 reslen:36 nscanned:4591684 ntoskip:1326{ $orderby:

{ GenerationTime: -1, _id: -1 }

, $query: { $or: [ { GenerationTime:

{ $gte: new Date(1313682837364), $lte: new Date(1313683437364) }

, SourceType:

{ $in: [ "VSS" ] }

, Component:

{ $in: [ "ProsodyAdaptor.VmpRXWrapper", "MediaController.MediaControllerCore", "MediaController.RadioEndpoint", "ProsodyAdaptor.SipCall" ] }

}, { GenerationTime:

{ $gte: new Date(1313682837364), $lte: new Date(1313683437364) }

, SourceType:

{ $in: [ "VSS" ] }

} ] } } nreturned:0 28687ms
Thu Aug 18 17:07:29 [conn153] query ds3000.logevents ntoreturn:5000 reslen:175614 nscanned:4593141 { $orderby:

{ GenerationTime: -1, _id: -1 }

, $query: { $or: [ { GenerationTime:

{ $gte: new Date(1313682837364), $lte: new Date(1313683437364) }

, SourceType:

{ $in: [ "VSS" ] }

, Component:

{ $in: [ "ProsodyAdaptor.VmpRXWrapper", "MediaController.MediaControllerCore", "MediaController.RadioEndpoint", "ProsodyAdaptor.SipCall" ] }

}, { GenerationTime:

{ $gte: new Date(1313682837364), $lte: new Date(1313683437364) }

, SourceType:

{ $in: [ "VSS" ] }

} ] } } nreturned:1326 22291ms
Thu Aug 18 17:07:49 [conn134] insert ds3000.logevents 280ms
Thu Aug 18 17:07:49 [dur] lsn set 70507016
Thu Aug 18 17:08:49 [dur] lsn set 70545486
Thu Aug 18 17:09:49 [dur] lsn set 70583956
Thu Aug 18 17:10:49 [dur] lsn set 70622426
Thu Aug 18 17:11:49 [dur] lsn set 70660866
Thu Aug 18 17:12:44 [conn124] VirtualProtect failed 10441050000000 4000000 errno:1455 The paging file is too small for this operation to complete.
Thu Aug 18 17:12:44 [conn124] ds3000.logevents Assertion failure false db\mongommf.cpp 72
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ERROR k(keypos+1).prevChildBucket != lchild
Thu Aug 18 17:12:44 [conn124] thisLoc: 6:6260a800 ds3000.logevents.$HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] keyPos: 53 n:61
Thu Aug 18 17:12:44 [conn124] k(keypos+1).pcb: 6:6260e820 lchild: 6:626047d0
Thu Aug 18 17:12:44 [conn124] recordLoc: 2:55c5b10 rchild: 6:62610830
Thu Aug 18 17:12:44 [conn124] key: { : "10.253.138.200", : new Date(1313683955734), : ObjectId('4e4d39fb82005a04dc082f04') }
Thu Aug 18 17:12:44 [conn124] DUMP btreebucket n:61 parent:1fce48f0
0 { : "10.253.138.200", : new Date(1313683950453), : ObjectId('4e4d39f182005a04dc081193') } left:6252e120 RecLoc:2:511b1ac
1 { : "10.253.138.200", : new Date(1313683950531), : ObjectId('4e4d39f282005a04dc081293') } left:62530130 RecLoc:2:5129ae0
2 { : "10.253.138.200", : new Date(1313683950609), : ObjectId('4e4d39f282005a04dc081347') } left:6253a180 RecLoc:2:514bbd0
3 { : "10.253.138.200", : new Date(1313683950687), : ObjectId('4e4d39f282005a04dc0813da') } left:6253c190 RecLoc:2:5158ba8
4 { : "10.253.138.200", : new Date(1313683950781), : ObjectId('4e4d39f282005a04dc081460') } left:6253e1a0 RecLoc:2:516a000
5 { : "10.253.138.200", : new Date(1313683950859), : ObjectId('4e4d39f282005a04dc0814fc') } left:625441d0 RecLoc:2:5188a14
6 { : "10.253.138.200", : new Date(1313683950937), : ObjectId('4e4d39f382005a04dc081574') } left:625461e0 RecLoc:2:51975e8
7 { : "10.253.138.200", : new Date(1313683951015), : ObjectId('4e4d39f382005a04dc0815d7') } left:6254c210 RecLoc:2:51ae90c
8 { : "10.253.138.200", : new Date(1313683951109), : ObjectId('4e4d39f382005a04dc081625') } left:6254e220 RecLoc:2:51c7604
9 { : "10.253.138.200", : new Date(1313683951171), : ObjectId('4e4d39f382005a04dc08169d') } left:62552240 RecLoc:2:51d62fc
10 { : "10.253.138.200", : new Date(1313683951265), : ObjectId('4e4d39f382005a04dc0816f8') } left:62554250 RecLoc:2:51e2dc8
11 { : "10.253.138.200", : new Date(1313683951343), : ObjectId('4e4d39f382005a04dc081758') } left:62556260 RecLoc:2:51f464c
12 { : "10.253.138.200", : new Date(1313683951406), : ObjectId('4e4d39f382005a04dc0817d6') } left:6255c290 RecLoc:2:520a978
13 { : "10.253.138.200", : new Date(1313683951484), : ObjectId('4e4d39f482005a04dc081826') } left:6255e2a0 RecLoc:2:521fd60
14 { : "10.253.138.200", : new Date(1313683951562), : ObjectId('4e4d39f482005a04dc08189c') } left:625622c0 RecLoc:2:522de8c
15 { : "10.253.138.200", : new Date(1313683951640), : ObjectId('4e4d39f482005a04dc08192b') } left:625682f0 RecLoc:2:5244ffc
16 { : "10.253.138.200", : new Date(1313683951734), : ObjectId('4e4d39ef82005a04dc080bc5') } left:6256a300 RecLoc:2:502228c
17 { : "10.253.138.200", : new Date(1313683951796), : ObjectId('4e4d39f082005a04dc080d8f') } left:62501fc0 RecLoc:2:506ae0c
18 { : "10.253.138.200", : new Date(1313683951859), : ObjectId('4e4d39f082005a04dc080e66') } left:62507ff0 RecLoc:2:5096b9c
19 { : "10.253.138.200", : new Date(1313683951875), : ObjectId('4e4d39f082005a04dc080f15') } left:6250e020 RecLoc:2:509c978
20 { : "10.253.138.200", : new Date(1313683951953), : ObjectId('4e4d39f182005a04dc080fdb') } left:62516060 RecLoc:2:50b9e2c
21 { : "10.253.138.200", : new Date(1313683952000), : ObjectId('4e4d39f182005a04dc0810a0') } left:62518070 RecLoc:2:50f95dc
22 { : "10.253.138.200", : new Date(1313683952015), : ObjectId('4e4d39f182005a04dc081153') } left:625240d0 RecLoc:2:50fefdc
23 { : "10.253.138.200", : new Date(1313683952046), : ObjectId('4e4d39f182005a04dc0811e4') } left:6252a100 RecLoc:2:510ed74
24 { : "10.253.138.200", : new Date(1313683952046), : ObjectId('4e4d39f182005a04dc081250') } left:6252c110 RecLoc:2:5114774
25 { : "10.253.138.200", : new Date(1313683952062), : ObjectId('4e4d39f282005a04dc081336') } left:62536160 RecLoc:2:513c930
26 { : "10.253.138.200", : new Date(1313683952078), : ObjectId('4e4d39f282005a04dc08141d') } left:62538170 RecLoc:2:5171d7c
27 { : "10.253.138.200", : new Date(1313683952093), : ObjectId('4e4d39f582005a04dc081b18') } left:625401b0 RecLoc:2:5294374
28 { : "10.253.138.200", : new Date(1313683952171), : ObjectId('4e4d39f582005a04dc081b5c') } left:62576360 RecLoc:2:52a0d00
29 { : "10.253.138.200", : new Date(1313683952250), : ObjectId('4e4d39f582005a04dc081c01') } left:62578370 RecLoc:2:52bab10
30 { : "10.253.138.200", : new Date(1313683952343), : ObjectId('4e4d39f582005a04dc081c4d') } left:6257c390 RecLoc:2:52c8570
31 { : "10.253.138.200", : new Date(1313683952437), : ObjectId('4e4d39f582005a04dc081ce6') } left:6257e3a0 RecLoc:2:52def9c
32 { : "10.253.138.200", : new Date(1313683952515), : ObjectId('4e4d39f582005a04dc081d86') } left:625843d0 RecLoc:2:52f9714
33 { : "10.253.138.200", : new Date(1313683952593), : ObjectId('4e4d39f582005a04dc081de4') } left:6258a400 RecLoc:2:53058bc
34 { : "10.253.138.200", : new Date(1313683952671), : ObjectId('4e4d39f682005a04dc081e62') } left:6258c410 RecLoc:2:53202f4
35 { : "10.253.138.200", : new Date(1313683952765), : ObjectId('4e4d39f682005a04dc081e9e') } left:62590430 RecLoc:2:532cc54
36 { : "10.253.138.200", : new Date(1313683952890), : ObjectId('4e4d39f682005a04dc081f9a') } left:62592440 RecLoc:2:535a748
37 { : "10.253.138.200", : new Date(1313683953046), : ObjectId('4e4d39f682005a04dc0820a0') } left:6259e4a0 RecLoc:2:537e350
38 { : "10.253.138.200", : new Date(1313683953187), : ObjectId('4e4d39f782005a04dc082140') } left:625a24c0 RecLoc:2:53a0af4
39 { : "10.253.138.200", : new Date(1313683953328), : ObjectId('4e4d39f782005a04dc082261') } left:625a84f0 RecLoc:2:53c5230
40 { : "10.253.138.200", : new Date(1313683953468), : ObjectId('4e4d39f782005a04dc082331') } left:625ae520 RecLoc:2:53e8c28
41 { : "10.253.138.200", : new Date(1313683953609), : ObjectId('4e4d39f882005a04dc08245d') } left:625b2540 RecLoc:2:5416390
42 { : "10.253.138.200", : new Date(1313683953781), : ObjectId('4e4d39f882005a04dc082538') } left:625bc590 RecLoc:2:543762c
43 { : "10.253.138.200", : new Date(1313683954125), : ObjectId('4e4d39f882005a04dc08260e') } left:625c25c0 RecLoc:2:545afbc
44 { : "10.253.138.200", : new Date(1313683954296), : ObjectId('4e4d39f882005a04dc0826e0') } left:625c85f0 RecLoc:2:547fcb0
45 { : "10.253.138.200", : new Date(1313683954468), : ObjectId('4e4d39f982005a04dc0827b8') } left:625cc610 RecLoc:2:54a244c
46 { : "10.253.138.200", : new Date(1313683954640), : ObjectId('4e4d39f982005a04dc08295e') } left:625d6660 RecLoc:2:54d8314
47 { : "10.253.138.200", : new Date(1313683954812), : ObjectId('4e4d39f982005a04dc082a7a') } left:625e06b0 RecLoc:2:550564c
48 { : "10.253.138.200", : new Date(1313683954984), : ObjectId('4e4d39fa82005a04dc082b55') } left:625ee720 RecLoc:2:5529470
49 { : "10.253.138.200", : new Date(1313683955156), : ObjectId('4e4d39fa82005a04dc082c80') } left:625f4750 RecLoc:2:5559010
50 { : "10.253.138.200", : new Date(1313683955328), : ObjectId('4e4d39fa82005a04dc082d51') } left:625fa780 RecLoc:2:5579494
51 { : "10.253.138.200", : new Date(1313683955515), : ObjectId('4e4d39fb82005a04dc082e1f') } left:625fe7a0 RecLoc:2:559d5c0
52 { : "10.253.138.200", : new Date(1313683955703), : ObjectId('4e4d39fb82005a04dc082ef6') } left:626047d0 RecLoc:2:55c2f0c
53 { : "10.253.138.200", : new Date(1313683955734), : ObjectId('4e4d39fb82005a04dc082f04') } left:626047d0 RecLoc:2:55c5b10
54 { : "10.253.138.200", : new Date(1313683955890), : ObjectId('4e4d39f382005a04dc0817b8') } left:6260e820 RecLoc:2:51f6f9c
55 { : "10.253.138.200", : new Date(1313683961000), : ObjectId('4e4d39f982005a04dc08285f') } left:62598470 RecLoc:2:54bf2d4
56 { : "10.253.138.200", : new Date(1313683961015), : ObjectId('4e4d39f982005a04dc082908') } left:625de6a0 RecLoc:2:54c5364
57 { : "10.253.138.200", : new Date(1313683961031), : ObjectId('4e4d39f982005a04dc08298b') } left:625e26c0 RecLoc:2:54e16b0
58 { : "10.253.138.201", : new Date(1313573832000), : ObjectId('4e4b8bc882005a0b08000879') } left:625e46d0 RecLoc:1:fe290
59 { : "10.253.138.201", : new Date(1313573849375), : ObjectId('4e4b8bd982005a0b08000aee') } left:54713900 RecLoc:1:144ae4
60 { : "10.253.138.201", : new Date(1313575061000), : ObjectId('4e4b909482005a0b0800a354') } left:118d6a0 RecLoc:1:131b63c right:118f6b0
Thu Aug 18 17:12:44 [conn124] ds3000.logevents Assertion failure false db\btree.cpp 1228
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
Thu Aug 18 17:12:44 [conn124] ds3000.logevents caught assertion indexRecord ds3000.logevents.$_HostIp_GenerationTimeid
.....This line repeats forever....

Regards
Nik