[SERVER-651] indexing using way too much heap space Created: 20/Feb/10  Updated: 12/Jul/16  Resolved: 21/Feb/10

Status: Closed
Project: Core Server
Component/s: Index Maintenance, Performance
Affects Version/s: None
Fix Version/s: 1.2.3, 1.3.3

Type: Improvement Priority: Critical - P2
Reporter: Eliot Horowitz (Inactive) Assignee: Eliot Horowitz (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Participants:

 Description   

indexing was using way too much heap space.
problem was building index keys, the default buffer size for building the keys could be up to 20x too big, so instead of 100mb of space, could use multiple gigs



 Comments   
Comment by auto [ 21/Feb/10 ]

Author:

{'login': 'erh', 'name': 'Eliot Horowitz', 'email': 'eliot@10gen.com'}

Message: slightly stupid way to make memory on indexing not so bad for 1.2 SERVER-651
http://github.com/mongodb/mongo/commit/8cd3f5b5d4480346cdb20abb6113d182eb8aa656

Comment by auto [ 20/Feb/10 ]

Author:

{'login': 'erh', 'name': 'Eliot Horowitz', 'email': 'eliot@10gen.com'}

Message: use re-usable fast array for sorting in memory
30-70% faster SERVER-651
http://github.com/mongodb/mongo/commit/5383659f5efab34ec2fb512b3388dbb9ad768c52

Comment by auto [ 20/Feb/10 ]

Author:

{'login': 'erh', 'name': 'Eliot Horowitz', 'email': 'eliot@10gen.com'}

Message: BSONSizeTracker - tracks how big actual bson objects created with a builder are
then can correctly size buffers from the beginning
using this is index creation, so when doing external sort, we have a more accurate memory estimate
fixes SERVER-651
http://github.com/mongodb/mongo/commit/6adaeeaa85a91cbc160067b0582cea3a1ef5f24a

Generated at Thu Feb 08 02:54:46 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.