[SERVER-4018] Add option to compact command to leave in padding. Created: 04/Oct/11 Updated: 27/Oct/15 Resolved: 05/Nov/13 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Performance, Storage |
| Affects Version/s: | None |
| Fix Version/s: | 2.5.4 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Spencer Brody (Inactive) | Assignee: | Matt Dannenberg |
| Resolution: | Done | Votes: | 9 |
| Labels: | compaction, padding | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||
| Participants: | |||||||||||||||||||||
| Description |
|
The compact command cleans up fragmentation but also eliminates any padding factor, which can have a big performance impact if you're doing a lot of writes that grow documents. It would be nice to have an option to compact to make it remove fragmentation while retaining padding. One approach would be to leave the same padding as was there previously (may not be possible if there's no way to distinguish padding from fragmentation), another would be to add the current padding factor to every document, and another would be to let the user specify what padding factor should be added to the documents. |
| Comments |
| Comment by auto [ 04/Nov/13 ] |
|
Author: {u'username': u'dannenberg', u'name': u'matt dannenberg', u'email': u'matt.dannenberg@10gen.com'}Message: |
| Comment by Matt Dannenberg [ 25/Oct/13 ] |
|
for docs: |
| Comment by auto [ 25/Oct/13 ] |
|
Author: {u'username': u'dannenberg', u'name': u'matt dannenberg', u'email': u'matt.dannenberg@10gen.com'}Message: |
| Comment by Daniel Pasette (Inactive) [ 29/Apr/13 ] |
|
This is partially implemented. You can currently choose an absolute number of bytes or a percentage of document size for allocation during compact. However, when usePowerOf2Sizes is set on a collection, compact should preserve powerOf2Sizes allocation strategy during compaction itself. |
| Comment by James Blackburn [ 15/Jan/13 ] |
|
Isn't this fixed: the compact command apparently now takes a paddingFactor option: |
| Comment by James Peter [ 12/Oct/11 ] |
|
+1 I recently ran out of disc space on a few nodes, so increased the size of the cluster, but there's now no way to recover that extra data from the moved chunks unless I get rid of the padding factor on those nodes (which is undesirable). |