[SERVER-7426] The usePowerOf2Sizes option corrupts the db permanently and unrecoverably Created: 19/Oct/12 Updated: 07/Mar/14 Resolved: 19/Oct/12 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Mark porter | Assignee: | Unassigned |
| Resolution: | Duplicate | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Environment: |
Running mongodb 2.2 on Linux version 2.6.32-5-amd64 (Debian 2.6.32-41), with a pymongo driver vintage early 2012. |
||
| Issue Links: |
|
||||||||||||
| Operating System: | ALL | ||||||||||||
| Participants: | |||||||||||||
| Linked BF Score: | 0 | ||||||||||||
| Description |
|
From MongoDB User Google Group: To improve padding behavior I have added the usePowerOf2Sizes option for a couple of collections: )
|
| Comments |
| Comment by Githook User [ 02/Dec/13 ] |
|
Author: {u'username': u'gregstuder', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}Message: |
| Comment by Mike Cherepov [ 22/Oct/12 ] |
|
Indeed some of the docs in mycoll were busting the 16MB limit after four 5+MB updates; I worked around that, so we are OK for the moment. If your nightly build easily drops into an existing db server installation, I could try that. Otherwise, we could mothball the bug until the next release comes out, whereupon I will test oversized docs and PowerOf2Sizes again. |
| Comment by Tad Marshall [ 19/Oct/12 ] |
|
Testing a non-corrupt copy of your database with a recent nightly build would show whether you have a new bug, distinct from the case that has been fixed. I understand if that is not feasible. Otherwise, steps-to-reproduce would enable us to test this ourselves. |
| Comment by Mike Cherepov [ 19/Oct/12 ] |
|
Mark: We have pymongo-2.1.1_-py2.7-linux-x86_64. Recounting the exact steps to reproduce this would be unhelpful without the whole mass of our code, but I would happily supply necessary details. The collection contains docs of a few MB. Here is the snippet that makes a difference between corruption and absence thereof:
Eliot: Some objects may be getting afoul of the 16MB limit – after removing usePowersOf2Sizes, I saw some Assertions about BSONobj exceeding the limit. Not sure I trust those, though – and didn't this cause mere exceptions pre-2.2.0??. Will investigate the sizes further. |
| Comment by Mark porter [ 19/Oct/12 ] |
|
Linking to |
| Comment by Eliot Horowitz (Inactive) [ 19/Oct/12 ] |