[SERVER-5742] bigMapReduce.js failing b/c of migrate deletion during m/r Created: 01/May/12 Updated: 11/Jul/16 Resolved: 06/Jun/12 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | MapReduce |
| Affects Version/s: | None |
| Fix Version/s: | 2.1.2 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Greg Studer | Assignee: | Greg Studer |
| Resolution: | Done | Votes: | 0 |
| Labels: | buildbot | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Operating System: | ALL |
| Participants: |
| Description |
|
Clearest failure is here: http://buildbot.mongodb.org/builders/Linux%20RHEL%2032-bit/builds/375/steps/test/logs/stdio/text |
| Comments |
| Comment by Greg Studer [ 06/Jun/12 ] | ||||||||||||||||||||||||||||
|
should be okay - batchsize not applicable and the cursor won't do any work since it's not used except as a placeholder. | ||||||||||||||||||||||||||||
| Comment by Greg Studer [ 03/May/12 ] | ||||||||||||||||||||||||||||
|
Reopening b/c want to verify that the cursor we open is actually very low-cost - change batchsize if necessary. | ||||||||||||||||||||||||||||
| Comment by auto [ 02/May/12 ] | ||||||||||||||||||||||||||||
|
Author: {u'login': u'gregstuder', u'name': u'gregs', u'email': u'greg@10gen.com'}Message: Later cursor does not prevent cleanup. | ||||||||||||||||||||||||||||
| Comment by Greg Studer [ 01/May/12 ] | ||||||||||||||||||||||||||||
|
Problem is that the cursor we open to prevent migration deletions in the initial mapReduce step is removed when the M/R cursor is opened. If a migration completes before the second cursor is initialized (which, on the RH build machines takes a long time), the migration data will not be protected. The initial cursor is opened before any of the potentially costly temporary collection creations and deletions, so that a StaleConfigException is thrown early and retries can occur if needed for a consistent view of data across the cluster. | ||||||||||||||||||||||||||||
| Comment by Andy Schwerin [ 01/May/12 ] | ||||||||||||||||||||||||||||
|
More details, for posterity, Greg? | ||||||||||||||||||||||||||||
| Comment by Greg Studer [ 01/May/12 ] | ||||||||||||||||||||||||||||
|
Core issue is this:
|