[SERVER-20151] write concern timeout in tags.js should not exceed max sync source lag secs Created: 29/Jun/15 Updated: 25/Jan/17 Resolved: 07/Oct/15 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Replication |
| Affects Version/s: | None |
| Fix Version/s: | 3.1.9 |
| Type: | Bug | Priority: | Minor - P4 |
| Reporter: | Adam Midvidy | Assignee: | Benety Goh |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||
| Operating System: | ALL | ||||||||
| Sprint: | RPL A (10/09/15) | ||||||||
| Participants: | |||||||||
| Linked BF Score: | 0 | ||||||||
| Description |
|
replsets/tags.js was using a timeout for the negative write concern test cases that results in the nodes disconnecting from their sync sources. Here's a sequence of events:
------
Also some weird stuff in the logs like this log line:
and some gibberish logged here
Which looks like it could be some sort of race printing the "ended connection to..." log message. Log: |
| Comments |
| Comment by Githook User [ 07/Oct/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
Author: {u'username': u'benety', u'name': u'Benety Goh', u'email': u'benety@mongodb.com'}Message: | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Githook User [ 07/Oct/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
Author: {u'username': u'benety', u'name': u'Benety Goh', u'email': u'benety@mongodb.com'}Message: | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Matt Dannenberg [ 31/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
The patch was reverted because it broke some rollback tests, which is something we could adapt those tests to handle. However, tags.js manage to fail with the patch present, so this approach is not worth pursuing any further. | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Githook User [ 27/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
Author: {u'username': u'benety', u'name': u'Benety Goh', u'email': u'benety@mongodb.com'}Message: Revert " This reverts commit b53ae44a850d011fb47596637c83d375b5751e55. | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Githook User [ 26/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
Author: {u'username': u'dannenberg', u'name': u'matt dannenberg', u'email': u'matt.dannenberg@10gen.com'}Message: | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Benety Goh [ 26/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
9b054f0032 OS X 10.8 DEBUG replicasets | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Benety Goh [ 26/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
5d76623abc OS X 10.8 DEBUG replicasets_WT https://logkeeper.mongodb.org/build/55dd4dd2be07c47abf9365ab/test/55dd63e2be07c47abf9383c4
| |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Benety Goh [ 26/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
546066e9df OS X 10.8 DEBUG replicasets https://logkeeper.mongodb.org/build/55dcd4b590413011a29151ab/test/55dce663be07c47abf91e14e | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Benety Goh [ 25/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
efa95c72b0 OS X 10.8 DEBUG replicasets_WT https://logkeeper.mongodb.org/build/55dbee0b90413011a28d0698/test/55dc0c7090413011a28d9605
| |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Benety Goh [ 22/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
Not really related other than it's tags.js 6124799c4e Windows 64-bit 2008R2+ DEBUG replicasets_WT https://logkeeper.mongodb.org/build/55d7a92690413011a280a2c7/test/55d7bf39be07c47abf812c9c
| |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Ian Whalen (Inactive) [ 14/Aug/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
ping scotthernandez | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Ian Whalen (Inactive) [ 13/Jul/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
Got it. scotthernandez any ideas then? | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Ernie Hershey [ 13/Jul/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
I don't think it's related because I don't see anything about a ulimit type error. The "bad file descriptor" error usually means something else wrong, like the internal representation of the file handle, or trying to write to a closed socket or things like that. | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Ian Whalen (Inactive) [ 13/Jul/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
ernie.hershey@10gen.com can we just write this off to the ulimit and link it to BUILD-758? | |||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Matt Dannenberg [ 29/Jun/15 ] | |||||||||||||||||||||||||||||||||||||||||||||||
|
Given that this is a file descriptor related failure on OSX, I wonder if this is related to the maximum file descriptors problem. ernie.hershey@10gen.com thoughts? |