[SERVER-30072] Fatal error in replicaset index builder Created: 10/Jul/17 Updated: 20/Sep/17 Resolved: 28/Aug/17 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Usability |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Chad Kreimendahl | Assignee: | Kelsey Schubert |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Operating System: | ALL |
| Steps To Reproduce: | While running several copyDatabase functions concurrently, the error occured. Only currently verified to impact 3.4.6 on linux |
| Participants: |
| Description |
|
| Comments |
| Comment by Kelsey Schubert [ 19/Jul/17 ] |
|
Hi sallgeud, Sorry for the delay getting back to you. From the log files, I can see that these crashes are the result of hitting a "Too many open files" system limit. We're aware that these replica sets may have hundreds of thousands of active data handles, as a result, unfortunately, this type of error is not unexpected. As you're aware, we have work scheduled to reduce the number of open files required for your schema and workload. For now, I would recommend reconfirming that your ulimits are appropriately set. Kind regards, |
| Comment by Chad Kreimendahl [ 19/Jul/17 ] |
|
Uploaded. It happened in 3.4.5 for us in the previous few days, so I've uploaded the 3.4.5 logs as well. |
| Comment by Chad Kreimendahl [ 10/Jul/17 ] |
|
Oops.. nm. See it now |
| Comment by Chad Kreimendahl [ 10/Jul/17 ] |
|
Sure. Send me over the secure upload Link |
| Comment by Kelsey Schubert [ 10/Jul/17 ] |
|
Additionally, would you please provide the diagnostic.data, as that may help us rule out some other theories that would explain this behavior. Thanks again, |
| Comment by Kelsey Schubert [ 10/Jul/17 ] |
|
Hi sallgeud, Thanks for the report, to help us investigate would you please upload the complete log file that includes the fassert? I've created a secure upload portal for you to use. Kind regards, |