[SERVER-8547] Mongo crash Created: 13/Feb/13 Updated: 10/Dec/14 Resolved: 28/Oct/13 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Stability |
| Affects Version/s: | 2.2.2 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Ipsy | Assignee: | Unassigned |
| Resolution: | Incomplete | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Environment: |
EC2 XL Linux instance |
||
| Attachments: |
|
| Operating System: | Linux |
| Participants: |
| Description |
|
We've experienced several crashes of our production mongod. The server is under reasonable load, with queries backed by indices and no long running queries. Here's one of the crashes: In case it's relevant, we have 3 replication instances: a primary, a secondary, and an arbiter, all within the same ec2 zone. |
| Comments |
| Comment by Stennie Steneker (Inactive) [ 28/Oct/13 ] | |
|
Hi Ipsy, FYI, objcheck functionality is now enabled by default as of MongoDB 2.4. I'm closing this issue as there is nothing further for us to investigate at this time. If you are still seeing this issue (particularly with a newer version of MongoDB, such as 2.4.x) please feel free to open a new issue or comment on this one with the relevant details including logs as well as server and driver versions. Thanks, | |
| Comment by Aaron Staple [ 27/Feb/13 ] | |
|
I can't give you precise numbers, but objcheck will do a sanity check of bson sent to mongo, including bson contained in queries and documents to be inserted. This may affect operation latency and server cpu usage. One possibility is that only a fraction of bad bson causes crashes so there's a chance you might not have to wait weeks to see a failure reported. Would it be possible to try out objcheck and see if you can live with the performance? | |
| Comment by Ipsy [ 27/Feb/13 ] | |
|
We've only had a few of these crashes, weeks apart. So it would have to stay in production for a while before we could reproduce. What is the expected performance impact of --objcheck? Thanks. | |
| Comment by Aaron Staple [ 27/Feb/13 ] | |
|
Hi Ipsy, How frequently are you seeing these failures? To help us diagnose the issue, would it be possible for you to run mongod with the --objcheck option and tell us if you see messages such as the following in the log:
| |
| Comment by Ipsy [ 25/Feb/13 ] | |
Thanks! | |
| Comment by Ipsy [ 25/Feb/13 ] | |
|
mongo log snippet | |
| Comment by Aaron Staple [ 25/Feb/13 ] | |
|
Hi Ipsy, To help us diagnose the issue:
Thanks |