<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:22:10 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-10065] Simultaneous ReplicaSet Failure Possibly Due to MapReduce</title>
                <link>https://jira.mongodb.org/browse/SERVER-10065</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I&apos;m not entirely sure what happens. I am including the relevant logs and minidump files that were generated in hopes that you can extrapolate what was the cause. There were a set of simultaneous exceptions that caused both servers in the replica set to fail.&lt;/p&gt;

&lt;p&gt;I can provide more background information as is helpful.&lt;/p&gt;</description>
                <environment>Both servers Windows Server 2008 R2&lt;br/&gt;
4 GB of RAM&lt;br/&gt;
Xeon X3450 2.67GHz</environment>
        <key id="80804">SERVER-10065</key>
            <summary>Simultaneous ReplicaSet Failure Possibly Due to MapReduce</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="adam.kirkton">Adam Kirkton</reporter>
                        <labels>
                    </labels>
                <created>Sun, 30 Jun 2013 04:02:27 +0000</created>
                <updated>Mon, 11 Jul 2016 17:38:48 +0000</updated>
                            <resolved>Mon, 29 Jul 2013 06:42:37 +0000</resolved>
                                    <version>2.4.4</version>
                                                    <component>JavaScript</component>
                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="390733" author="stennie" created="Mon, 29 Jul 2013 06:42:37 +0000"  >&lt;p&gt;Hi Adam,&lt;/p&gt;

&lt;p&gt;Given your Map/Reduce jobs have been successfully running for about six months without issue, it seems unlikely that they would be related to the recent memory access violations.  In particular, the EXCEPTION_IN_PAGE_ERROR as noted by Tad earlier usually indicates a hardware issue.&lt;/p&gt;

&lt;p&gt;It sounds like the errors are affecting all the data nodes in your replica set?  With your case of potential data storage problems you should ideally try to &lt;a href=&quot;http://docs.mongodb.org/manual/tutorial/resync-replica-set-member/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Resync from a known good member of a replica set&lt;/a&gt; rather than repairing a node and potentially introducing some inconsistency.&lt;/p&gt;

&lt;p&gt;If you haven&apos;t done a repair yet, I would suggest first running &lt;a href=&quot;http://docs.mongodb.org/manual/reference/method/db.collection.validate/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;db.collection.validate(true)&lt;/a&gt; on the collection(s) used by your Map/Reduce jobs.  This will report if there are obvious data structure errors in the collections.  It&apos;s worth noting that a validate(true) can be resource intensive as it has to scan the collection and objects; you would ideally want to run this during an offpeak or maintenance window.&lt;/p&gt;

&lt;p&gt;Per your suggestion, I&apos;m going to close this issue as there does not appear to be anything further to investigate at this time.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Stephen&lt;/p&gt;</comment>
                            <comment id="381185" author="adam.kirkton" created="Mon, 15 Jul 2013 12:12:21 +0000"  >&lt;p&gt;Thanks for the information. There isn&apos;t anything in the event log unfortunately other than the services restarting. I am planning on upgrading to 2.4.5 soon and running the reports again. I will also look into doing a repair run on my db in case there is some corruption. Would sharing the map reduce logic I have help at all with regards to the access violations? These particular map/reduce processes had been running for about six months once an hour before they just started dying. So it&apos;s probably related to the other problem, but there may not be a good way to tell. If there&apos;s nothing else, you can go ahead and close the ticket.&lt;/p&gt;</comment>
                            <comment id="380753" author="tad" created="Sun, 14 Jul 2013 11:59:23 +0000"  >&lt;p&gt;The stack traces in the logs show access violations while calling mongo::Scope::loadStored() and EXCEPTION_IN_PAGE_ERROR while calling mongo::PageFaultException::touch().&lt;/p&gt;

&lt;p&gt;Access violations are caused by referencing memory that is not mapped for the reference type (e.g. read or write) and usually indicate a program logic error.&lt;/p&gt;

&lt;p&gt;EXCEPTION_IN_PAGE_ERROR (exception 0xC0000006) is caused by a failure to load a properly referenced memory location, and usually indicates a hardware issue; a disk failure if reading directly from a local disk drive or a network error if reading over the network.&lt;/p&gt;

&lt;p&gt;Can you check the Windows event log to see if there is a hardware event recorded that matches the time of the failures?&lt;/p&gt;

&lt;p&gt;The EXCEPTION_IN_PAGE_ERROR (exception 0xC0000006) failures happened on db01 at:&lt;br/&gt;
Sat Jun 29 22:21:59.398 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn173662&amp;#93;&lt;/span&gt; *** unhandled exception 0xC0000006 at 0x000000013FD302D4, terminating&lt;br/&gt;
Sat Jun 29 22:41:33.704 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn23&amp;#93;&lt;/span&gt; *** unhandled exception 0xC0000006 at 0x00000001400C02D4, terminating&lt;/p&gt;

&lt;p&gt;The access violations suggest possible corruption in the database, at least as seen by the running mongod.exe; this may be related to (e.g. caused by) the hardware failure that produced the EXCEPTION_IN_PAGE_ERRORs.&lt;/p&gt;</comment>
                            <comment id="370959" author="adam.kirkton" created="Sun, 30 Jun 2013 04:06:24 +0000"  >&lt;p&gt;Second database server mini dump file&lt;/p&gt;</comment>
                            <comment id="370958" author="adam.kirkton" created="Sun, 30 Jun 2013 04:05:58 +0000"  >&lt;p&gt;Second database server log file&lt;/p&gt;</comment>
                            <comment id="370956" author="adam.kirkton" created="Sun, 30 Jun 2013 04:04:52 +0000"  >&lt;p&gt;Dump file from server 1. For restart that happened at 10:41 PM EDT based on file date.&lt;/p&gt;</comment>
                            <comment id="370955" author="adam.kirkton" created="Sun, 30 Jun 2013 04:03:38 +0000"  >&lt;p&gt;Log file from server 1&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="28463" name="db01.dmp" size="841799" author="adam.kirkton" created="Sun, 30 Jun 2013 04:04:52 +0000"/>
                            <attachment id="28462" name="db01.txt" size="32715" author="adam.kirkton" created="Sun, 30 Jun 2013 04:03:38 +0000"/>
                            <attachment id="28465" name="db02.dmp" size="437399" author="adam.kirkton" created="Sun, 30 Jun 2013 04:06:24 +0000"/>
                            <attachment id="28464" name="db02.txt" size="79736" author="adam.kirkton" created="Sun, 30 Jun 2013 04:05:58 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Sun, 14 Jul 2013 11:59:23 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        10 years, 29 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            10 years, 29 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10022"><![CDATA[Windows]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>adam.kirkton</customfieldvalue>
            <customfieldvalue>stephen.steneker@mongodb.com</customfieldvalue>
            <customfieldvalue>tad</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrmomv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrrfan:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>73862</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrlg5b:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>