<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:06:20 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-24431] collection lock not release for mongod failure</title>
                <link>https://jira.mongodb.org/browse/SERVER-24431</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I found a few entries that were similar to this but not quite the same.&lt;/p&gt;

&lt;p&gt;Configuration:&lt;br/&gt;
5 shards&lt;br/&gt;
3 config&lt;br/&gt;
1 mongos&lt;/p&gt;

&lt;p&gt;A user had a runaway process that was insert way too many documents into a collection. Everything was working properly until we ran out of disk space on one of the shards. When the mongod instance on the shard went down it held a collection lock for migration. After freeing some disk space and restarting the mongod instance, sh.status() indicated that the balancer was running but chunks were not being migrated.&lt;/p&gt;

&lt;p&gt;After doing some reading and searching, it appeared that the problem was related to the locks. When I looked at the locks in the config database, I found that there were two locks were being held (state = 2). One on the balancer and one on a collection. The description on the collection lock, indicated that it was holding a migration lock by the shard that went down. After setting the lock state to 0 for both of these entries the balancer resumed normal operations and started to migrate chunks. I may have had to restart the mongod or some of the shards but I am not sure.&lt;/p&gt;

&lt;p&gt;Seems like there should be some sort of recovery for a condition when a shard fails and is holding a lock.&lt;/p&gt;</description>
                <environment></environment>
        <key id="292040">SERVER-24431</key>
            <summary>collection lock not release for mongod failure</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="kelsey.schubert@mongodb.com">Kelsey Schubert</assignee>
                                    <reporter username="bmwmaestoso">bob whitehurst</reporter>
                        <labels>
                    </labels>
                <created>Tue, 7 Jun 2016 13:34:03 +0000</created>
                <updated>Mon, 8 Aug 2016 15:54:53 +0000</updated>
                            <resolved>Mon, 8 Aug 2016 15:54:46 +0000</resolved>
                                    <version>3.0.4</version>
                                                    <component>Sharding</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="1350252" author="thomas.schubert" created="Mon, 8 Aug 2016 15:54:30 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=bmwmaestoso&quot; class=&quot;user-hover&quot; rel=&quot;bmwmaestoso&quot;&gt;bmwmaestoso&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for your patience; I was unlucky during my first reproduction attempts that the kill signal occurred without a migration lock. I have reproduced this issue and identified that this issue is currently tracked in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-8840&quot; title=&quot;Release distributed locks if shard shuts itself down during a migration&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-8840&quot;&gt;&lt;del&gt;SERVER-8840&lt;/del&gt;&lt;/a&gt;. Please note that after 15 minutes these locks should be released and no additional workaround is required. Feel free to vote for &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-8840&quot; title=&quot;Release distributed locks if shard shuts itself down during a migration&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-8840&quot;&gt;&lt;del&gt;SERVER-8840&lt;/del&gt;&lt;/a&gt; and watch it for updates.&lt;/p&gt;

&lt;p&gt;Thanks again,&lt;br/&gt;
Thomas&lt;/p&gt;</comment>
                            <comment id="1306919" author="bmwmaestoso" created="Mon, 27 Jun 2016 01:43:56 +0000"  >&lt;p&gt;Trying to get logs out of our environment is impossible as this is a secure government facility. It would require a whole review process. If I can manually copy the data as long as it isn&apos;t overwhelming. Regardless, I don&apos;t have these log anymore. I don&apos;t have a problem if you can&apos;t recreate the issue. I know what to check for now and I know how t fix the problem. It would just be nice if it didn&apos;t happen.&lt;/p&gt;

&lt;p&gt;Seems like you create the condition manually and then see what happen when you start a shard. This condition could happen at any time any action that might bring down the process without performing any kind of controlled shutdown. These conditions could due to loss of power, OOM condition, or a SIGSEGV.&lt;/p&gt;</comment>
                            <comment id="1298612" author="thomas.schubert" created="Fri, 17 Jun 2016 22:45:24 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=bmwmaestoso&quot; class=&quot;user-hover&quot; rel=&quot;bmwmaestoso&quot;&gt;bmwmaestoso&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thanks for reporting this issue. Unfortunately, I haven&apos;t been able to reproduce this issue yet. To help our investigation, would you please attach the logs of the shard when it ran out of disk space?&lt;/p&gt;

&lt;p&gt;Thank you,&lt;br/&gt;
Thomas&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="67217">SERVER-8840</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 17 Jun 2016 22:45:24 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        7 years, 27 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            7 years, 27 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>bmwmaestoso</customfieldvalue>
            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrk6d3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hsm7q7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[kelsey.schubert@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsew9b:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>