<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 02:57:50 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-1719] mongos process died with splitIfShould failed: medianKey command failed</title>
                <link>https://jira.mongodb.org/browse/SERVER-1719</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Problem:&lt;br/&gt;
Running a multi-shard system (2 shards, 2 members). After loading data, I wanted to drop the daya in the collection&lt;/p&gt;

&lt;p&gt;&amp;gt; use scaleout&lt;br/&gt;
switched to db scaleout&lt;br/&gt;
&amp;gt; db.blogs.drop()&lt;br/&gt;
true&lt;/p&gt;

&lt;p&gt;When I tries to re-connect to the mongos I got the following&lt;/p&gt;

&lt;p&gt;vero:scripts$ ../../software/mongodb-osx-x86_64-1.6.0/bin/mongo --port 27500 -host ec2-184-73-98-241.compute-1.amazonaws.com&lt;br/&gt;
MongoDB shell version: 1.6.0&lt;br/&gt;
connecting to: ec2-184-73-98-241.compute-1.amazonaws.com:27500/test&lt;br/&gt;
Wed Sep  1 14:10:32 Error: couldn&apos;t connect to server ec2-184-73-98-241.compute-1.amazonaws.com:27500} (anon):1139&lt;br/&gt;
exception: connect failed&lt;/p&gt;

&lt;p&gt;Looking at the node running mongos, the process was no longer running. I saw the following in the logs&lt;/p&gt;

&lt;p&gt;ed Sep  1 21:01:10 &lt;span class=&quot;error&quot;&gt;&amp;#91;WriteBackListener&amp;#93;&lt;/span&gt; config change: { _id: &quot;ip-10-196-174-191-2010-09-01T21:01:10-25&quot;, server: &quot;ip-10-196-174-191&quot;, time: new Date(1283374870915), what: &quot;split&quot;, ns: &quot;scaleout.blogs&quot;, details: { before: { min: &lt;/p&gt;
{ ts: 26140129 }
&lt;p&gt;, max: &lt;/p&gt;
{ ts: 30278795 }
&lt;p&gt; }, left: { min: &lt;/p&gt;
{ ts: 26140129 }
&lt;p&gt;, max: &lt;/p&gt;
{ ts: 27936982 }
&lt;p&gt; }, right: { min: &lt;/p&gt;
{ ts: 27936982 }
&lt;p&gt;, max: &lt;/p&gt;
{ ts: 30278795 }
&lt;p&gt; } } }&lt;br/&gt;
Wed Sep  1 21:04:23 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn2&amp;#93;&lt;/span&gt; DROP: scaleout.blogs&lt;br/&gt;
Wed Sep  1 21:04:23 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn2&amp;#93;&lt;/span&gt; config change: { _id: &quot;ip-10-196-174-191-2010-09-01T21:04:23-26&quot;, server: &quot;ip-10-196-174-191&quot;, time: new Date(1283375063464), what: &quot;dropCollection.start&quot;, ns: &quot;scaleout.blogs&quot;, details: {} }&lt;br/&gt;
Wed Sep  1 21:06:01 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn2&amp;#93;&lt;/span&gt; config change: { _id: &quot;ip-10-196-174-191-2010-09-01T21:06:01-27&quot;, server: &quot;ip-10-196-174-191&quot;, time: new Date(1283375161378), what: &quot;dropCollection&quot;, ns: &quot;scaleout.blogs&quot;, details: {} }&lt;br/&gt;
Wed Sep  1 21:06:01 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn8&amp;#93;&lt;/span&gt; ChunkManager: couldn&apos;t find chunk for: &lt;/p&gt;
{ ts: 26631861 }
&lt;p&gt; going to retry&lt;br/&gt;
Wed Sep  1 21:06:01 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn8&amp;#93;&lt;/span&gt; DBException in process: couldn&apos;t find a chunk aftry retry which should be impossible extracted: &lt;/p&gt;
{ ts: 26631861 }
&lt;p&gt;Wed Sep  1 21:06:01 &lt;span class=&quot;error&quot;&gt;&amp;#91;WriteBackListener&amp;#93;&lt;/span&gt; ~ScopedDBConnection: _conn != null&lt;br/&gt;
Wed Sep  1 21:06:01 &lt;span class=&quot;error&quot;&gt;&amp;#91;WriteBackListener&amp;#93;&lt;/span&gt; ERROR: splitIfShould failed: medianKey command failed: { errmsg: &quot;no index found for specified keyPattern: &lt;/p&gt;
{ ts: 1.0 }
&lt;p&gt;&quot;, ok: 0.0 }&lt;/p&gt;

&lt;p&gt;Log from shard000&lt;br/&gt;
Wed Sep  1 20:57:31 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn3&amp;#93;&lt;/span&gt; query admin.$cmd ntoreturn:1 command: &lt;/p&gt;
{ serverStatus: 1 }
&lt;p&gt; reslen:856 109ms&lt;br/&gt;
Wed Sep  1 21:07:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;rs_sync&amp;#93;&lt;/span&gt; CMD: drop scaleout.blogs&lt;br/&gt;
Wed Sep  1 21:07:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;rs_sync&amp;#93;&lt;/span&gt; building new index on &lt;/p&gt;
{ _id: 1 }
&lt;p&gt; for scaleout.blogs&lt;br/&gt;
Wed Sep  1 21:07:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;rs_sync&amp;#93;&lt;/span&gt; Buildindex scaleout.blogs idxNo:0 { name: &quot;&lt;em&gt;id&lt;/em&gt;&quot;, ns: &quot;scaleout.blogs&quot;, key: &lt;/p&gt;
{ _id: 1 }
&lt;p&gt; }&lt;br/&gt;
Wed Sep  1 21:07:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;rs_sync&amp;#93;&lt;/span&gt; done for 0 records 0secs&lt;br/&gt;
Wed Sep  1 21:10:41 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn3&amp;#93;&lt;/span&gt; end connection 127.0.0.1:42059&lt;/p&gt;

&lt;p&gt;Log from shard001&lt;br/&gt;
Wed Sep  1 20:50:17 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn5&amp;#93;&lt;/span&gt; query admin.$cmd ntoreturn:1 command: &lt;/p&gt;
{ serverStatus: 1 }
&lt;p&gt; reslen:856 443ms&lt;br/&gt;
Wed Sep  1 20:52:17 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn5&amp;#93;&lt;/span&gt; query admin.$cmd ntoreturn:1 command: &lt;/p&gt;
{ serverStatus: 1 }
&lt;p&gt; reslen:856 121ms&lt;br/&gt;
Wed Sep  1 20:58:35 allocating new datafile /var/lib/mongodb/replset1/scaleout.7, filling with zeroes...&lt;br/&gt;
Wed Sep  1 20:58:35 done allocating datafile /var/lib/mongodb/replset1/scaleout.7, size: 2047MB,  took 0.01 secs&lt;br/&gt;
Wed Sep  1 20:59:17 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn5&amp;#93;&lt;/span&gt; query admin.$cmd ntoreturn:1 command: &lt;/p&gt;
{ serverStatus: 1 }
&lt;p&gt; reslen:856 126ms&lt;br/&gt;
Wed Sep  1 21:05:59 &lt;span class=&quot;error&quot;&gt;&amp;#91;rs_sync&amp;#93;&lt;/span&gt; CMD: drop scaleout.blogs&lt;br/&gt;
Wed Sep  1 21:11:14 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn5&amp;#93;&lt;/span&gt; end connection 127.0.0.1:43086&lt;/p&gt;



&lt;p&gt;Reproduce:&lt;br/&gt;
This is what I did&lt;br/&gt;
&amp;#8211; loaded both shards with data&lt;br/&gt;
&amp;#8211; performed the db.blogs.drop()&lt;/p&gt;

&lt;p&gt;Does not look like an out of disk space problem.&lt;/p&gt;

&lt;p&gt;Workaround:&lt;br/&gt;
Restart mongos&lt;/p&gt;

&lt;p&gt;Business Case:&lt;br/&gt;
Reliability&lt;/p&gt;</description>
                <environment>ec2 / ubuntu</environment>
        <key id="12982">SERVER-1719</key>
            <summary>mongos process died with splitIfShould failed: medianKey command failed</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="4" iconUrl="https://jira.mongodb.org/images/icons/priorities/minor.svg">Minor - P4</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="5">Cannot Reproduce</resolution>
                                        <assignee username="eliot">Eliot Horowitz</assignee>
                                    <reporter username="alvin">Alvin Richards</reporter>
                        <labels>
                    </labels>
                <created>Wed, 1 Sep 2010 21:24:34 +0000</created>
                <updated>Fri, 30 Mar 2012 14:37:05 +0000</updated>
                            <resolved>Mon, 13 Sep 2010 19:24:09 +0000</resolved>
                                    <version>1.6.1</version>
                                                                        <votes>0</votes>
                                    <watches>0</watches>
                                                                                                                <comments>
                            <comment id="18106" author="eliot" created="Mon, 13 Sep 2010 19:24:09 +0000"  >&lt;p&gt;The mechanism changed a bit - so finding this exact is going to be impossible.&lt;br/&gt;
Added more tests for new mechanism&lt;/p&gt;</comment>
                            <comment id="17704" author="eliot" created="Thu, 2 Sep 2010 15:37:21 +0000"  >&lt;p&gt;Its probably a concurrency issue with the order of doing a drop&lt;/p&gt;</comment>
                            <comment id="17688" author="alvin" created="Thu, 2 Sep 2010 06:38:20 +0000"  >&lt;p&gt;I tried a basic repro and it did not repro. Any clues from the code that make indicate what tickled this?&lt;/p&gt;</comment>
                            <comment id="17686" author="eliot" created="Thu, 2 Sep 2010 05:07:44 +0000"  >&lt;p&gt;Can you make a js test?&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>4.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 2 Sep 2010 05:07:44 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        13 years, 23 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            13 years, 23 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>alvin</customfieldvalue>
            <customfieldvalue>eliot</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrpg27:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrij1r:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>21738</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht0cdj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>