<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:12:21 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-6668] Mongos crashes consistently under high load for various reasons</title>
                <link>https://jira.mongodb.org/browse/SERVER-6668</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Mongos consistently crashes under high loads (~2500 concurrent requests). This is easily reproducible on our system. Stack traces and logs at links below.&lt;/p&gt;

&lt;p&gt;1) First crash stack traces, two out of three mongos died at the same time. &lt;br/&gt;
&lt;a href=&quot;https://gist.github.com/a70ccfbdd5e58430f68c&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://gist.github.com/a70ccfbdd5e58430f68c&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;2) mongos log: &lt;a href=&quot;http://sprunge.us/OEiU&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://sprunge.us/OEiU&lt;/a&gt; - we noticed in this one: &quot;ERROR: Out of file descriptors. Waiting one second before trying to accept more connections.&quot; So we increased the file descriptors and that one went away for now. Regardless, mongos should not crash like this. &lt;/p&gt;

&lt;p&gt;Somewhere in here, we increased the number of mongos from 3 to 12 and it seemed to work a bit better, but still easy to make it crash. &lt;/p&gt;

&lt;p&gt;3) And this just goes on and on, we&apos;ll restart them and easily kill them with a bit of load. &lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;http://sprunge.us/IfUR&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://sprunge.us/IfUR&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;http://sprunge.us/gFSS&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://sprunge.us/gFSS&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;http://sprunge.us/dLCj&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://sprunge.us/dLCj&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;http://sprunge.us/XSOb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://sprunge.us/XSOb&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;http://sprunge.us/TZZD&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://sprunge.us/TZZD&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;http://sprunge.us/ZNUO&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://sprunge.us/ZNUO&lt;/a&gt;&lt;/p&gt;</description>
                <environment>Ubuntu 12.04, aws, m1.xlarge instance types</environment>
        <key id="45885">SERVER-6668</key>
            <summary>Mongos crashes consistently under high load for various reasons</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="1" iconUrl="https://jira.mongodb.org/images/icons/priorities/blocker.svg">Blocker - P1</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="5">Cannot Reproduce</resolution>
                                        <assignee username="asya.kamsky@mongodb.com">Asya Kamsky</assignee>
                                    <reporter username="treeder">Travis Reeder</reporter>
                        <labels>
                            <label>crash</label>
                            <label>failure</label>
                            <label>linux</label>
                            <label>mongos</label>
                            <label>sharding</label>
                    </labels>
                <created>Tue, 31 Jul 2012 19:01:49 +0000</created>
                <updated>Fri, 8 Mar 2013 15:55:35 +0000</updated>
                            <resolved>Fri, 31 Aug 2012 19:01:20 +0000</resolved>
                                    <version>2.0.6</version>
                                                    <component>Sharding</component>
                                        <votes>1</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="150940" author="asya" created="Mon, 6 Aug 2012 23:37:53 +0000"  >&lt;p&gt;Are you still seeing this problem with larger number of mongos processes?  I haven&apos;t been able to reproduce the behavior you&apos;re seeing.&lt;/p&gt;</comment>
                            <comment id="149321" author="eliot" created="Wed, 1 Aug 2012 01:20:27 +0000"  >&lt;p&gt;That should be enough - but unlimited would be better, and doesn&apos;t cause issues.&lt;/p&gt;</comment>
                            <comment id="149217" author="treeder" created="Tue, 31 Jul 2012 22:28:29 +0000"  >&lt;p&gt;mongodb@ip-10-115-87-10:/home/ubuntu$ ulimit -a&lt;br/&gt;
core file size          (blocks, -c) 0&lt;br/&gt;
data seg size           (kbytes, -d) unlimited&lt;br/&gt;
scheduling priority             (-e) 0&lt;br/&gt;
file size               (blocks, -f) unlimited&lt;br/&gt;
pending signals                 (-i) 55459&lt;br/&gt;
max locked memory       (kbytes, -l) 64&lt;br/&gt;
max memory size         (kbytes, -m) unlimited&lt;br/&gt;
open files                      (-n) 65535&lt;br/&gt;
pipe size            (512 bytes, -p) 8&lt;br/&gt;
POSIX message queues     (bytes, -q) 819200&lt;br/&gt;
real-time priority              (-r) 0&lt;br/&gt;
stack size              (kbytes, -s) 8192&lt;br/&gt;
cpu time               (seconds, -t) unlimited&lt;br/&gt;
max user processes              (-u) 55459&lt;br/&gt;
virtual memory          (kbytes, -v) unlimited&lt;br/&gt;
file locks                      (-x) unlimited&lt;/p&gt;</comment>
                            <comment id="149171" author="treeder" created="Tue, 31 Jul 2012 19:50:18 +0000"  >&lt;p&gt;We increased them to 65535. Is that sufficient?&lt;/p&gt;</comment>
                            <comment id="149169" author="eliot" created="Tue, 31 Jul 2012 19:45:46 +0000"  >&lt;p&gt;What are the file descriptor and process limits?&lt;br/&gt;
Looks like they might be too low.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 31 Jul 2012 19:45:46 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        11 years, 28 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            11 years, 28 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>asya.kamsky@mongodb.com</customfieldvalue>
            <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>treeder</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrnt3b:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrg4en:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7618</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht05nr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>