<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:42:45 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-57776] Sharded collections becomes inaccessible when it becomes to big</title>
                <link>https://jira.mongodb.org/browse/SERVER-57776</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I have a large sharded (+500TB) collection that right now is inaccessible because of a timeout in the synchronization between MongoC and MongoS.&lt;/p&gt;

&lt;p&gt;Both MongoS and MongoC are run on enterprise class servers with 10Gbit network with &amp;lt;0.1ms latency.&lt;/p&gt;

&lt;p&gt;The Shareded collection has +20 million entries in the config.chunks collection on the MongoC - and the total number of entries in config.chunks collection is +40 million. When the MongoS starts there is a (hardcoded?) limit of 1 min for each collection to sync config.chunks from the MongoC to the MongoS...And if it fails the MongoS will not start at all.&lt;br/&gt;
I have tried to add&#160;loadRoutingTableOnStartup: false to the mongos config and the result is that mongos starts and all other collections are accessible but I am still not able to access the large sharded collection.&lt;/p&gt;



&lt;p&gt;Is there a way to change that timeout in the MongoS?&lt;/p&gt;</description>
                <environment></environment>
        <key id="1788302">SERVER-57776</key>
            <summary>Sharded collections becomes inaccessible when it becomes to big</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="eric.sedor@mongodb.com">Eric Sedor</assignee>
                                    <reporter username="nicolai@niro-it.dk">Nicolai &#216;dum</reporter>
                        <labels>
                    </labels>
                <created>Thu, 17 Jun 2021 13:07:27 +0000</created>
                <updated>Mon, 19 Jul 2021 18:26:57 +0000</updated>
                            <resolved>Mon, 19 Jul 2021 18:26:57 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>6</watches>
                                                                                                                <comments>
                            <comment id="3950249" author="eric.sedor" created="Mon, 19 Jul 2021 18:26:43 +0000"  >&lt;p&gt;Thanks for clarifying &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=nicolai%40niro-it.dk&quot; class=&quot;user-hover&quot; rel=&quot;nicolai@niro-it.dk&quot;&gt;nicolai@niro-it.dk&lt;/a&gt;. We do understand this is sensitive information and appreciate your care. Unfortunately, without logs or diagnostic data, we aren&apos;t able to investigate this report here in the SERVER project. But we will be on the lookout for similar reports. If you do end up able to provide logs showing the mongos startup failure, let us know and we can reopen this ticket.&lt;/p&gt;

&lt;p&gt;Sincerely,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                            <comment id="3944418" author="nicolai@niro-it.dk" created="Thu, 15 Jul 2021 18:50:39 +0000"  >&lt;p&gt;Sorry - I am not able to provide you with un-obfucated logs - I have used &lt;a href=&quot;https://github.com/rueckstiess/fruitsalad&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/rueckstiess/fruitsalad&lt;/a&gt;&#160;but I am not sure if it can handle the new json format.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Regards&lt;/p&gt;

&lt;p&gt;Nicolai&lt;/p&gt;</comment>
                            <comment id="3943829" author="eric.sedor" created="Thu, 15 Jul 2021 15:37:47 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=nicolai%40niro-it.dk&quot; class=&quot;user-hover&quot; rel=&quot;nicolai@niro-it.dk&quot;&gt;nicolai@niro-it.dk&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Are you able to provide un-obfuscated logs? We are definitely interested in investigating the details of what you&apos;re reporting.&lt;/p&gt;

&lt;p&gt;Sincerely,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                            <comment id="3906251" author="eric.sedor" created="Mon, 28 Jun 2021 21:29:46 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=nicolai%40niro-it.dk&quot; class=&quot;user-hover&quot; rel=&quot;nicolai@niro-it.dk&quot;&gt;nicolai@niro-it.dk&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;It looks like the logs have been fully obfuscated. Are you at all able to provide either partially obfuscated or un-redacted versions of these logs to the same &lt;a href=&quot;https://amphora.corp.mongodb.com/public/upload/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJmb2xkZXJfaWQiOiIxMzk0MDAzMTg2MDMiLCJleHAiOjE2MjY1MzcwMDh9.LHssf4Od5M1SvLjFYPx2bbTe1JAl18ZUdUoRWadTFwQ&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;upload portal&lt;/a&gt;? To clarify, files uploaded here will only be visible to MongoDB employees actively involved in this investigation.&lt;/p&gt;

&lt;p&gt;If that&apos;s not possible, could you provide manually redacted lines that preserve the system-related information in each line? We&apos;re particularly interested in the log messages that are occurring on the mongos and config server primary at the time the mongos is failing to start. &lt;/p&gt;

&lt;p&gt;Gratefully,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                            <comment id="3886506" author="nicolai@niro-it.dk" created="Fri, 18 Jun 2021 08:24:48 +0000"  >&lt;p&gt;I have uploaded mongos and a mongoc log. Because of company policy I am not able to upload binary files.&#160;&lt;/p&gt;</comment>
                            <comment id="3886496" author="nicolai@niro-it.dk" created="Fri, 18 Jun 2021 08:12:17 +0000"  >&lt;p&gt;OS: CentOS Linux release 7.9.2009&lt;/p&gt;

&lt;p&gt;MongoDB --version&lt;/p&gt;

&lt;p&gt;Build Info: {&lt;br/&gt;
 &quot;version&quot;: &quot;4.4.6&quot;,&lt;br/&gt;
 &quot;gitVersion&quot;: &quot;72e66213c2c3eab37d9358d5e78ad7f5c1d0d0d7&quot;,&lt;br/&gt;
 &quot;openSSLVersion&quot;: &quot;OpenSSL 1.0.1e-fips 11 Feb 2013&quot;,&lt;br/&gt;
 &quot;modules&quot;: [],&lt;br/&gt;
 &quot;allocator&quot;: &quot;tcmalloc&quot;,&lt;br/&gt;
 &quot;environment&quot;: &lt;/p&gt;
{
 &quot;distmod&quot;: &quot;rhel70&quot;,
 &quot;distarch&quot;: &quot;x86_64&quot;,
 &quot;target_arch&quot;: &quot;x86_64&quot;
 }
&lt;p&gt;}&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="3885065" author="eric.sedor" created="Thu, 17 Jun 2021 15:53:30 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=nicolai%40niro-it.dk&quot; class=&quot;user-hover&quot; rel=&quot;nicolai@niro-it.dk&quot;&gt;nicolai@niro-it.dk&lt;/a&gt;, can you clarify the MongoDB version and provide some additional information?&lt;/p&gt;

&lt;p&gt;I&apos;ve created a secure &lt;a href=&quot;https://amphora.corp.mongodb.com/public/upload/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJmb2xkZXJfaWQiOiIxMzk0MDAzMTg2MDMiLCJleHAiOjE2MjY1MzcwMDh9.LHssf4Od5M1SvLjFYPx2bbTe1JAl18ZUdUoRWadTFwQ&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;upload portal&lt;/a&gt; for you. Files uploaded to this portal are visible only to MongoDB employees and are routinely deleted after some time.&lt;/p&gt;

&lt;p&gt;We&apos;d like information from the following nodes:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;A mongos that has failed to start&lt;/li&gt;
	&lt;li&gt;The primary member of the config server replica set&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;For each of these nodes spanning a time period that includes a failed restart attempt, would you please archive (tar or zip) and upload to that link:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;the mongos/d logs&lt;/li&gt;
	&lt;li&gt;the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory (the contents are described &lt;a href=&quot;https://docs.mongodb.com/manual/administration/analyzing-mongodb-performance/#full-time-diagnostic-data-capture&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;)&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Thank you,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 17 Jun 2021 15:53:30 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        2 years, 29 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>eric.sedor@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            2 years, 29 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>eric.sedor@mongodb.com</customfieldvalue>
            <customfieldvalue>nicolai@niro-it.dk</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hzn2hz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hz7l67:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;Create a sharded setup where the config.chunks collection contains 40 million entries and half of them relates to one single collection.&lt;/p&gt;

&lt;p&gt;Try to start a MongoS&lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[eric.sedor@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hzmor3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>