<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:17:02 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-28066] Sharding on GridFS files, all the files ends up on the same shard</title>
                <link>https://jira.mongodb.org/browse/SERVER-28066</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi !&lt;/p&gt;

&lt;p&gt;We have a collection that contains files (and a lot of them) that have sharding enabled on it on the following indexes:&lt;/p&gt;

&lt;p&gt;fs.chunks : &lt;/p&gt;
{file_id : 1, n: 1}

&lt;p&gt;The files in it are ~15.27mb and when I run fs.chunks.getShardDistribution() I&apos;m getting : &lt;/p&gt;

&lt;p&gt;Shard shard0000 at server1:27018&lt;br/&gt;
 data : 11.84GiB docs : 48997 chunks : 97634&lt;br/&gt;
 estimated data per chunk : 127KiB&lt;br/&gt;
 estimated docs per chunk : 0&lt;/p&gt;

&lt;p&gt;Shard shard0001 at server2:27018&lt;br/&gt;
 data : 12.51GiB docs : 51791 chunks : 97633&lt;br/&gt;
 estimated data per chunk : 134KiB&lt;br/&gt;
 estimated docs per chunk : 0&lt;/p&gt;

&lt;p&gt;Shard shard0002 at server3:27018&lt;br/&gt;
 data : 5647.85GiB docs : 23407469 chunks : 97633&lt;br/&gt;
 estimated data per chunk : 59.23MiB&lt;br/&gt;
 estimated docs per chunk : 239&lt;/p&gt;

&lt;p&gt;Totals&lt;br/&gt;
 data : 5672.22GiB docs : 23508257 chunks : 292900&lt;br/&gt;
 Shard shard0000 contains 0.2% data, 0.2% docs in cluster, avg obj size on shard : 253KiB&lt;br/&gt;
 Shard shard0001 contains 0.22% data, 0.22% docs in cluster, avg obj size on shard : 253KiB&lt;br/&gt;
 Shard shard0002 contains 99.57% data, 99.57% docs in cluster, avg obj size on shard : 253KiB&lt;/p&gt;

&lt;p&gt;We&apos;re starting to run out of space on the server that is hosting shad0002 and can&apos;t figure out why the shard aren&apos;t balancing out :S &lt;/p&gt;

&lt;p&gt;In the log we&apos;re seeing error like :&lt;br/&gt;
2017-02-21T18:50:39.563+0000 W SHARDING &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1338&amp;#93;&lt;/span&gt; could not autosplit collection telemetry-fs.fs.chunks :: caused by :: 13333 can&apos;t split a chunk in that many parts&lt;/p&gt;

&lt;p&gt;and  googling it doesn&apos;t give me lot of information &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/sad.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt; &lt;/p&gt;

&lt;p&gt;Is there anything we&apos;re missing there ? &lt;/p&gt;


</description>
                <environment></environment>
        <key id="355959">SERVER-28066</key>
            <summary>Sharding on GridFS files, all the files ends up on the same shard</summary>
                <type id="6" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14720&amp;avatarType=issuetype">Question</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="kelsey.schubert@mongodb.com">Kelsey Schubert</assignee>
                                    <reporter username="smarquis">Stephane Marquis</reporter>
                        <labels>
                    </labels>
                <created>Tue, 21 Feb 2017 18:51:38 +0000</created>
                <updated>Wed, 31 May 2017 21:23:44 +0000</updated>
                            <resolved>Thu, 23 Mar 2017 20:57:36 +0000</resolved>
                                    <version>3.2.10</version>
                                                    <component>Sharding</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="1519105" author="thomas.schubert" created="Wed, 8 Mar 2017 17:33:53 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=smarquis&quot; class=&quot;user-hover&quot; rel=&quot;smarquis&quot;&gt;smarquis&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;The log error you&apos;ve shared indicates that the maximum split points in a chunk, 8192 has been reached. This isn&apos;t a limit to the number of chunks you can end up with, just the number of pieces you can split one chunk into at a time.&lt;/p&gt;

&lt;p&gt;To work around this, you can increase the chunk size from the default 64MB for that collection to something higher, say 128MB or 256 MB. This will reduce the number of pieces that a particular chunk needs to be split into. At a later stage you can then lower the chunk size back to the default 64MB, so that you don&apos;t end up with very large chunks.&lt;/p&gt;

&lt;p&gt;Would you please follow these steps, and let us know if it resolves the issue?&lt;/p&gt;

&lt;p&gt;Thank you,&lt;br/&gt;
Thomas&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                                        </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 21 Feb 2017 19:12:47 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 49 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>backlog-server-pm</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 49 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>
            <customfieldvalue>smarquis</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht2qkn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hsvao7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[kelsey.schubert@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hs4g3z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>