<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:10:03 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-5849] Miessage max size limit</title>
                <link>https://jira.mongodb.org/browse/SERVER-5849</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;playing with mongo and sending big bulks insert commands, I get the error &lt;/p&gt;
&lt;blockquote&gt;&lt;p&gt;&quot;Wed May 16 11:59:01 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn139&amp;#93;&lt;/span&gt; recv(): message len 58721588 is too large58721588&quot;&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;Looking at the code about this limitation, I found the limit being 48000000 and defined in &lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/src/mongo/util/net/message_port.cpp#L159L159&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;message_port.cpp&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Can you explain me why this limit of 48000000 came from ?&lt;br/&gt;
It is just an arbitrary limit defined as approximately 3 times the &lt;a href=&quot;http://www.mongodb.org/display/DOCS/Documents&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;maximum document size&lt;/a&gt; ?&lt;/p&gt;

&lt;p&gt;I found nowhere else in the code a reference to this number, except in js-1.7 which severals times use the number 0x48000000.&lt;br/&gt;
Since I found no others reason for the 48000000 limits, I was wondering that maybe this limit should be 0x48000000 instead of 4800000.&lt;/p&gt;

&lt;p&gt;Does somebody have some insight about this ?&lt;/p&gt;</description>
                <environment></environment>
        <key id="38845">SERVER-5849</key>
            <summary>Miessage max size limit</summary>
                <type id="6" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14720&amp;avatarType=issuetype">Question</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="christkv">Christian Amor Kvalheim</assignee>
                                    <reporter username="maxired">Maxence Dalmais</reporter>
                        <labels>
                            <label>message</label>
                            <label>size</label>
                    </labels>
                <created>Wed, 16 May 2012 12:01:16 +0000</created>
                <updated>Thu, 1 Nov 2012 21:49:39 +0000</updated>
                            <resolved>Sat, 16 Jun 2012 13:53:28 +0000</resolved>
                                    <version>2.0.2</version>
                                                    <component>Networking</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="181623" author="rogerbinns" created="Thu, 1 Nov 2012 21:49:39 +0000"  >&lt;p&gt;This random limit causes a lot of grief for bulk inserts and the resulting behaviour in the client (pymongo in my case) means you just get an abruptly dropped connection and no further explanation.&lt;/p&gt;</comment>
                            <comment id="120487" author="christkv" created="Thu, 17 May 2012 13:33:31 +0000"  >&lt;p&gt;github reference issue &lt;a href=&quot;https://github.com/mongodb/node-mongodb-native/issues/609&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/node-mongodb-native/issues/609&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="120477" author="christkv" created="Thu, 17 May 2012 13:06:09 +0000"  >&lt;p&gt;I would suggest you just up the poolsize of the driver and restrict the bulk inserts to the max 16GB and then if you need fork child processes in node. It&apos;s very likely you&apos;ll flood the tcp connection between the inserter and the server so that will most likely be your upper limit on insertion speed.&lt;/p&gt;</comment>
                            <comment id="120468" author="scotthernandez" created="Thu, 17 May 2012 12:53:50 +0000"  >&lt;p&gt;The limit on the server is an extreme, and there if drivers make simple mistakes. Drivers are basically written to use the max doc size plus some overhead.&lt;/p&gt;</comment>
                            <comment id="120434" author="maxired" created="Thu, 17 May 2012 10:33:03 +0000"  >&lt;p&gt;I used a modify version of the node-mongodb-native for testing.&lt;/p&gt;

&lt;p&gt;The fact is that this limit is not documented, and cannot be read remotely by a client. (Whereas maxBsonObjectSize is)&lt;/p&gt;

&lt;p&gt;The official node-mongodb-native implementation has a message limit of 16MB(+headers I guess).&lt;br/&gt;
Should it use this 48000000 limit ? &lt;br/&gt;
Would it works with old mongo version, or maybe the previous limit was 3*4MB ? &lt;/p&gt;</comment>
                            <comment id="120331" author="eliot" created="Thu, 17 May 2012 01:21:54 +0000"  >&lt;p&gt;The limit is as you said, roughly 3x max doc size.&lt;/p&gt;

&lt;p&gt;what client are you using? &lt;br/&gt;
They shouldn&apos;t be generating a bulk insert message that large.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>6.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 17 May 2012 01:21:54 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        11 years, 15 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            11 years, 15 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>christkv</customfieldvalue>
            <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>maxired</customfieldvalue>
            <customfieldvalue>rogerbinns</customfieldvalue>
            <customfieldvalue>scotthernandez</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hro2wn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hriqxb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>23015</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrquv3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>