<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:13:35 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-26912] Bulk insert provides little improvement in overall performance with much higher cpu usage</title>
                <link>https://jira.mongodb.org/browse/SERVER-26912</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Windows 2012R2, WT&lt;/p&gt;

&lt;p&gt;With an insert-only workload, using the bulk-insert api provides a ~2x improvement in throughput. Using the same test as &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-26753&quot; title=&quot;Minor speed regression (13%) and &amp;#39;choppy&amp;#39; performance in 3.4 vs 3.2&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-26753&quot;&gt;&lt;del&gt;SERVER-26753&lt;/del&gt;&lt;/a&gt;, but simply using a bulk-insert of 10 documents (whereas the original test inserted 1), the overall steady-state performance is marginally improved (~3%) but the cpu usage goes from ~55% to 100%.&lt;/p&gt;

&lt;p&gt;I realize we are asking more of the DB, but I&apos;m surprised at how little of an improvement there is given the significant increase in CPU usage. Is it possible there is a significant amount of time spent spinning?&lt;/p&gt;

&lt;p&gt;Please see the attached diagnostics.&lt;/p&gt;</description>
                <environment></environment>
        <key id="329477">SERVER-26912</key>
            <summary>Bulk insert provides little improvement in overall performance with much higher cpu usage</summary>
                <type id="6" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14720&amp;avatarType=issuetype">Question</type>
                                            <priority id="4" iconUrl="https://jira.mongodb.org/images/icons/priorities/minor.svg">Minor - P4</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="david.hows">David Hows</assignee>
                                    <reporter username="nick@innsenroute.com">Nick Judson</reporter>
                        <labels>
                    </labels>
                <created>Fri, 4 Nov 2016 17:56:45 +0000</created>
                <updated>Wed, 5 Apr 2017 16:44:16 +0000</updated>
                            <resolved>Mon, 13 Mar 2017 23:54:40 +0000</resolved>
                                    <version>3.4.0-rc1</version>
                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>11</watches>
                                                                                                                <comments>
                            <comment id="1523128" author="david.hows" created="Mon, 13 Mar 2017 23:54:22 +0000"  >&lt;p&gt;Hi Nick,&lt;/p&gt;

&lt;p&gt;Glad to hear!&lt;/p&gt;

&lt;p&gt;I&apos;m marking this one as &quot;Gone away&quot;, since the initially reported issue has been resolved in a more recent release.&lt;/p&gt;

&lt;p&gt;Thanks for the clarification.&lt;/p&gt;</comment>
                            <comment id="1522861" author="nick@innsenroute.com" created="Mon, 13 Mar 2017 18:54:02 +0000"  >&lt;p&gt;@David Hows - as discussed I ran a series of tests with 3.4.2 and the performance looks excellent with bulk operations. I was able to get the highest throughput yet. Thanks!&lt;/p&gt;</comment>
                            <comment id="1518617" author="david.hows" created="Wed, 8 Mar 2017 04:52:23 +0000"  >&lt;p&gt;Hi Nick,&lt;/p&gt;

&lt;p&gt;Thanks for taking the time to run me through your reproducer.&lt;/p&gt;

&lt;p&gt;As discussed, it looks like the issues weren&apos;t present in 3.4.2, can you retest locally and confirm.&lt;/p&gt;

&lt;p&gt;Thanks!&lt;/p&gt;</comment>
                            <comment id="1518467" author="david.hows" created="Tue, 7 Mar 2017 23:41:42 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=nickj&quot; class=&quot;user-hover&quot; rel=&quot;nickj&quot;&gt;nickj&lt;/a&gt;, I&apos;m looking to confirm if this issue still exists in recent releases of Mongo.&lt;/p&gt;

&lt;p&gt;I was looking here and on &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-26753&quot; title=&quot;Minor speed regression (13%) and &amp;#39;choppy&amp;#39; performance in 3.4 vs 3.2&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-26753&quot;&gt;&lt;del&gt;SERVER-26753&lt;/del&gt;&lt;/a&gt; to get a copy of your workload. I&apos;ve been unable to get a copy, would you be able to email me a copy? Or can you upload to a provided drop site?&lt;/p&gt;

&lt;p&gt;Thanks!&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;David&lt;/li&gt;
&lt;/ul&gt;
</comment>
                            <comment id="1426531" author="nick@innsenroute.com" created="Fri, 4 Nov 2016 18:16:10 +0000"  >&lt;p&gt; ~Michael Cahill - After re-testing &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-26753&quot; title=&quot;Minor speed regression (13%) and &amp;#39;choppy&amp;#39; performance in 3.4 vs 3.2&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-26753&quot;&gt;&lt;del&gt;SERVER-26753&lt;/del&gt;&lt;/a&gt; with RC2, I see that the fix for that issue isn&apos;t merged yet. So be aware that the fix for &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-26753&quot; title=&quot;Minor speed regression (13%) and &amp;#39;choppy&amp;#39; performance in 3.4 vs 3.2&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-26753&quot;&gt;&lt;del&gt;SERVER-26753&lt;/del&gt;&lt;/a&gt; appears to have a big negative impact on this bulk test.&lt;/p&gt;</comment>
                            <comment id="1426521" author="nick@innsenroute.com" created="Fri, 4 Nov 2016 18:09:15 +0000"  >&lt;p&gt;Just tested with the new RC2 and there appears to be a big improvement. Mods please close.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="143428" name="RC2.bulk-insert.metrics.2016-11-04T18-00-22Z-00000" size="188214" author="nick@innsenroute.com" created="Fri, 4 Nov 2016 18:09:15 +0000"/>
                            <attachment id="143426" name="bulk-insert.metrics.2016-11-04T17-41-13Z-00000" size="153165" author="nick@innsenroute.com" created="Fri, 4 Nov 2016 17:56:45 +0000"/>
                            <attachment id="143425" name="single-insert.metrics.2016-11-04T17-33-32Z-00000" size="131218" author="nick@innsenroute.com" created="Fri, 4 Nov 2016 17:56:45 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>6.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 25 Nov 2016 01:00:39 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 48 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 48 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>david.hows</customfieldvalue>
            <customfieldvalue>nick@innsenroute.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrjruf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrbn53:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsedqn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>