<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 02:58:02 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-1780] &quot;doing delete inline&quot; blocks the whole cluster</title>
                <link>https://jira.mongodb.org/browse/SERVER-1780</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;in best of the best cases it takes at least several seconds.&lt;/p&gt;

&lt;p&gt;When the amount of data is substantial, it can block for more than an hour, pretty much rendering the whole cluster useless and making queries pile up in the queue.&lt;/p&gt;

&lt;p&gt;It does some very intensive I/O. Does it do data compaction of some sort?&lt;/p&gt;

&lt;p&gt;Since we have chunks of data roughly of the same size, could we just mark it free and than later rewrite it?&lt;/p&gt;</description>
                <environment></environment>
        <key id="13075">SERVER-1780</key>
            <summary>&quot;doing delete inline&quot; blocks the whole cluster</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="eliot">Eliot Horowitz</assignee>
                                    <reporter username="sergei.tulentsev@gmail.com">Sergei Tulentsev</reporter>
                        <labels>
                    </labels>
                <created>Sun, 12 Sep 2010 14:06:42 +0000</created>
                <updated>Tue, 16 Nov 2021 15:37:18 +0000</updated>
                            <resolved>Thu, 30 Sep 2010 01:45:05 +0000</resolved>
                                    <version>1.6.2</version>
                    <version>1.7.0</version>
                                                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="140895" author="tobywang" created="Mon, 9 Jul 2012 15:47:38 +0000"  >&lt;p&gt;Hi, Scott, I am very sorry that I didn&apos;t give you some useful details. While the sharding cluster is a production one and has high-traffic. I didn&apos;t catch those stats and logs when the problem occurred this afternoon and am not going to reproduce this problem. I had switched the activeWindow to low-traffic times. If it appears again, I will let you know. Thank your very much!&lt;/p&gt;</comment>
                            <comment id="140797" author="scotthernandez" created="Mon, 9 Jul 2012 13:09:24 +0000"  >&lt;p&gt;Guanhai, please open a new issue with stats, and logs. Please include iostat -xmt 2, mongostat and vmstat numbers during the period for all members involved as well as the logs from those members and the mongos instances.&lt;/p&gt;

&lt;p&gt;In addition please include a mongodump of the config database after the event. Timing/a-timeline would be very useful so please call out when what happened as you experienced it from the user&apos;s/applications&apos; perspective.&lt;/p&gt;</comment>
                            <comment id="140750" author="tobywang" created="Mon, 9 Jul 2012 10:51:29 +0000"  >&lt;p&gt;When the balancer migrating a chunk from one shard to another I got the same issue with mongodb 1.8.5, git version: 403c8dadcd56f68dcbe06013ecbfac67b32a22ac. When &quot;doing delete inline&quot;, all operations of the sharding cluster were blocked more than twenty minutes. My cluster received about 10,000 commands per second at that time.&lt;/p&gt;</comment>
                            <comment id="20018" author="eliot" created="Wed, 3 Nov 2010 21:59:47 +0000"  >&lt;p&gt;That&apos;s expected.  The goal is that it shouldn&apos;t cause detrimental performance to the system.&lt;br/&gt;
There are already a lot of other improvements in 1.7 to make it less imapctfull&lt;/p&gt;</comment>
                            <comment id="20016" author="squanderingtime" created="Wed, 3 Nov 2010 21:56:22 +0000"  >&lt;p&gt;The total cluster blocking appears to be resolved in 1.6.4, everything just slows down in relation.  The source shard however that&apos;s having a chunk moved away is still experiencing ~15 minutes of 100% IO utilization for a 200MB chunk.  Is this expected or should I file/comment on a bug elsewhere?&lt;/p&gt;</comment>
                            <comment id="20009" author="eliot" created="Wed, 3 Nov 2010 20:37:26 +0000"  >&lt;p&gt;Can you try 1.6.4?&lt;/p&gt;</comment>
                            <comment id="20008" author="squanderingtime" created="Wed, 3 Nov 2010 20:32:34 +0000"  >&lt;p&gt;I&apos;m still seeing this issue on 1.6.3.&lt;/p&gt;

&lt;p&gt;Wed Nov  3 12:53:34 MongoDB starting : pid=16617 port=27018 dbpath=/db/var/mongodb/ 64-bit &lt;br/&gt;
Wed Nov  3 12:53:34 db version v1.6.3, pdfile version 4.5&lt;br/&gt;
Wed Nov  3 12:53:34 git version: 278bd2ac2f2efbee556f32c13c1b6803224d1c01&lt;br/&gt;
Wed Nov  3 12:53:34 sys info: Linux domU-12-31-39-06-79-A1 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41&lt;br/&gt;
Wed Nov  3 12:53:34 &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; waiting for connections on port 27018&lt;br/&gt;
Wed Nov  3 12:53:34 &lt;span class=&quot;error&quot;&gt;&amp;#91;websvr&amp;#93;&lt;/span&gt; web admin interface listening on port 28018&lt;/p&gt;

&lt;p&gt;I see the &quot;doing delete inline&quot; message and then iostat -x 2 jumps to 100% for approximately 10-11 minutes.  Any attempt to write to the cluster in this window appears to block activity.&lt;/p&gt;

&lt;p&gt;avg-cpu:  %user   %nice %system %iowait  %steal   %idle&lt;br/&gt;
           2.12    0.00    9.09   38.61    0.00   50.19&lt;/p&gt;

&lt;p&gt;Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util&lt;br/&gt;
sda               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00&lt;br/&gt;
sda1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00&lt;br/&gt;
sda2              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00&lt;br/&gt;
sdb               0.00     0.00   98.51 10049.25  2057.71 121796.02    12.21   114.86   11.30   0.10 100.50&lt;br/&gt;
dm-0              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00&lt;br/&gt;
dm-1              0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00&lt;br/&gt;
dm-2              0.00     0.00   96.52 10044.28  2041.79 121903.48    12.22   114.85   11.31   0.10 100.50&lt;/p&gt;</comment>
                            <comment id="18700" author="eliot" created="Thu, 30 Sep 2010 01:45:05 +0000"  >&lt;p&gt;Ok - going to close for now.&lt;br/&gt;
Please comment if it starts acting up again.&lt;/p&gt;</comment>
                            <comment id="18699" author="sergei.tulentsev@gmail.com" created="Thu, 30 Sep 2010 01:43:17 +0000"  >&lt;p&gt;It&apos;s performing very well, though write load is significantly lower.&lt;/p&gt;</comment>
                            <comment id="18698" author="eliot" created="Thu, 30 Sep 2010 01:40:41 +0000"  >&lt;p&gt;Is this performing better or are you still having problems?&lt;/p&gt;</comment>
                            <comment id="18696" author="sergei.tulentsev@gmail.com" created="Thu, 30 Sep 2010 01:37:53 +0000"  >&lt;p&gt;I am running 1.6.3 now.&lt;/p&gt;</comment>
                            <comment id="18694" author="eliot" created="Thu, 30 Sep 2010 01:27:48 +0000"  >&lt;p&gt;1.6.3 has a number of the changes.&lt;br/&gt;
You may want to try that.&lt;/p&gt;</comment>
                            <comment id="18691" author="sergei.tulentsev@gmail.com" created="Wed, 29 Sep 2010 23:23:45 +0000"  >&lt;p&gt;Sorry, must have missed your previous comment. What&apos;s a stall?&lt;/p&gt;

&lt;p&gt;I must say that I dont&apos; encounter this behaviour anymore. Probably because I am not inserting data at that rate.Though, I still have some data to import. &lt;/p&gt;

&lt;p&gt;But I would rather wait for next stable build. Are you going to merge these changes into it?&lt;/p&gt;</comment>
                            <comment id="18686" author="eliot" created="Wed, 29 Sep 2010 21:51:05 +0000"  >&lt;p&gt;Any updates?&lt;br/&gt;
Can you try 1.7.1?&lt;/p&gt;</comment>
                            <comment id="18062" author="eliot" created="Sun, 12 Sep 2010 17:06:44 +0000"  >&lt;p&gt;Yes that.&lt;br/&gt;
And you upgraded everything?&lt;br/&gt;
Can you send the logs from a stall after that?&lt;br/&gt;
Shouldn&apos;t be happening any more&lt;/p&gt;</comment>
                            <comment id="18061" author="sergei.tulentsev@gmail.com" created="Sun, 12 Sep 2010 17:04:27 +0000"  >&lt;p&gt;You mean this?&lt;/p&gt;

&lt;p&gt;sergio@cs2592:~$ mongod --version&lt;br/&gt;
db version v1.7.1-pre-, pdfile version 4.5&lt;br/&gt;
Sun Sep 12 21:03:28 git version: 6766569f9acdd80e27d957906f61dd7a14425d0d&lt;/p&gt;</comment>
                            <comment id="18060" author="eliot" created="Sun, 12 Sep 2010 16:53:29 +0000"  >&lt;p&gt;Can you send the startup banned with git hash?&lt;/p&gt;</comment>
                            <comment id="18056" author="sergei.tulentsev@gmail.com" created="Sun, 12 Sep 2010 15:56:16 +0000"  >&lt;p&gt;Yes, this is still happening in the latest nightly (2010-09-10)&lt;/p&gt;</comment>
                            <comment id="18054" author="eliot" created="Sun, 12 Sep 2010 14:22:36 +0000"  >&lt;p&gt;Is this still happening in the 1.7?&lt;br/&gt;
&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-1521&quot; title=&quot;yield lock during removeRange&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-1521&quot;&gt;&lt;del&gt;SERVER-1521&lt;/del&gt;&lt;/a&gt; should have fixed it&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>19.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Sun, 12 Sep 2010 14:22:36 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        11 years, 32 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            11 years, 32 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>squanderingtime</customfieldvalue>
            <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>tobywang</customfieldvalue>
            <customfieldvalue>scotthernandez</customfieldvalue>
            <customfieldvalue>sergei.tulentsev@gmail.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrpf93:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrijcn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>21787</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht0avz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>