<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 02:55:42 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-975] make ClientCusror::yield do an adaptive sleep (WAS: Improve yielding for remove queries)</title>
                <link>https://jira.mongodb.org/browse/SERVER-975</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I&apos;m currently runnning this query:&lt;/p&gt;

&lt;p&gt;		{&lt;br/&gt;
			&quot;opid&quot; : 24472544,&lt;br/&gt;
			&quot;active&quot; : true,&lt;br/&gt;
			&quot;lockType&quot; : &quot;write&quot;,&lt;br/&gt;
			&quot;waitingForLock&quot; : false,&lt;br/&gt;
			&quot;secs_running&quot; : 6600,&lt;br/&gt;
			&quot;op&quot; : &quot;remove&quot;,&lt;br/&gt;
			&quot;ns&quot; : &quot;mydb.mycoll&quot;,&lt;br/&gt;
			&quot;query&quot; : {&lt;br/&gt;
				&quot;entry&quot; : &lt;/p&gt;
{
					&quot;$ne&quot; : &quot;string&quot;
				}
&lt;p&gt;			},&lt;br/&gt;
			&quot;client&quot; : &quot;127.0.0.1:48464&quot;,&lt;br/&gt;
			&quot;desc&quot; : &quot;conn&quot;&lt;br/&gt;
		},&lt;/p&gt;



&lt;p&gt;It&apos;s now taking &amp;gt; 100 minutes (and still a long way to go) for a 17 million documents collection.&lt;/p&gt;

&lt;p&gt;The main problem is that it seems to completely lock the application and that it does not yield.&lt;br/&gt;
When running .stats() or .count() from the mongo shell, it actually does let 3-4 inserts through, but only to retake the lock and keep it after a few seconds.&lt;/p&gt;

&lt;p&gt;This is what I usually see in mongostats:&lt;br/&gt;
insert/s query/s update/s delete/s getmore/s command/s mapped  vsize    res % locked % idx miss  conn     time &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5892    0.979     0.0131    14 17:01:28 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5891    0.935     0.0102    14 17:01:29 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5890     1.08    0.00866    14 17:01:30 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5888    0.999     0.0106    14 17:01:31 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5886    0.977     0.0112    14 17:01:32 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5885     1.01    0.00845    14 17:01:33 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5884    0.964     0.0147    14 17:01:34 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5885     1.04     0.0121    14 17:01:35 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5884    0.986     0.0147    14 17:01:36 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5883     1.03     0.0121    14 17:01:37 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5881    0.986     0.0117    14 17:01:38 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5880    0.958     0.0123    14 17:01:39 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5878     1.03     0.0133    14 17:01:40 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5878    0.975     0.0124    14 17:01:41 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5876     1.05     0.0122    14 17:01:42 &lt;br/&gt;
       0       0        0        0         0         2  49161  49967   5878    0.931     0.0151    14 17:01:43 &lt;/p&gt;</description>
                <environment>ubuntu 9.10 64 bit, mongodb 1.4</environment>
        <key id="11713">SERVER-975</key>
            <summary>make ClientCusror::yield do an adaptive sleep (WAS: Improve yielding for remove queries)</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="eliot">Eliot Horowitz</assignee>
                                    <reporter username="rb2k">Marc Seeger</reporter>
                        <labels>
                    </labels>
                <created>Tue, 6 Apr 2010 13:17:34 +0000</created>
                <updated>Tue, 12 Jul 2016 00:27:31 +0000</updated>
                            <resolved>Tue, 6 Apr 2010 13:49:47 +0000</resolved>
                                                    <fixVersion>1.4.1</fixVersion>
                    <fixVersion>1.5.0</fixVersion>
                                                        <votes>0</votes>
                                    <watches>0</watches>
                                                                                                                <comments>
                            <comment id="13886" author="eliot" created="Mon, 26 Apr 2010 13:51:19 +0000"  >&lt;p&gt;in a release&lt;/p&gt;</comment>
                            <comment id="13608" author="auto" created="Tue, 13 Apr 2010 17:18:41 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;login&apos;: &apos;erh&apos;, &apos;name&apos;: &apos;Eliot Horowitz&apos;, &apos;email&apos;: &apos;eliot@10gen.com&apos;}
&lt;p&gt;Message: adaptive sleep for ClientCusror::yield &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-975&quot; title=&quot;make ClientCusror::yield do an adaptive sleep (WAS: Improve yielding for remove queries)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-975&quot;&gt;&lt;del&gt;SERVER-975&lt;/del&gt;&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;http://github.com/mongodb/mongo/commit/f8339b000d80c35248a5c7a7e6a8fe2182702f6c&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://github.com/mongodb/mongo/commit/f8339b000d80c35248a5c7a7e6a8fe2182702f6c&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="13477" author="auto" created="Tue, 6 Apr 2010 13:47:51 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;login&apos;: &apos;&apos;, &apos;name&apos;: &apos;Eliot Horowitz&apos;, &apos;email&apos;: &apos;eliot@10gen.com&apos;}
&lt;p&gt;Message: adaptive sleep for ClientCusror::yield &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-975&quot; title=&quot;make ClientCusror::yield do an adaptive sleep (WAS: Improve yielding for remove queries)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-975&quot;&gt;&lt;del&gt;SERVER-975&lt;/del&gt;&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;http://github.com/mongodb/mongo/commit/009e2e4e0a1c1bbcfcc1acb4b18f035dee7b31fb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://github.com/mongodb/mongo/commit/009e2e4e0a1c1bbcfcc1acb4b18f035dee7b31fb&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="13474" author="rb2k" created="Tue, 6 Apr 2010 13:39:30 +0000"  >&lt;p&gt;3-4 inserts ONLY once I manually call .count() from the shell. Otherwise I can watch it for 5 minutes without anything else happening&lt;/p&gt;

&lt;p&gt;here is the currentOP: &lt;a href=&quot;http://pastebin.com/6uC2ek17&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://pastebin.com/6uC2ek17&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="13473" author="eliot" created="Tue, 6 Apr 2010 13:35:25 +0000"  >&lt;p&gt;right - you said it let 3-4 inserts in.&lt;br/&gt;
so i&apos;m unclear what exactly the issue is.&lt;/p&gt;

&lt;p&gt;do you think other ops are having to wait too long?&lt;br/&gt;
can you send db.currentOp sample output?&lt;/p&gt;</comment>
                            <comment id="13472" author="rb2k" created="Tue, 6 Apr 2010 13:34:01 +0000"  >&lt;p&gt;It was my impression that the &quot;remove data&quot; step shouldn&apos;t be blocking but should, in between, let other queries/inserts/updates do their thing.&lt;br/&gt;
I have TONS of operations waiting (from other processes etc)&lt;/p&gt;</comment>
                            <comment id="13469" author="eliot" created="Tue, 6 Apr 2010 13:28:30 +0000"  >&lt;p&gt;I&apos;m not sure what you mean by improved yielding.&lt;br/&gt;
Do you have operations waiting?&lt;/p&gt;

&lt;p&gt;It sounds like its doing exactly what its supposed to.&lt;/p&gt;

&lt;p&gt;remove some data, then let other ops in, then continue...&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 6 Apr 2010 13:28:30 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        13 years, 43 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            13 years, 43 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>auto</customfieldvalue>
            <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>rb2k</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrpo47:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrionr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>22647</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht0jbj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>