<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 06:40:58 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-79434] Bug running spill to disk in mongosync passthroughs</title>
                <link>https://jira.mongodb.org/browse/SERVER-79434</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I tried re-enabling spill_to_disk after &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-77185&quot; title=&quot;Bug with implementation of $lookup in SBE&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-77185&quot;&gt;&lt;del&gt;SERVER-77185&lt;/del&gt;&lt;/a&gt; was done and backported, and even with the backports, I&apos;m still seeing problems. Here are the problematic logs: &lt;a href=&quot;https://parsley.mongodb.com/resmoke/e3675d4e2151a916de0ca82a4fb29a9c/all?bookmarks=0,4585,129264,173946&amp;amp;filters=000localhost%253A20753,000js_test_try,000j3%253Acl0%253As1%253Aprim&amp;amp;shareLine=129264&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://parsley.mongodb.com/resmoke/e3675d4e2151a916de0ca82a4fb29a9c/all?bookmarks=0,4585,129264,173946&amp;amp;filters=000localhost%253A20753,000js_test_try,000j3%253Acl0%253As1%253Aprim&amp;amp;shareLine=129264&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Essentially it seems that at some point when the test is running &lt;b&gt;j3:cl0:s1:prim&lt;/b&gt; throws a QueryExceededMemoryLimitNoDiskUseAllowed, and then it never recovers or is reachable by the other nodes.&lt;/p&gt;</description>
                <environment></environment>
        <key id="2403177">SERVER-79434</key>
            <summary>Bug running spill to disk in mongosync passthroughs</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="2">Won&apos;t Fix</resolution>
                                        <assignee username="ivan.fefer@mongodb.com">Ivan Fefer</assignee>
                                    <reporter username="rohan.sharan@mongodb.com">Rohan Sharan</reporter>
                        <labels>
                            <label>greenerbuild</label>
                    </labels>
                <created>Thu, 27 Jul 2023 19:37:52 +0000</created>
                <updated>Mon, 16 Oct 2023 08:46:19 +0000</updated>
                            <resolved>Mon, 16 Oct 2023 08:46:19 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="5780380" author="JIRAUSER1270969" created="Mon, 16 Oct 2023 08:46:19 +0000"  >&lt;p&gt;Unable to reproduce the issue. It looks like the problem is outside spill_to_disk.js test and the server.&lt;/p&gt;</comment>
                            <comment id="5764233" author="JIRAUSER1270969" created="Mon, 9 Oct 2023 14:22:53 +0000"  >&lt;p&gt;Also, latest execution succeeded, but accumulator_js_size_limits.js took 220 seconds to complete with a single query taking this much most of the time.&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;j1:cl0:s1:prim&amp;#93;&lt;/span&gt; | 2023-10-09T14:18:18.877+00:00 I  COMMAND  51803   &lt;span class=&quot;error&quot;&gt;&amp;#91;conn64&amp;#93;&lt;/span&gt; &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;staging.watermelon&quot;,&quot;appName&quot;:&quot;MongoDB Shell&quot;,&quot;command&quot;:{&quot;aggregate&quot;:&quot;watermelon&quot;,&quot;pipeline&quot;:[{&quot;$addFields&quot;:{&quot;a&quot;:&lt;/p&gt;
{&quot;$range&quot;:[0,1000000]}
&lt;p&gt;}},{&quot;$unwind&quot;:&quot;$a&quot;},{&quot;$group&quot;:{&quot;_id&quot;:&quot;$groupBy&quot;,&quot;count&quot;:{&quot;$accumulator&quot;:{&quot;init&quot;:{&quot;$code&quot;:&quot;function() &lt;/p&gt;
{\n            return \&quot;\&quot;;\n        }
&lt;p&gt;&quot;},&quot;accumulateArgs&quot;:&lt;span class=&quot;error&quot;&gt;&amp;#91;\{&amp;quot;fieldName&amp;quot;:&amp;quot;$a&amp;quot;}&amp;#93;&lt;/span&gt;,&quot;accumulate&quot;:{&quot;$code&quot;:&quot;function(state, args) &lt;/p&gt;
{\n            return state + \&quot;a\&quot;;\n        }
&lt;p&gt;&quot;},&quot;merge&quot;:{&quot;$code&quot;:&quot;function(state1, state2) &lt;/p&gt;
{\n            return state1 + state2;\n        }
&lt;p&gt;&quot;},&quot;finalize&quot;:{&quot;$code&quot;:&quot;function(state) &lt;/p&gt;
{\n            return state.length;\n        }
&lt;p&gt;&quot;}}}}},{&quot;$limit&quot;:10}],&quot;cursor&quot;:{&quot;batchSize&quot;:101},&quot;let&quot;:{},&quot;fromMongos&quot;:false,&quot;$_generateV2ResumeTokens&quot;:false,&quot;readConcern&quot;:{&quot;level&quot;:&quot;local&quot;,&quot;provenance&quot;:&quot;implicitDefault&quot;},&quot;writeConcern&quot;:{&quot;w&quot;:&quot;majority&quot;,&quot;wtimeout&quot;:0,&quot;provenance&quot;:&quot;implicitDefault&quot;},&quot;shardVersion&quot;:{&quot;t&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:0,&quot;i&quot;:0}},&quot;e&quot;:{&quot;$oid&quot;:&quot;000000000000000000000000&quot;},&quot;v&quot;:{&quot;$timestamp&quot;:&lt;/p&gt;
{&quot;t&quot;:0,&quot;i&quot;:0}
&lt;p&gt;}},&quot;databaseVersion&quot;:{&quot;uuid&quot;:&lt;/p&gt;
{&quot;$uuid&quot;:&quot;5952481b-83b1-47af-b8d4-ba9c5bcf7ffc&quot;}
&lt;p&gt;,&quot;timestamp&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1696860872,&quot;i&quot;:1}},&quot;lastMod&quot;:1},&quot;lsid&quot;:{&quot;id&quot;:&lt;/p&gt;
{&quot;$uuid&quot;:&quot;bd5169cf-043c-4e09-8049-0f8db356c9fd&quot;}
&lt;p&gt;,&quot;uid&quot;:{&quot;$binary&quot;:&lt;/p&gt;
{&quot;base64&quot;:&quot;47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=&quot;,&quot;subType&quot;:&quot;0&quot;}
&lt;p&gt;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1696860879,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$configTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1696860877,&quot;i&quot;:1}},&quot;$topologyTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1696860862,&quot;i&quot;:11}},&quot;$client&quot;:{&quot;application&quot;:&lt;/p&gt;
{&quot;name&quot;:&quot;MongoDB Shell&quot;}
&lt;p&gt;,&quot;driver&quot;:{&quot;name&quot;:&quot;MongoDB Internal Client&quot;,&quot;version&quot;:&quot;6.0.8-43-g806d10c&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Red Hat Enterprise Linux release 8.0 (Ootpa)&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;Kernel 4.18.0-80.1.2.el8_0.x86_64&quot;},&quot;mongos&quot;:{&quot;host&quot;:&quot;ip-10-128-213-98.ec2.internal:20255&quot;,&quot;client&quot;:&quot;127.0.0.1:57474&quot;,&quot;version&quot;:&quot;6.0.8-43-g806d10c&quot;}},&quot;mayBypassWriteBlocking&quot;:false,&quot;$db&quot;:&quot;staging&quot;},&quot;planSummary&quot;:&quot;COLLSCAN&quot;,&quot;numYields&quot;:0,&quot;queryHash&quot;:&quot;9B1F31E9&quot;,&quot;queryFramework&quot;:&quot;classic&quot;,&quot;ok&quot;:0,&quot;errMsg&quot;:&quot;PlanExecutor error during aggregation :: caused by :: $accumulator arguments exceed max BSON size: 16777228&quot;,&quot;errName&quot;:&quot;Location4545000&quot;,&quot;errCode&quot;:4545000,&quot;reslen&quot;:396,&quot;locks&quot;:{&quot;FeatureCompatibilityVersion&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:2}},&quot;Global&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:2}},&quot;Mutex&quot;:{&quot;acquireCount&quot;:&lt;/p&gt;
{&quot;r&quot;:3}
&lt;p&gt;}},&quot;readConcern&quot;:{&quot;level&quot;:&quot;local&quot;,&quot;provenance&quot;:&quot;implicitDefault&quot;},&quot;writeConcern&quot;:{&quot;w&quot;:&quot;majority&quot;,&quot;wtimeout&quot;:0,&quot;provenance&quot;:&quot;implicitDefault&quot;},&quot;storage&quot;:{},&quot;remote&quot;:&quot;127.0.0.1:47074&quot;,&quot;protocol&quot;:&quot;op_msg&quot;,&quot;durationMillis&quot;:219626}&lt;br/&gt;
&#160;&lt;/p&gt;</comment>
                            <comment id="5764029" author="JIRAUSER1270969" created="Mon, 9 Oct 2023 13:19:22 +0000"  >&lt;p&gt;I have restarted the task couple of time and it has failed 3 times out of 6.&lt;/p&gt;

&lt;p&gt;Failures&#160; are similar to the original failure, however it seems that &lt;a href=&quot;https://github.com/mongodb/mongo/blob/v6.0/jstests/aggregation/spill_to_disk.js&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;spill_to_disk.js&lt;/a&gt; test finished successfully in this runs, but they hanged on &lt;a href=&quot;https://github.com/mongodb/mongo/blob/v6.0/jstests/aggregation/accumulators/accumulator_js_size_limits.js&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;accumulator_js_size_limits.js&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;The common denominator of both tests is that they both spill data to disk. And according to logs hanging or death of one of the mongod processes happened after some data was spilled to disk.&lt;/p&gt;

&lt;p&gt;The lack of logs suggests the process either stuck waiting for something or is killed with SIGKILL or something similar any other failures usually leave at least &quot;Segmentation Fault (core dumped)&quot; in the worst case and a full stack trace and an error message in the best case.&lt;/p&gt;

&lt;p&gt;I suspect that the problem is on the side of environment: disk ran out of inodes, process exceeded limit on open file descriptor, something like that, not on the mongod side.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                                                <inwardlinks description="is depended on by">
                                                        </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25125"><![CDATA[Query Execution]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 6 Oct 2023 12:42:27 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        16 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ivan.fefer@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            16 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>ivan.fefer@mongodb.com</customfieldvalue>
            <customfieldvalue>rohan.sharan@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i2juwn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i21yo0:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="7254">QE 2023-10-16</customfieldvalue>
    <customfieldvalue id="7255">QE 2023-10-30</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i2jh1z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>