<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:03:29 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-3594] new crash in 1.9.1: couldn&apos;t make room for new record (len: 135548) in capped ns &lt;database&gt;.system.profile</title>
                <link>https://jira.mongodb.org/browse/SERVER-3594</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We have reverted to MongoDB 1.9.0 because of a new crash in 1.9.1, triggered during the initial import of our data. The crash happened reliably (even after stopping &amp;amp; deleting /var/lib/mongodb/* &amp;amp; reimporting) until downgrading to 1.9.0.&lt;/p&gt;

&lt;p&gt;Running the import - it works okay initially, until it gets to some &apos;interesting&apos; data (attached an example), which is interesting because it has many fields which Foswiki indexes (many more than the 64 limit; basically, all the FIELD.&amp;lt;foo&amp;gt;.value fields). For what it&apos;s worth, the code that adds these indexes is at &lt;a href=&quot;https://github.com/foswiki/MongoDBPlugin/blob/master/lib/Foswiki/Plugins/MongoDBPlugin.pm#L309&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/foswiki/MongoDBPlugin/blob/master/lib/Foswiki/Plugins/MongoDBPlugin.pm#L309&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;I have been trying to reproduce on our test environment so I can get some verbose log output, but as usual, it&apos;s working fine there...&lt;/p&gt;</description>
                <environment>Single-core VMWare 4GB RAM Ubuntu 10.04.3 LTS instance&lt;br/&gt;
2.6.32-33-server #71-Ubuntu SMP Wed Jul 20 17:42:25 UTC 2011 x86_64 GNU/Linux&lt;br/&gt;
Single stand-alone mongod, no sharding, no replica&lt;br/&gt;
Using auth, noprealloc, nosmallfiles, directoryperdb&lt;br/&gt;
mongod --version&lt;br/&gt;
db version v1.9.0, pdfile version 4.5&lt;br/&gt;
Mon Aug 15 10:52:08 git version: 434d8b47e569578d932e3caedd3bb16e8c0836a3&lt;br/&gt;
&lt;br/&gt;
This is from mongodb-10gen-unstable package&lt;br/&gt;
&lt;br/&gt;
Foswiki trunk svn rev 12313 with CPAN MongoDB version 0.43</environment>
        <key id="20972">SERVER-3594</key>
            <summary>new crash in 1.9.1: couldn&apos;t make room for new record (len: 135548) in capped ns &lt;database&gt;.system.profile</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="mathias@mongodb.com">Mathias Stearn</assignee>
                                    <reporter username="csirac2">Paul Harvey</reporter>
                        <labels>
                            <label>crash</label>
                            <label>insert</label>
                    </labels>
                <created>Mon, 15 Aug 2011 01:25:30 +0000</created>
                <updated>Mon, 11 Jul 2016 18:32:44 +0000</updated>
                            <resolved>Fri, 16 Sep 2011 05:26:02 +0000</resolved>
                                    <version>1.9.1</version>
                                    <fixVersion>2.0.0-rc2</fixVersion>
                                    <component>Stability</component>
                                        <votes>0</votes>
                                    <watches>0</watches>
                                                                                                                <comments>
                            <comment id="53922" author="csirac2" created="Wed, 14 Sep 2011 04:20:24 +0000"  >&lt;p&gt;My apologies for the lengthy delay, fighting deadlines.&lt;/p&gt;

&lt;p&gt;Success! Did a several full import runs with mongodb-10gen package&lt;br/&gt;
db version v2.0.0, pdfile version 4.5&lt;br/&gt;
Wed Sep 14 14:18:35 git version: 695c67dff0ffc361b8568a13366f027caa406222&lt;/p&gt;

&lt;p&gt;I guess we can close this now. Thank you&lt;/p&gt;</comment>
                            <comment id="53714" author="redbeard0531" created="Tue, 13 Sep 2011 15:34:44 +0000"  >&lt;p&gt;How did the test go?&lt;/p&gt;</comment>
                            <comment id="52719" author="csirac2" created="Tue, 6 Sep 2011 23:55:24 +0000"  >&lt;p&gt;Sorry for the delay, I will try to test today.&lt;/p&gt;</comment>
                            <comment id="52708" author="redbeard0531" created="Tue, 6 Sep 2011 22:57:17 +0000"  >&lt;p&gt;Have you been able to test with one of the RCs? I think this has been resolved, but I&apos;d rather not close this case without confirmation.&lt;/p&gt;</comment>
                            <comment id="52016" author="redbeard0531" created="Thu, 1 Sep 2011 17:09:08 +0000"  >&lt;p&gt;Could you make sure that you don&apos;t have a script that is creating the system.profile collection to be 128k? It should now default to 1MB. &lt;/p&gt;

&lt;p&gt;Could you also include the full log if this happens again?&lt;/p&gt;</comment>
                            <comment id="52015" author="redbeard0531" created="Thu, 1 Sep 2011 17:02:43 +0000"  >&lt;p&gt;Have you been able to retest? Based on the log from the 24th, it looks like you were using a pre-existing system.profile collection.&lt;/p&gt;</comment>
                            <comment id="50831" author="csirac2" created="Fri, 26 Aug 2011 00:34:07 +0000"  >&lt;p&gt;Do you mean with a more recent build? The last run was done after rm -rf /var/lib/mongodb/* (or at least, I&apos;m pretty sure).&lt;/p&gt;

&lt;p&gt;Will try to test again next week.&lt;/p&gt;</comment>
                            <comment id="50718" author="redbeard0531" created="Thu, 25 Aug 2011 16:04:10 +0000"  >&lt;p&gt;Could you try dropping the system.profile collection? It should now default to 1MB.&lt;/p&gt;</comment>
                            <comment id="50715" author="redbeard0531" created="Thu, 25 Aug 2011 15:55:06 +0000"  >&lt;p&gt;I reopened. Looking into this now.&lt;/p&gt;</comment>
                            <comment id="50425" author="csirac2" created="Wed, 24 Aug 2011 07:25:16 +0000"  >&lt;p&gt;Either I&apos;m an idiot, or I don&apos;t have permission to re-open. Anyway, I hope somebody who sees this can re-open it for me &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/p&gt;</comment>
                            <comment id="50422" author="csirac2" created="Wed, 24 Aug 2011 07:15:28 +0000"  >&lt;p&gt;Although it seems to get through much more data before failing, it does still fail. &lt;/p&gt;

&lt;p&gt;Attached mongod-nightly3.log&lt;/p&gt;</comment>
                            <comment id="50362" author="csirac2" created="Wed, 24 Aug 2011 03:08:39 +0000"  >&lt;p&gt;Re-confirmed crashes during import using the old&lt;br/&gt;
mongod --version&lt;br/&gt;
db version v2.0.0-rc0-pre-, pdfile version 4.5&lt;br/&gt;
Wed Aug 24 13:04:39 git version: 4edeb8f2b0050dc918a7d935afd458dd05ff515a&lt;/p&gt;

&lt;p&gt;Now waiting for a new import to complete, using the new nightly&lt;br/&gt;
mongod --version&lt;br/&gt;
db version v2.0.0-rc0-pre-, pdfile version 4.5&lt;br/&gt;
Wed Aug 24 13:06:41 git version: 278f5cee2c98f9f0edac641111a6794e9c828f96&lt;/p&gt;</comment>
                            <comment id="50136" author="redbeard0531" created="Tue, 23 Aug 2011 14:06:30 +0000"  >&lt;p&gt;Please reopen if you still see this with the latest nightlies&lt;/p&gt;</comment>
                            <comment id="49959" author="redbeard0531" created="Mon, 22 Aug 2011 19:05:08 +0000"  >&lt;p&gt;OK, the latest nightly on our site should now have the fix. Could you d/l it and try again?&lt;/p&gt;</comment>
                            <comment id="49249" author="csirac2" created="Thu, 18 Aug 2011 12:23:54 +0000"  >&lt;p&gt;The import failed again. Edit: build 4edeb8f2b0050dc918a7d935afd458dd05ff515a is older than the fixes committed, will wait for the next nightly.&lt;/p&gt;

&lt;p&gt;mongod-nightly2.log comes from 4edeb8f2b0050dc918a7d935afd458dd05ff515a&lt;/p&gt;</comment>
                            <comment id="49237" author="csirac2" created="Thu, 18 Aug 2011 07:48:10 +0000"  >&lt;p&gt;Now testing:&lt;/p&gt;

&lt;p&gt;db version v2.0.0-rc0-pre-, pdfile version 4.5&lt;br/&gt;
Thu Aug 18 17:44:18 git version: 4edeb8f2b0050dc918a7d935afd458dd05ff515a&lt;/p&gt;

&lt;p&gt;Still running, but seems to be getting further than usual.&lt;/p&gt;

&lt;p&gt;Immediately prior to the current import run, I have confirmed again that the test environment crashed with db version v1.9.2-pre-, pdfile version 4.5&lt;br/&gt;
Thu Aug 18 17:05:21 git version: 7cad9757de992d4db6f6e991dedd970d9a17d0c0&lt;/p&gt;

&lt;p&gt;Will report tomorrow if it runs to completion.&lt;/p&gt;</comment>
                            <comment id="48946" author="csirac2" created="Wed, 17 Aug 2011 02:47:23 +0000"  >&lt;p&gt;Awesome, thanks! Will try the next nightly.&lt;/p&gt;</comment>
                            <comment id="48923" author="redbeard0531" created="Tue, 16 Aug 2011 21:27:45 +0000"  >&lt;p&gt;I think I&apos;ve fixed this issue. Please either pull from master and rebuild or wait until the next nightly comes out and try again with profiling on.&lt;/p&gt;

&lt;p&gt;Good catch by the way!&lt;/p&gt;</comment>
                            <comment id="48911" author="redbeard0531" created="Tue, 16 Aug 2011 20:12:35 +0000"  >&lt;p&gt;I think I found the issue and it is definitely in profile. For now I&apos;d suggest leaving it disabled unless some part of your app depends on it.&lt;/p&gt;</comment>
                            <comment id="48777" author="csirac2" created="Tue, 16 Aug 2011 10:13:33 +0000"  >&lt;p&gt;The import ran to completion, with profiling disabled. It&apos;s enabled again, waiting on another run with objectcheck enabled..&lt;/p&gt;</comment>
                            <comment id="48755" author="csirac2" created="Tue, 16 Aug 2011 05:37:46 +0000"  >&lt;p&gt;Okay, I&apos;ll those two things in isolation first.&lt;/p&gt;

&lt;p&gt;Indeed, 1.9 in production, and we do notice the &quot;NOT RECOMMENDED FOR PRODUCTION&quot; in the logs&lt;/p&gt;

&lt;p&gt;Foswiki makes terribly JS-heavy queries, necessary to emulate the full expressiveness of Foswiki&apos;s native QuerySearch, which made 1.8.1 &amp;amp; 2 crash in terribly hard to reproduce ways (see &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-3131&quot; title=&quot;JS Error: out of memory leading to segfaults&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-3131&quot;&gt;&lt;del&gt;SERVER-3131&lt;/del&gt;&lt;/a&gt;). 1.9.0 has been surprisingly solid. Anyway, we&apos;re a research team, so normal rules don&apos;t apply &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/p&gt;</comment>
                            <comment id="48748" author="redbeard0531" created="Tue, 16 Aug 2011 03:59:03 +0000"  >&lt;p&gt;It looks like if is dieing in the profiler. just to confirm, could you try disabling it to see if it still crashes? Also, try starting with --objcheck to make sure there are no garbage documents trying to make their way in.&lt;/p&gt;

&lt;p&gt;PS - are you using 1.9 for a production deployment? We recommend running even releases since the odd ones are unstable dev builds. That said, I&apos;m glad we have brave souls who can find bugs like this in the wild.&lt;/p&gt;</comment>
                            <comment id="48739" author="csirac2" created="Tue, 16 Aug 2011 02:07:49 +0000"  >&lt;p&gt;Now testing db version v1.9.2-pre-, pdfile version 4.5&lt;br/&gt;
Tue Aug 16 12:06:21 git version: 7cad9757de992d4db6f6e991dedd970d9a17d0c0&lt;/p&gt;

&lt;p&gt;Update: It failed again, somewhere else. Attached mongod-nightly.log, somewhat &lt;span class=&quot;error&quot;&gt;&amp;#91;redacted&amp;#93;&lt;/span&gt;, which ran with verbose=true set in /etc/mongodb.conf.&lt;/p&gt;

&lt;p&gt;So it seems the &quot;many fields&quot; document detail is a red herring. The document it was crashing on this time had nothing remarkable about it. It reliably (twice or more) crashes in the same place on each import run, both days I tried a &amp;gt; 1.9.0 mongod, even after stop, delete /var/lib/mongodb/* &amp;amp; start.&lt;/p&gt;

&lt;p&gt;Let me know if you want me to try something else.&lt;/p&gt;</comment>
                            <comment id="48687" author="redbeard0531" created="Mon, 15 Aug 2011 21:35:19 +0000"  >&lt;p&gt;Could you test with the latest 1.9 nightly? There has been a lot of changes since 1.9.1.&lt;/p&gt;</comment>
                            <comment id="48520" author="csirac2" created="Mon, 15 Aug 2011 01:40:10 +0000"  >&lt;p&gt;Created &lt;a href=&quot;http://foswiki.org/Tasks/Item11042&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://foswiki.org/Tasks/Item11042&lt;/a&gt; - I&apos;m wondering if the failing assert is new since 1.9.0?&lt;/p&gt;</comment>
                            <comment id="48519" author="csirac2" created="Mon, 15 Aug 2011 01:28:25 +0000"  >&lt;p&gt;I&apos;m not sure if calling ensureIndex on &amp;gt; 64 fields is related at all here, it&apos;s just unusual that this is happening on the very first piece of data which has enough fields for this to happen.&lt;/p&gt;

&lt;p&gt;The code isn&apos;t crashing in the ensureIndex bit - it&apos;s crashing in the bits that add a new topic.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="21077">SERVER-3618</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="12690" name="example.json" size="154667" author="csirac2" created="Mon, 15 Aug 2011 01:25:31 +0000"/>
                            <attachment id="12688" name="foswiki.log" size="3361" author="csirac2" created="Mon, 15 Aug 2011 01:25:31 +0000"/>
                            <attachment id="12701" name="mongod-nightly.log" size="3981" author="csirac2" created="Tue, 16 Aug 2011 02:24:55 +0000"/>
                            <attachment id="12721" name="mongod-nightly2.log" size="1295" author="csirac2" created="Thu, 18 Aug 2011 12:24:26 +0000"/>
                            <attachment id="12868" name="mongod-nightly3.log" size="1297" author="csirac2" created="Wed, 24 Aug 2011 07:14:51 +0000"/>
                            <attachment id="12689" name="mongod.log" size="2337" author="csirac2" created="Mon, 15 Aug 2011 01:25:31 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>26.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 15 Aug 2011 21:35:19 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        12 years, 23 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            12 years, 23 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>mathias@mongodb.com</customfieldvalue>
            <customfieldvalue>csirac2</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrotsv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hriskn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>23282</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht0ebj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>