<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:44:50 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-17542] Out of Memory crash with wiredTiger</title>
                <link>https://jira.mongodb.org/browse/SERVER-17542</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We upgraded to 3.0.0 following the day of release and did a mongorestore to entirely rebuild all of our databases into wiredTiger&apos;s engine.  It worked well for approximately 4 days of low-level usage before throwing an &quot;out of memory&quot; error during some regular (non-heavy) usage.&lt;/p&gt;

&lt;p&gt;It doesn&apos;t appear as if this is related to &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-16902&quot; title=&quot;wt cache: maximum page size at eviction (MB) exceeds memory_page_max by order of magnitude&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-16902&quot;&gt;&lt;del&gt;SERVER-16902&lt;/del&gt;&lt;/a&gt;, as we&apos;re talking about less than 100,000 inserts, updates, deletes over several days, and nothing in bulk.&lt;/p&gt;

&lt;p&gt;We&apos;re configured with 4GB of memory allocated to WT. Snappy compression is on, as is prefixCompression. The machine is virtual and dynamically allocates memory. It appears that the system was only using 8GB out of 12GB of potential memory at the time of crash.&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; wiredTiger:&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;  engineConfig:&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;   cacheSizeGB: 4&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2015-03-10T16:28:52.007-0500 I WRITE    [conn42060] remove Monitoring.RecordSearchIssue ndeleted:53714 keyUpdates:0 writeConflicts:0 numYields:2484 locks:{} 54255ms&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2015-03-10T16:28:52.009-0500 I COMMAND  [conn42060] command Monitoring.$cmd command: delete { delete: &quot;RecordSearchIssue&quot;, writeConcern: { fsync: false, j: true }, ordered: true, deletes: [ { q: {}, limit: 0 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:40 locks:{} 54257ms&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2015-03-10T16:28:52.369-0500 I COMMAND  [conn42060] command OnspringC1.$cmd command: listCollections { $query: { listCollections: 1 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:8432 locks:{} 289ms&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2015-03-10T16:28:52.648-0500 I CONTROL  [conn42060] Stack trace failed, SymInitialize failed with error 3765269347&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2015-03-10T16:28:52.648-0500 F -        [conn42060] out of memory.&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;</description>
                <environment></environment>
        <key id="188890">SERVER-17542</key>
            <summary>Out of Memory crash with wiredTiger</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="sam.kleinman">Sam Kleinman</assignee>
                                    <reporter username="sallgeud">Chad Kreimendahl</reporter>
                        <labels>
                    </labels>
                <created>Wed, 11 Mar 2015 15:19:26 +0000</created>
                <updated>Tue, 9 Jun 2015 21:03:14 +0000</updated>
                            <resolved>Tue, 21 Apr 2015 18:59:18 +0000</resolved>
                                    <version>3.0.0</version>
                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>13</watches>
                                                                                                                <comments>
                            <comment id="935646" author="mike@meshfire.com" created="Tue, 9 Jun 2015 21:03:14 +0000"  >&lt;p&gt;I have been regularly encountering an OOM error that I reported here:&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-16902&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-16902&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;This also seems related to &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-16977&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;16997&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="894207" author="ramon.fernandez" created="Tue, 21 Apr 2015 18:56:31 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sallgeud&quot; class=&quot;user-hover&quot; rel=&quot;sallgeud&quot;&gt;sallgeud&lt;/a&gt;, since you were not able to recreate the issue we&apos;re going to resolve this ticket. However you may want to tune into &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-17324&quot; title=&quot;NULL pointer exception during insert only stress under low memory condition&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-17324&quot;&gt;&lt;del&gt;SERVER-17324&lt;/del&gt;&lt;/a&gt; for updates on out-of-memory conditions in WiredTiger. See also &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-10044?focusedCommentId=891417&amp;amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-891417&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;this comment&lt;/a&gt; in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-10044&quot; title=&quot;Repeated Server Crash. VirtualProtect failure in mongo::makeChunkWritable (Windows 7 x64).&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-10044&quot;&gt;&lt;del&gt;SERVER-10044&lt;/del&gt;&lt;/a&gt; for more details on the effect of the initial size of the pagefile on memory allocations.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="878603" author="sallgeud" created="Fri, 10 Apr 2015 19:45:12 +0000"  >&lt;p&gt;I was not able to recreate it after rerunning the tool that does this.  We also just switched our dev system back to mmapv1 in preparation for regression testing of a release we have coming out.  We&apos;ll switch back over to WT in a few weeks, once we get all of our testing done.&lt;/p&gt;</comment>
                            <comment id="878600" author="ramon.fernandez" created="Fri, 10 Apr 2015 19:39:47 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sallgeud&quot; class=&quot;user-hover&quot; rel=&quot;sallgeud&quot;&gt;sallgeud&lt;/a&gt;, have you had a chance of running with a pagefile that&apos;s allowed to grow up to 12GB? Any progress testing things on your end?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="859767" author="sallgeud" created="Fri, 20 Mar 2015 21:30:35 +0000"  >&lt;p&gt;We have our classes keep track of their indexes (for the most part), so that shouldn&apos;t be a problem for us to just drop and recreate. Still have potential OOM issues.  Going to attempt to run with updated code on drop by Monday and confirm memory usage.&lt;/p&gt;</comment>
                            <comment id="859682" author="ramon.fernandez" created="Fri, 20 Mar 2015 20:12:41 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sallgeud&quot; class=&quot;user-hover&quot; rel=&quot;sallgeud&quot;&gt;sallgeud&lt;/a&gt;, &lt;/p&gt;

&lt;p&gt;on Windows if the pagefile is not being used it doesn&apos;t mean it wasn&apos;t needed &amp;#8211; it may mean that Windows could not find enough memory for a given request (see &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-10044&quot; title=&quot;Repeated Server Crash. VirtualProtect failure in mongo::makeChunkWritable (Windows 7 x64).&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-10044&quot;&gt;&lt;del&gt;SERVER-10044&lt;/del&gt;&lt;/a&gt;) &amp;#8211; so I&apos;d recommend you try Sam&apos;s suggestion of allowing the pagefile to grow to 12GB.&lt;/p&gt;

&lt;p&gt;Note that for every document removal the index needs to be updated as well, so on a collection with a large number of documents with a bunch of indexes a &lt;tt&gt;remove()&lt;/tt&gt; operation may take a long time and consume resources unnecessarily. Note that you can save the indexes and restore them later:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: #006699; font-weight: bold; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;function&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; restoreIndexes(element, index, array) {&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &lt;/span&gt;&lt;span style=&quot;color: #006699; font-weight: bold; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;if&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; (element.name != &lt;/span&gt;&lt;span style=&quot;color: blue; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;&quot;_id_&quot;&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;) {&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;        print(&lt;/span&gt;&lt;span style=&quot;color: blue; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;&apos;Restoring: &apos;&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; + tojson(element.key));&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;        db.foo.ensureIndex(element.key);&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: #006699; font-weight: bold; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;var&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; indexes = db.foo.getIndexes();&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;db.foo.drop();&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;indexes.forEach(restoreIndexes);&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;This simple approach does not &lt;a href=&quot;http://docs.mongodb.org/manual/reference/method/db.collection.createIndex/#options-for-all-index-types&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;preserve index options&lt;/a&gt; though, so the recommended approach would be for your application to keep track of what indexes are needed. Hope this helps.&lt;/p&gt;</comment>
                            <comment id="859613" author="sallgeud" created="Fri, 20 Mar 2015 19:41:48 +0000"  >&lt;p&gt;It doesn&apos;t appear as if we ever used more than ~250MB of swap/pagefile... or at least the system suggests that&apos;s the max its hit.  I&apos;m not terribly concerned about windows-only issues, as we&apos;re primarily not windows in our higher level environments with Mongo.  General concern is the crash vs graceful recovery or just degradation, which would be more understandable if paging.&lt;/p&gt;

&lt;p&gt;I&apos;d be happy to Collection.Drop(). However, doesn&apos;t that also destroy any indexes that were created?  We really need to keep all of the indexes while just nuking all of the data. More like a database style Truncate.  So, drop is substantially less practical than removeAll, by our estimation.&lt;/p&gt;

&lt;p&gt;From the docs:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Removes a collection from the database. The method also removes any indexes associated with the dropped collection. The method provides a wrapper around the drop command.&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;Yes, separate issue. Yes, version 3.0.1 still takes extraordinarily long to show dbs. Just mentioning it here because in getting info while debugging this, I find myself doing a ton of waiting &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/p&gt;

</comment>
                            <comment id="859450" author="samk" created="Fri, 20 Mar 2015 18:19:11 +0000"  >&lt;p&gt;Thanks for the response, a couple of things:&lt;/p&gt;

&lt;ol&gt;
	&lt;li&gt;calling &lt;tt&gt;remove()&lt;/tt&gt; with an empty query document is relatively expensive because MongoDB must perform the query and page all documents into memory just to delete them. Consider using a collection &lt;tt&gt;drop()&lt;/tt&gt; method for these kinds of operations.&lt;/li&gt;
	&lt;li&gt;we&apos;ve encountered a number of issues with windows deployments where the size of a page file becomes a limiting factor because of the way that windows manages memory. You may be able to resolve this issue by increasing the size of the page file. Can you see if you can reproduce the crash with a larger page size, perhaps try with sizes between 4gb and 12gb?&lt;/li&gt;
	&lt;li&gt;I believe that the latency on the &lt;tt&gt;show dbs&lt;/tt&gt; operation (i.e. the &lt;tt&gt;listDatabases&lt;/tt&gt; command) may be a distinct issue from the out of memory issue. Can you confirm that you&apos;re running a 3.0.x-series shell for this operation? Additionally, just to be sure, there aren&apos;t operations on other VMs on this machine that might be contending for storage access and that the slowdown with &lt;tt&gt;listDatabases&lt;/tt&gt;/&lt;tt&gt;listCollections&lt;/tt&gt; operation is stable after the first run. In general, we&apos;ll try to continue to address this issue as part of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-17078&quot; title=&quot;show databases taking extraordinarily long with wiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-17078&quot;&gt;&lt;del&gt;SERVER-17078&lt;/del&gt;&lt;/a&gt;.&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;Thanks for your patience!&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
sam&lt;/p&gt;</comment>
                            <comment id="857283" author="sallgeud" created="Wed, 18 Mar 2015 20:49:02 +0000"  >&lt;p&gt;Uncompressed data information (forgot to include): &lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;note: &amp;quot;show dbs&amp;quot; still takes approximately 30-60 seconds to run the first time and 20-30 sec subsequent when using wiredTiger with lots of collections&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;24 Databases&lt;/li&gt;
	&lt;li&gt;Most Under 100M in uncompressed data size&lt;/li&gt;
	&lt;li&gt;Largest:
&lt;blockquote&gt;
&lt;p&gt;        &quot;collections&quot; : 275,&lt;br/&gt;
        &quot;objects&quot; : 608596,&lt;br/&gt;
        &quot;avgObjSize&quot; : 1971.8336548383493,&lt;br/&gt;
        &quot;dataSize&quot; : 1200050075,&lt;br/&gt;
        &quot;storageSize&quot; : 345194496,&lt;br/&gt;
        &quot;numExtents&quot; : 0,&lt;br/&gt;
        &quot;indexes&quot; : 2951,&lt;br/&gt;
        &quot;indexSize&quot; : 154775552,&lt;br/&gt;
        &quot;ok&quot; : 1&lt;/p&gt;&lt;/blockquote&gt;&lt;/li&gt;
	&lt;li&gt;Database with issue:
&lt;blockquote&gt;
&lt;p&gt;        &quot;collections&quot; : 7,&lt;br/&gt;
        &quot;objects&quot; : 88548,&lt;br/&gt;
        &quot;avgObjSize&quot; : 141.33360437276957,&lt;br/&gt;
        &quot;dataSize&quot; : 12514808,&lt;br/&gt;
        &quot;storageSize&quot; : 4640768,&lt;br/&gt;
        &quot;numExtents&quot; : 0,&lt;br/&gt;
        &quot;indexes&quot; : 7,&lt;br/&gt;
        &quot;indexSize&quot; : 2056192,&lt;br/&gt;
        &quot;ok&quot; : 1&lt;/p&gt;&lt;/blockquote&gt;&lt;/li&gt;
&lt;/ul&gt;
</comment>
                            <comment id="857270" author="sallgeud" created="Wed, 18 Mar 2015 20:41:49 +0000"  >&lt;p&gt;How much storage is available to MongoDB in the dbPath directory?&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Total of 128 GB. 80.1 GB Free&lt;/p&gt;&lt;/blockquote&gt;


&lt;p&gt;What is your data size? Both, in terms of the data files exactly, and the data size reported by dbStats?&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;WiredTiger directory (since I left the mmapv1 dir in place and used a new one for wt): &lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;21,333 files&lt;/li&gt;
	&lt;li&gt;76 folders&lt;/li&gt;
	&lt;li&gt;2.88 GB Actual&lt;/li&gt;
	&lt;li&gt;3.90 GB On Disk (because of page sizes)&lt;/li&gt;
&lt;/ul&gt;
&lt;/blockquote&gt;


&lt;p&gt;What is the size of the page file?&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;2GB&lt;/p&gt;&lt;/blockquote&gt;


&lt;p&gt;Is this system running directly on hardware or in some sort of virtual environment?&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Hyper-V. &lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Server 2012 R2 host and virtual system.&lt;/li&gt;
	&lt;li&gt;Gen 1 Hyper-V&lt;/li&gt;
	&lt;li&gt;Dynamic Memory allocation (8GB min - 12GB max)&lt;/li&gt;
	&lt;li&gt;Recently changed to fixed 12GB&lt;/li&gt;
	&lt;li&gt;Solid state backed drives.&lt;/li&gt;
&lt;/ul&gt;
&lt;/blockquote&gt;


&lt;p&gt;Have you tested this with the latest stable production release (3.0.1?)&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Installed today. Encountered the race condition on shutdown vs service shutdown on windows, but otherwise ok. Will have to wait a week or so to know for sure.&lt;/p&gt;&lt;/blockquote&gt;


&lt;p&gt;Do you have a sense of what the operation (i.e. the delete operation on the second line of your log) was? It looks like you deleted 50k records just prior to the error. Would it be possible to try and recreate this issue to ensure that some aspect of the delete operation doesn&apos;t trigger the error?&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;There were no other log entries for approximately 10 minutes prior to those. It looks like we performed a Collection.RemoveAll() (C#), prior to rebuilding the content. So, a relatively simple delete of the collection that appears to have taken quite a long time. It&apos;s unknown whether it was in the middle of a checkpoint or some other back-end, as it happened when nobody was really using the system.  This call is done once a day as part of a cleanup process while doing system analysis and comparison of indexing results. It runs automatically, so there were no live users on the system at the time&lt;/p&gt;

&lt;p&gt;This is our dev system which is currently on the 1.10 version of the C# driver, which appears to call collection.delete with a null query (as also seen in the log). I&apos;m unsure what would have cause the duration of the delete. I can very easily replicate this portion of it at any time by manually restarting our monitoring system.&lt;/p&gt;&lt;/blockquote&gt;
</comment>
                            <comment id="857154" author="samk" created="Wed, 18 Mar 2015 18:52:54 +0000"  >&lt;p&gt;Sorry that you&apos;ve hit this error.  Can you provide more information about the environment where this is running? The answers to the following questions may help us debug&lt;/p&gt;

&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;How much storage is available to MongoDB in the &lt;tt&gt;dbPath&lt;/tt&gt; directory?&lt;/li&gt;
&lt;/ul&gt;


&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;What is your data size? Both, in terms of the data files exactly, and the data size reported by dbStats?&lt;/li&gt;
&lt;/ul&gt;


&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;What is the size of the page file?&lt;/li&gt;
&lt;/ul&gt;


&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Is this system running directly on hardware or in some sort of virtual environment?&lt;/li&gt;
&lt;/ul&gt;


&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Have you tested this with the latest stable production release (3.0.1?)&lt;/li&gt;
&lt;/ul&gt;


&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Do you have a sense of what the operation (i.e. the delete operation on the second line of your log) was? It looks like you deleted 50k records just prior to the error. Would it be possible to try and recreate this issue to ensure that some aspect of the delete operation doesn&apos;t trigger the error?&lt;/li&gt;
&lt;/ul&gt;
</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="185007">SERVER-17324</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>11.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 18 Mar 2015 18:52:54 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        8 years, 36 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>mike@meshfire.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            8 years, 36 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>sallgeud</customfieldvalue>
            <customfieldvalue>mike@meshfire.com</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
            <customfieldvalue>sam.kleinman</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrlazr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hs70n3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsg7ev:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>