<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:51:45 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-19688] TTL Index is having more Latency</title>
                <link>https://jira.mongodb.org/browse/SERVER-19688</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi Team,&lt;br/&gt;
We are using mongodb V 3.0.4 and storage engine of &quot;WiredTiger&quot;. In one of  our collections&apos;, we are storing the security/auth tokens with TTL index on token expiry time. We are aware that, as per our mongo documentation, we will have a latency of around 1 min. But in our system we are seeing a latency of around 15 - 20 mins. As we are planning to implement authentication based on the same, it would be a major security concern.&lt;br/&gt;
Another interesting fact we found here is, even after 15 mins, the TTL logic is only deleting the oldest record and not all the expired records. Say for example, if TTL indexed column is having timestamps, 10:25am, 10:26am, 10:28 am etc... and while we check at around 10:40am only record with 10:25am is getting deleted and not all the expired data, similarly say at 10:45 am it is deleting only record with 10:26am and not all the expired data.&lt;br/&gt;
We checked if any option to reduce the sync time, but as per mongo documentation, we couldn&apos;t find a one.&lt;br/&gt;
Kindly guide us on the same.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Kingsly J&lt;/p&gt;</description>
                <environment></environment>
        <key id="223553">SERVER-19688</key>
            <summary>TTL Index is having more Latency</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="ramon.fernandez@mongodb.com">Ramon Fernandez Marina</assignee>
                                    <reporter username="jebas">Kingsly J</reporter>
                        <labels>
                    </labels>
                <created>Fri, 31 Jul 2015 06:42:02 +0000</created>
                <updated>Mon, 10 Aug 2015 18:18:52 +0000</updated>
                            <resolved>Mon, 10 Aug 2015 18:18:52 +0000</resolved>
                                    <version>3.0.4</version>
                                                    <component>TTL</component>
                                        <votes>0</votes>
                                    <watches>9</watches>
                                                                                                                <comments>
                            <comment id="1000958" author="ramon.fernandez" created="Mon, 10 Aug 2015 18:17:25 +0000"  >&lt;p&gt;Thanks for the additional details &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=jebas&quot; class=&quot;user-hover&quot; rel=&quot;jebas&quot;&gt;jebas&lt;/a&gt;, sorry to hear that expiring docs at a specific clock time didn&apos;t work well for you either. I&apos;m afraid that the only suitable workaround at time may be to use a regular collection and do the expiration manually at the application level.&lt;/p&gt;

&lt;p&gt;I am going to post your results in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19334&quot; title=&quot;TTL index deletions cannot always keep up with insertions with WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-19334&quot;&gt;&lt;del&gt;SERVER-19334&lt;/del&gt;&lt;/a&gt; and close this ticket as a duplicate. Feel free to vote for &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19334&quot; title=&quot;TTL index deletions cannot always keep up with insertions with WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-19334&quot;&gt;&lt;del&gt;SERVER-19334&lt;/del&gt;&lt;/a&gt; and to watch it to receive updates.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="995958" author="jebas" created="Tue, 4 Aug 2015 13:47:35 +0000"  >&lt;p&gt;Hi Ramon,&lt;br/&gt;
Thanks for your reply.&lt;br/&gt;
we have tried the option of &quot;expiring docs at specific time clock&quot; also, and having the same issue. We had issues in checking with changing the timezones/ storage engine as it would affect our development process as few other instances are running on the same machine.&lt;br/&gt;
Regarding the workload, the TTL indexes collection will not have more than 500 records at any point in time. The overall workload is littlebit higher.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Kingsly J &lt;/p&gt;</comment>
                            <comment id="995543" author="ramon.fernandez" created="Mon, 3 Aug 2015 22:07:04 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=jebas&quot; class=&quot;user-hover&quot; rel=&quot;jebas&quot;&gt;jebas&lt;/a&gt;; after further discussion we believe this ticket is a duplicate of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19334&quot; title=&quot;TTL index deletions cannot always keep up with insertions with WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-19334&quot;&gt;&lt;del&gt;SERVER-19334&lt;/del&gt;&lt;/a&gt;, which we want to address in the current development cycle. It is much less likely that this is a bug in timezone handling.&lt;/p&gt;

&lt;p&gt;Can you provide us more details with the overall load on this server as well as the load on the affected TTL collection? There may be ways to optimize this server&apos;s performance to lower the latency of document deletion. Also, have you tried &lt;a href=&quot;http://docs.mongodb.org/manual/tutorial/expire-data/#expire-documents-at-a-specific-clock-time&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;expiring documents at a specific clock time&lt;/a&gt; as proposed above?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="994499" author="ramon.fernandez" created="Sat, 1 Aug 2015 13:13:51 +0000"  >&lt;p&gt;Thanks for your report &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=jebas&quot; class=&quot;user-hover&quot; rel=&quot;jebas&quot;&gt;jebas&lt;/a&gt;. I see your time zone is IST, which is currently UTC+5:30. I wonder if there&apos;s a bug in handling time zones in &lt;tt&gt;mongod&lt;/tt&gt;, so here are some options to investigate this:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;would you be able to set the time zone to a value that has full hour differences with UTC and repeat the experiment? For example, YEKT (UTC+5) or NOVT (UTC+6).&lt;/li&gt;
	&lt;li&gt;would you be able to repeat the experiment with the MMAPv1 storage engine for IST and YEKT/NOVT? In other words, if there&apos;s a bug is it also present in MMAPv1? That would help determine the next step.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;A possible alternative you may want to try as well is to slightly modify your application to &lt;a href=&quot;http://docs.mongodb.org/manual/tutorial/expire-data/#expire-documents-at-a-specific-clock-time&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;expire documents at a specific clock time&lt;/a&gt;. This feature might give you the fine-grained control you need in your application.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="215708">SERVER-19334</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>4.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 31 Jul 2015 10:50:06 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        8 years, 27 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            8 years, 27 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>jebas</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrkyxj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hsc8zj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsfson:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>