<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:05:54 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[KAFKA-230] Change stream doesn&apos;t recover with errors.tolerance=all on Mongo 4</title>
                <link>https://jira.mongodb.org/browse/KAFKA-230</link>
                <project id="16285" key="KAFKA">Kafka Connector</project>
                    <description>&lt;p&gt;Currently if we fall off the end of the oplog for whatever reason we get the following error on mongo 4:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;INFO An exception occurred when trying to get the next item from the Change Stream: Query failed with error code &lt;/span&gt;&lt;span style=&quot;color: #009900; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;280&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; and error message &lt;/span&gt;&lt;span style=&quot;color: blue; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;&apos;Resume of change stream was not possible, as the resume point may no longer be in the oplog.&apos;&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; on server mongos-profile-&lt;/span&gt;&lt;span style=&quot;color: #009900; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;1&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;.sailthru.cloud:&lt;/span&gt;&lt;span style=&quot;color: #009900; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;17020&lt;/span&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; (com.mongodb.kafka.connect.source.MongoSourceTask)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;With&#160;errors.tolerance=all the source should auto recover starting with a fresh &quot;change stream&quot;.&lt;/p&gt;

&lt;p&gt;However this doesn&apos;t happen due to:&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;The&#160;resumeTokenNotFound error detection not matching on the returned error.&lt;/li&gt;
	&lt;li&gt;The error actually being thrown during the reading of the cursor, not the creation of the cursor(where the recovery logic currently lives)&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;This minimal patch is enough to fix for us &lt;a href=&quot;https://github.com/tim-patterson/mongo-kafka/commit/a281a6c42256efdea6613e5a2a91bca61cfa75c6&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/tim-patterson/mongo-kafka/commit/a281a6c42256efdea6613e5a2a91bca61cfa75c6&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;(I&apos;m currently chasing up on my companies open source policies so I&apos;m not sure if I&apos;m going to be in a position to submit a fix/PR)&lt;/p&gt;</description>
                <environment>Confluent 5.5.4 (kafka 2.4.x I believe)</environment>
        <key id="1766643">KAFKA-230</key>
            <summary>Change stream doesn&apos;t recover with errors.tolerance=all on Mongo 4</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="10300" iconUrl="https://jira.mongodb.org/images/icons/priorities/medium.svg">Unknown</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="ross@mongodb.com">Ross Lawley</assignee>
                                    <reporter username="tpatterson@sailthru.com">Tim Patterson</reporter>
                        <labels>
                            <label>external-user</label>
                    </labels>
                <created>Wed, 2 Jun 2021 19:43:58 +0000</created>
                <updated>Sat, 28 Oct 2023 10:46:12 +0000</updated>
                            <resolved>Fri, 9 Jul 2021 08:51:09 +0000</resolved>
                                    <version>1.5.1</version>
                    <version>1.6.0</version>
                                    <fixVersion>1.6.0</fixVersion>
                                    <component>Source</component>
                                        <votes>0</votes>
                                    <watches>1</watches>
                                                                                                                <comments>
                            <comment id="3924813" author="xgen-internal-githook" created="Fri, 9 Jul 2021 08:43:28 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Ross Lawley&apos;, &apos;email&apos;: &apos;ross.lawley@gmail.com&apos;, &apos;username&apos;: &apos;rozza&apos;}
&lt;p&gt;Message: Fixed Source Connector recovery during getMore call (#79)&lt;/p&gt;


&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-230&quot; title=&quot;Change stream doesn&amp;#39;t recover with errors.tolerance=all on Mongo 4&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-230&quot;&gt;&lt;del&gt;KAFKA-230&lt;/del&gt;&lt;/a&gt; &lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-219&quot; title=&quot;Source Connector unable to recover from broken change stream due to event &amp;gt; 16MB&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-219&quot;&gt;&lt;del&gt;KAFKA-219&lt;/del&gt;&lt;/a&gt;&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo-kafka/commit/2f1b034437cb140d8d30682169fbb633c98c5623&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo-kafka/commit/2f1b034437cb140d8d30682169fbb633c98c5623&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3920462" author="ross@10gen.com" created="Wed, 7 Jul 2021 14:27:35 +0000"  >&lt;p&gt;PR: &lt;a href=&quot;https://github.com/mongodb/mongo-kafka/pull/79&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo-kafka/pull/79&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3860764" author="esha.bhargava" created="Fri, 4 Jun 2021 19:30:09 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=tpatterson%40sailthru.com&quot; class=&quot;user-hover&quot; rel=&quot;tpatterson@sailthru.com&quot;&gt;tpatterson@sailthru.com&lt;/a&gt; Thank you for reporting this issue! We&apos;ll look into it and get back to you soon.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hr3o07:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>