<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:05:34 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[KAFKA-96] Source Connector: The resume token UUID does not exist</title>
                <link>https://jira.mongodb.org/browse/KAFKA-96</link>
                <project id="16285" key="KAFKA">Kafka Connector</project>
                    <description>&lt;p&gt;Component: Confluent Kafka Connector &lt;br/&gt;
Version: 1.0.1&lt;/p&gt;

&lt;p&gt;MongoDB version: 3.6.16, sharded cluster&#160;&lt;/p&gt;

&lt;p&gt;Related tickets:&#160;&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-32088&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-32088&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-32029&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-32029&lt;/a&gt;&lt;/p&gt;





&lt;p&gt;Issue:&#160;&lt;/p&gt;

&lt;p&gt;&lt;tt&gt;Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:179)&lt;/tt&gt;&lt;/p&gt;

&lt;p&gt;&lt;tt&gt;com.mongodb.MongoCommandException: Command failed with error 40615 (Location40615): &apos;The resume token UUID does not exist. Has the collection been dropped?&apos; on server xxx. The full response is {&quot;ok&quot;: 0.0, &quot;errmsg&quot;: &quot;The resume token UUID does not exist. Has the collection been dropped?&quot;, &quot;code&quot;: 40615, &quot;codeName&quot;: &quot;Location40615&quot;, &quot;operationTime&quot;: {&quot;$timestamp&quot;: {&quot;t&quot;: 1584614769, &quot;i&quot;: 95&lt;/tt&gt;, &quot;$clusterTime&quot;: {&quot;clusterTime&quot;: {&quot;$timestamp&quot;: {&quot;t&quot;: 1584614769, &quot;i&quot;: 95}}, &quot;signature&quot;: {&quot;hash&quot;: &lt;/p&gt;
{&quot;$binary&quot;: &quot;2BrRm3m276aXzvoFKW+R/TnxNMU=&quot;, &quot;$type&quot;: &quot;00&quot;}
&lt;p&gt;, &quot;keyId&quot;: {&quot;$numberLong&quot;: &quot;6763316478826514148&quot;}}}}}}&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;The error happens when a changeStream generated by the Kafka Connector cannot find the collection on the target server via the mongos. This is a known bug which is fixed in MongoDB 4+ as seen in ticket &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-32029&quot; title=&quot;ChangeStream resumeAfter does not work on unsharded collections if there is more than one shard in the system&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-32029&quot;&gt;&lt;del&gt;SERVER-32029&lt;/del&gt;&lt;/a&gt; and a backport for this will not be implemented. Upgrading to MongoDB 4+ is not an option for the time being due to time constraints&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Questions:&lt;/p&gt;

&lt;p&gt;We were wondering if there was a workaround for this specific issue? We use tag based sharding and we shard the collections based on this tag. We have one active shard currently -&amp;gt;&#160; we know which shard is receiving writes and where the data is located. We thought it might be possible to tail the oplog of the shard primary in the active shard using the Kafka Connector, receive the data and dump it to Kafka, thoughts on this / is this even plausible? Is the only way to receive data through mongos using changeStreams initiated by the Kafka Connector when we&#8217;re dealing with a sharded MongoDB cluster?&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Workflow:&lt;/p&gt;

&lt;p&gt;MongoDB Shard/ReplicaSet Oplog (current active shard) &#8594; KafkaConnector &#8594;Kafka Cluster&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment>Component: Confluent Kafka Connector &lt;br/&gt;
Version: 1.0.1&lt;br/&gt;
&lt;br/&gt;
MongoDB version: 3.6.16, sharded cluster&amp;#xA0;</environment>
        <key id="1309483">KAFKA-96</key>
            <summary>Source Connector: The resume token UUID does not exist</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="ross@mongodb.com">Ross Lawley</assignee>
                                    <reporter username="pietro.partescano@adevinta.com">Pietro Partescano</reporter>
                        <labels>
                    </labels>
                <created>Thu, 9 Apr 2020 11:55:42 +0000</created>
                <updated>Fri, 11 Sep 2020 12:57:02 +0000</updated>
                            <resolved>Fri, 11 Sep 2020 12:57:02 +0000</resolved>
                                                    <fixVersion>1.3.0</fixVersion>
                                    <component>Source</component>
                                        <votes>0</votes>
                                    <watches>1</watches>
                                                                                                                <comments>
                            <comment id="3387039" author="ross@10gen.com" created="Fri, 11 Sep 2020 12:57:02 +0000"  >&lt;p&gt;Better support for errors.tolerance in the source connector (&lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-105&quot; title=&quot;Support errors.tolerance&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-105&quot;&gt;&lt;del&gt;KAFKA-105&lt;/del&gt;&lt;/a&gt;) and / or use of the postBatchResumeToken (&lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-76&quot; title=&quot;Reuse the postBatchResumeToken&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-76&quot;&gt;&lt;del&gt;KAFKA-76&lt;/del&gt;&lt;/a&gt;)  will help users manage when resume tokens are missing.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="1036772">KAFKA-76</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1341837">KAFKA-105</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10857" key="com.pyxis.greenhopper.jira:gh-epic-link">
                        <customfieldname>Epic Link</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>KAFKA-134</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hx1vyn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>