<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:05:40 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[KAFKA-138] Improve resume change stream error message</title>
                <link>https://jira.mongodb.org/browse/KAFKA-138</link>
                <project id="16285" key="KAFKA">Kafka Connector</project>
                    <description>&lt;p&gt;In &lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-91&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/KAFKA-91&lt;/a&gt; added error message.&lt;br/&gt;
 I think it&apos;s not completely correct.&lt;br/&gt;
 &lt;a href=&quot;https://github.com/mongodb/mongo-kafka/blob/master/src/main/java/com/mongodb/kafka/connect/source/MongoSourceTask.java#L300-L301&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo-kafka/blob/master/src/main/java/com/mongodb/kafka/connect/source/MongoSourceTask.java#L300-L301&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Kafka Connect uses its own mechanism, not kafka consumer group to store offsets for source connectors. So, as far as I understand there is no way to use kafka-consumer-groups.sh to reset offsets.&lt;/p&gt;

&lt;p&gt;If I&apos;m wrong about using kafka-consumer-groups.sh, please make the message more explicit.&lt;/p&gt;

&lt;p&gt;Could be helpful:&lt;br/&gt;
 &lt;a href=&quot;https://rmoff.net/2019/08/15/reset-kafka-connect-source-connector-offsets/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://rmoff.net/2019/08/15/reset-kafka-connect-source-connector-offsets/&lt;/a&gt;&lt;/p&gt;</description>
                <environment></environment>
        <key id="1432441">KAFKA-138</key>
            <summary>Improve resume change stream error message</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13202">Works as Designed</resolution>
                                        <assignee username="ross@mongodb.com">Ross Lawley</assignee>
                                    <reporter username="andreworty@gmail.com">Andrey B</reporter>
                        <labels>
                    </labels>
                <created>Thu, 6 Aug 2020 13:59:17 +0000</created>
                <updated>Fri, 27 Oct 2023 11:54:15 +0000</updated>
                            <resolved>Mon, 17 Aug 2020 13:32:04 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="3342351" author="JIRAUSER1269378" created="Mon, 17 Aug 2020 14:12:19 +0000"  >&lt;p&gt;Hi, my mistake. I wasn&apos;t clear enough. &lt;br/&gt;
 I spoke only about source connectors.&lt;/p&gt;

&lt;p&gt;I mean Source connector uses&#160;&lt;a href=&quot;https://github.com/apache/kafka/blob/trunk/connect/runtime/src/main/java/org/apache/kafka/connect/storage/OffsetStorageReaderImpl.java&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;OffsetStorageReader&lt;/a&gt; and &lt;a href=&quot;https://github.com/apache/kafka/blob/trunk/connect/runtime/src/main/java/org/apache/kafka/connect/storage/OffsetStorageWriter.java&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;OffsetStorageWriter&lt;/a&gt; to work with offsets. So, there is no consumer group and kafka-consumer-groups.sh can&apos;t be used.&lt;/p&gt;

&lt;p&gt;See more: &lt;a href=&quot;https://github.com/apache/kafka/blob/trunk/connect/runtime/src/main/java/org/apache/kafka/connect/storage/OffsetStorageWriter.java#L39-L43&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/apache/kafka/blob/trunk/connect/runtime/src/main/java/org/apache/kafka/connect/storage/OffsetStorageWriter.java#L39-L43&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3342252" author="ross@10gen.com" created="Mon, 17 Aug 2020 13:31:53 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=andreworty%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;andreworty@gmail.com&quot;&gt;andreworty@gmail.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Offsets are handled by Kafka outside of the connector.  The connector itself just declares an offset when producing SourceRecords.  This allows for changes in Kafka topologies and connector restarts.  As far as I&apos;m aware the Kafka connect uses the existing Kafka offset mechanisms and as such you can either delete the offset file when running standalone or manage the meta data in the offset topic via the mentioned shell script or manually.&lt;/p&gt;

&lt;p&gt;As &lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-134&quot; title=&quot;Improve error handling for the source and sink&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-134&quot;&gt;&lt;del&gt;KAFKA-134&lt;/del&gt;&lt;/a&gt; will also look into making errors, missing offsets etc easier to deal with, I&apos;m closing this ticket.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hxlhpr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>