<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:05:52 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[KAFKA-215] New names for errors tolerance config properties</title>
                <link>https://jira.mongodb.org/browse/KAFKA-215</link>
                <project id="16285" key="KAFKA">Kafka Connector</project>
                    <description>&lt;p&gt;The &lt;tt&gt;errors.tolerance&lt;/tt&gt;, &lt;tt&gt;errors.log.enable&lt;/tt&gt;, and &lt;tt&gt;errors.deadletterqueue.topic.name&lt;/tt&gt; properties introduced as part of the work for &lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-78&quot; title=&quot;Publish error messages to a topic&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-78&quot;&gt;&lt;del&gt;KAFKA-78&lt;/del&gt;&lt;/a&gt;&#160;and &lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-105&quot; title=&quot;Support errors.tolerance&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-105&quot;&gt;&lt;del&gt;KAFKA-105&lt;/del&gt;&lt;/a&gt;&#160;conflict with the names of properties used by the Connect framework. This prevents users from configuring connectors with different values for the framework-level &lt;tt&gt;errors.tolerance&lt;/tt&gt; and the connector-level &lt;tt&gt;errors.tolerance&lt;/tt&gt; properties, for example, and can be problematic in environments where error tolerance is only enabled with the expectation that faulty records will be sent to a DLQ topic. Since no DLQ topic is supported by the sink connector itself (and likely won&apos;t be until the &lt;tt&gt;ErrorReporter&lt;/tt&gt; mechanism introduced in &lt;a href=&quot;https://cwiki.apache.org/confluence/display/KAFKA/KIP-610%3A+Error+Reporting+in+Sink+Connectors&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;KIP-610&lt;/a&gt;&#160;is leveraged), this forces users to choose between potential data loss (by setting &lt;tt&gt;errors.tolerance&lt;/tt&gt; to &lt;tt&gt;all&lt;/tt&gt;) and having the connector die on skip records that fail during the conversion/transformation phase (by setting &lt;tt&gt;errors.tolerance&lt;/tt&gt; to &lt;tt&gt;none&lt;/tt&gt;).&lt;/p&gt;

&lt;p&gt;It&apos;d be great if it were possible to set the framework-level &lt;tt&gt;errors.tolerance&lt;/tt&gt; property and related properties to different values than the ones recognized by the connector. Implementation-wise, a couple of options include:&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;Rename the existing configuration properties. For example, &lt;tt&gt;errors.tolerance&lt;/tt&gt; might be changed to &lt;tt&gt;mongo.errors.tolerance&lt;/tt&gt;.&lt;/li&gt;
	&lt;li&gt;Add new properties with different names that take precedence over the existing properties, if specified. Going with the above example, if someone specified only &lt;tt&gt;errors.tolerance = ALL&lt;/tt&gt;, then all errors would be tolerated; however, if someone specified both &lt;tt&gt;errors.tolerance = ALL&lt;/tt&gt; and &lt;tt&gt;mongo.errors.tolerance = NONE&lt;/tt&gt;, then no errors would be tolerated as the latter would take priority over the former.&lt;/li&gt;
	&lt;li&gt;Like option 2, add new properties with different names that take precedence over the existing properties if specified, but also deprecate the existing properties and note that they will be removed in an upcoming release.&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;Filed as critical (P2) priority as this has the potential right now to lead to unexpected data loss for users of the connector.&lt;/p&gt;</description>
                <environment></environment>
        <key id="1667744">KAFKA-215</key>
            <summary>New names for errors tolerance config properties</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="2" iconUrl="https://jira.mongodb.org/images/icons/priorities/critical.svg">Critical - P2</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="ross@mongodb.com">Ross Lawley</assignee>
                                    <reporter username="chrise@confluent.io">Chris Egerton</reporter>
                        <labels>
                    </labels>
                <created>Thu, 1 Apr 2021 02:08:07 +0000</created>
                <updated>Sat, 28 Oct 2023 10:46:10 +0000</updated>
                            <resolved>Thu, 10 Jun 2021 13:29:58 +0000</resolved>
                                    <version>1.5.0</version>
                                    <fixVersion>1.6.0</fixVersion>
                                    <component>Sink</component>
                    <component>Source</component>
                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="3870581" author="ross@10gen.com" created="Thu, 10 Jun 2021 13:30:35 +0000"  >&lt;p&gt;Thanks &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=chrise%40confluent.io&quot; class=&quot;user-hover&quot; rel=&quot;chrise@confluent.io&quot;&gt;chrise@confluent.io&lt;/a&gt;&#160;this has been merged into master and is scheduled for the 1.6.0 release.&lt;/p&gt;</comment>
                            <comment id="3870570" author="xgen-internal-githook" created="Thu, 10 Jun 2021 13:25:09 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Ross Lawley&apos;, &apos;email&apos;: &apos;ross.lawley@gmail.com&apos;, &apos;username&apos;: &apos;rozza&apos;}
&lt;p&gt;Message: Updated changelog&lt;/p&gt;

&lt;p&gt;Added mongo specific override options for error handling properties&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-215&quot; title=&quot;New names for errors tolerance config properties&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-215&quot;&gt;&lt;del&gt;KAFKA-215&lt;/del&gt;&lt;/a&gt;&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo-kafka/commit/ececd75d021d3c537ee474a00daa12f908e88e8f&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo-kafka/commit/ececd75d021d3c537ee474a00daa12f908e88e8f&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3870562" author="xgen-internal-githook" created="Thu, 10 Jun 2021 13:22:22 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Chris Egerton&apos;, &apos;email&apos;: &apos;chrise@confluent.io&apos;, &apos;username&apos;: &apos;C0urante&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/KAFKA-215&quot; title=&quot;New names for errors tolerance config properties&quot; class=&quot;issue-link&quot; data-issue-key=&quot;KAFKA-215&quot;&gt;&lt;del&gt;KAFKA-215&lt;/del&gt;&lt;/a&gt;: Add override options for error handling properties&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo-kafka/commit/3969d115d3e96d554aa43b009c58253782cd5ab8&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo-kafka/commit/3969d115d3e96d554aa43b009c58253782cd5ab8&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3695470" author="JIRAUSER1259239" created="Thu, 1 Apr 2021 02:10:41 +0000"  >&lt;p&gt;Ross Lawley--thoughts? Happy to do the PR legwork as long as this has some traction and is recognized as a worthwhile change.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10320">
                    <name>Documented</name>
                                                                <inwardlinks description="is documented by">
                                                        </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="1553401">KAFKA-177</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1341837">KAFKA-105</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10257" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Documentation Changes</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10250"><![CDATA[Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_14266" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Documentation Changes Summary</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;Document any new properties introduced as a result of this issue, and expand documentation to include behavioral changes to any existing properties.&lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hynsnr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>