<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:05:59 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[KAFKA-272] Allow connector to only do Copy Existing and no Change Streams</title>
                <link>https://jira.mongodb.org/browse/KAFKA-272</link>
                <project id="16285" key="KAFKA">Kafka Connector</project>
                    <description>&lt;p&gt;We have to read a lot of historic data (2+ TB) and it is taking too long because of CPU limitations (can&apos;t get connector to use all 4 cores), so we are thinking about having multiple instances of the connector to import different portions of the historic data but only one instance to do the change streams but we can&apos;t find a clean way to configure this since it seems all instances would automatically switch to the change stream once they are done with their corresponding Copy Existing portion. Thanks for any advice or help you can give us with this.&lt;/p&gt;</description>
                <environment></environment>
        <key id="1952359">KAFKA-272</key>
            <summary>Allow connector to only do Copy Existing and no Change Streams</summary>
                <type id="2" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14711&amp;avatarType=issuetype">New Feature</type>
                                            <priority id="10300" iconUrl="https://jira.mongodb.org/images/icons/priorities/medium.svg">Unknown</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13202">Works as Designed</resolution>
                                        <assignee username="robert.walters@mongodb.com">Robert Walters</assignee>
                                    <reporter username="daniel@haystack.tv">Daniel Barreto</reporter>
                        <labels>
                            <label>external-user</label>
                    </labels>
                <created>Thu, 16 Dec 2021 17:10:42 +0000</created>
                <updated>Fri, 27 Oct 2023 11:54:13 +0000</updated>
                            <resolved>Wed, 5 Jan 2022 15:22:34 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="4276282" author="robert.walters" created="Wed, 5 Jan 2022 15:22:34 +0000"  >&lt;p&gt;Resolved by customer&lt;/p&gt;</comment>
                            <comment id="4276139" author="JIRAUSER1269898" created="Wed, 5 Jan 2022 14:46:30 +0000"  >&lt;p&gt;Yes, we figured it out. Thank You!&lt;/p&gt;</comment>
                            <comment id="4275021" author="robert.walters" created="Tue, 4 Jan 2022 21:08:00 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=daniel%40haystack.tv&quot; class=&quot;user-hover&quot; rel=&quot;daniel@haystack.tv&quot;&gt;daniel@haystack.tv&lt;/a&gt;&#160;You can configure multiple instances of the connector each with their own pipeline using copy.existing filter that would effectively take a portion of the data.&#160; &lt;a href=&quot;https://docs.mongodb.com/kafka-connector/master/source-connector/usage-examples/copy-existing-data/#filter-data.&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://docs.mongodb.com/kafka-connector/master/source-connector/usage-examples/copy-existing-data/#filter-data.&lt;/a&gt;&#160; E.g. connector 1 could have a filter where state=&apos;ny&apos;, connector 2 where state=&apos;ma&apos;, etc.. that kind of setup.&#160; Im not sure if your data can be broken up this way but this is one option.&#160; Would this work for you?&lt;/p&gt;</comment>
                            <comment id="4262393" author="esha.bhargava" created="Tue, 21 Dec 2021 19:12:29 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=daniel%40haystack.tv&quot; class=&quot;user-hover&quot; rel=&quot;daniel@haystack.tv&quot;&gt;daniel@haystack.tv&lt;/a&gt; Thank you for reporting the issue! We&apos;ll look into it and get back to you soon.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hzy4bj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>