<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:06:16 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[KAFKA-392] Support for multiple clusters on one source connector</title>
                <link>https://jira.mongodb.org/browse/KAFKA-392</link>
                <project id="16285" key="KAFKA">Kafka Connector</project>
                    <description>&lt;p&gt;Hello!&lt;/p&gt;

&lt;p&gt;Thanks for the multiplexing capabilities by being able to specify multiple collections and also multiple topics to fan that out into.&lt;/p&gt;

&lt;p&gt;Have a question/request related to multiplexing multiple collections located in multiple clusters. I have not seen that as a possibility as only 1 URI is allowed to be configured.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Is there a special way I am missing to configure the URI such that multiple clusters are accessible to the changestream? is there some Mongo technology that can be stood up as an aggregator ?&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Use case: For replication purposes you are forced to deploy 1 source connector per mongo cluster. but that is overkill as there is not a lot of volume and we have a lot of clusters.&#160;&lt;/p&gt;

&lt;p&gt;Expected: Ability to connect to multiple mongo clusters as a source&lt;/p&gt;</description>
                <environment></environment>
        <key id="2516558">KAFKA-392</key>
            <summary>Support for multiple clusters on one source connector</summary>
                <type id="6" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14720&amp;avatarType=issuetype">Question</type>
                                            <priority id="10300" iconUrl="https://jira.mongodb.org/images/icons/priorities/medium.svg">Unknown</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="robert.walters@mongodb.com">Robert Walters</assignee>
                                    <reporter username="florin@leadiq.com">Florin Bun&#259;u</reporter>
                        <labels>
                    </labels>
                <created>Tue, 5 Dec 2023 12:33:53 +0000</created>
                <updated>Thu, 1 Feb 2024 15:16:46 +0000</updated>
                            <resolved>Thu, 1 Feb 2024 15:16:46 +0000</resolved>
                                                                    <component>Source</component>
                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="6056985" author="JIRAUSER1270335" created="Wed, 31 Jan 2024 19:45:29 +0000"  >&lt;p&gt;Hi Robert, I appreciate the details. yep i imagined this might be the case. thank you for the confirmation&lt;/p&gt;</comment>
                            <comment id="6055464" author="robert.walters" created="Wed, 31 Jan 2024 12:24:41 +0000"  >&lt;p&gt;Today, change streams only work within a single cluster, which is why the kafka connector can only support a single cluster.&#160; To add multiple listeners to the Kafka connector for a single instance isn&apos;t something that would come easy as it would require storing multiple resume tokens and dealing with error conditions where one cluster might be offline but the others are online, or similar scenarios where one resume token from a cluster might have fallen off the oplog but the others are fine so do you fail the connector as a whole or just that cluster, etc.. It would be a very large work item and given the amount of other tickets that are requested, I do not see this as something we can implement in the connector.&#160; The scenario you are describing might be better handled with an ETL tool that is designed to handle this multiplexing.&lt;/p&gt;</comment>
                            <comment id="6055130" author="JIRAUSER1270335" created="Wed, 31 Jan 2024 09:42:45 +0000"  >&lt;p&gt;Hello. any updates on this ? Do you think it would be possible ?&#160;&lt;/p&gt;</comment>
                            <comment id="5925936" author="dbeng-pm-bot" created="Tue, 5 Dec 2023 12:33:56 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=florin%40leadiq.com&quot; class=&quot;user-hover&quot; rel=&quot;florin@leadiq.com&quot;&gt;florin@leadiq.com&lt;/a&gt;, thank you for reporting this issue! The team will look into it and get back to you soon. &lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                        <customfield id="customfield_23812" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Assigned Team</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="26447"><![CDATA[Java Drivers]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i2l0l8:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>