[KAFKA-82] Unable to set "topics.regex" for sink connector Created: 10/Feb/20  Updated: 28/Oct/23  Resolved: 17/Apr/20

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: 1.0
Fix Version/s: 1.1

Type: Improvement Priority: Minor - P4
Reporter: Tim Brand Assignee: Ross Lawley
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to KAFKA-263 Confluent MongoDbAtlasSinkConnector t... Closed

 Description   

The confluent documentation notes that it's possible to set either a `topics` property of `topics.regex` property. (see https://docs.confluent.io/current/installation/configuration/connect/sink-connect-configs.html)
We tried to set the `topics.regex`, but then we get the error that the required setting `topics` is missing in the config. But the documentation says: "Only one of topics or topics.regex should be specified". Setting both the `topics` and the `topics.regex` will result in an error too, saying that there should only be configured one of them.

 

Is there any possibility to use the `topics.regex` property instead of `topics`?

 

Kafka Connect version: 5.4.0

MongoDB Connect version: 1.0.0



 Comments   
Comment by Githook User [ 17/Apr/20 ]

Author:

{'name': 'Ross Lawley', 'email': 'ross.lawley@gmail.com', 'username': 'rozza'}

Message: Added support for topics.regex

KAFKA-82
Branch: master
https://github.com/mongodb/mongo-kafka/commit/5d8c3d5f91e3d2aac6e30ee32de48c9e136c320b

Comment by Ross Lawley [ 15/Apr/20 ]

https://github.com/rozza/mongo-kafka/pull/15

Comment by Tim Brand [ 14/Feb/20 ]

Hi Ross, 

Thanks, great to hear that!

Comment by Ross Lawley [ 13/Feb/20 ]

Hi tim.brand@schiphol.nl,

Thanks for reporting, at the moment it isn't possible but I'll schedule this ticket to add support in the future.

 

Kind Regards,

Ross

Generated at Thu Feb 08 09:05:32 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.