[KAFKA-109] Allow subset of collections in source Connector. Created: 02/Jun/20  Updated: 27/Oct/23  Resolved: 15/Jul/20

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: Gil Vander Marcken Assignee: Robert Walters
Resolution: Gone away Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Documented

 Description   

Hello,

Currently, when using the source connector you have two options avaliable : either you watch a single collection or you watch all the collections in the database.

It will be nice to be able to specify collections: collectionA, collectionB and the source connector will onyl watches those two collections in the database.



 Comments   
Comment by Robert Walters [ 22/Jun/20 ]

You can specify collections using a pipeline statement in the source connector definition

something like:

...

"pipeline": "[{\"$match\": {\"ns.coll\":

{\"$regex\": /^(col1|col2)$/}

}}]",

...

 

 

Generated at Thu Feb 08 09:05:36 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.