[KAFKA-32] Kafka Connector to Mongodb which imitates JDBC Connector Created: 04/Jun/19  Updated: 09/Jul/19  Resolved: 09/Jul/19

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: New Feature Priority: Major - P3
Reporter: Meirkhan Assignee: Scott L'Hommedieu (Inactive)
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates KAFKA-26 Continuous querying Closed

 Description   

I need the Kafka Connector to Mongodb which imitates JDBC Source Connector. So that data is loaded to Kafka by periodically executing a mongodb query from collection. Will there be implemented this kind of feature?



 Comments   
Comment by Ian Whalen (Inactive) [ 09/Jul/19 ]

closing this as a dupe of KAFKA-26 - please watch there where we will clean up the description and use that to track implementation.

Comment by Meirkhan [ 11/Jun/19 ]

Hi Ross,

My specific case:

I have stream of data from RDBMS > to Kafka which stores > to MongoDB.

Now I need to constantly check data in MongoDB with data in original source - RDBMS.

Therefore, I want to write in config file a query to collection I need and period of time to repeat, and Connector will produce this data into specific topic in Kafka.

 

Meirkhan

Comment by Ross Lawley [ 11/Jun/19 ]

Hi meirelop,

Thanks for the ticket! Currently, the source connector works off change streams and there is an option to return just the full document - would that meet your needs? If not could you provide some more information or even better an example of your usecase?

Ross

Generated at Thu Feb 08 09:05:24 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.