[KAFKA-51] MongoDB Event Roundtrip Created: 02/Aug/19  Updated: 28/Oct/23  Resolved: 22/Jan/21

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: 1.4.0

Type: New Feature Priority: Major - P3
Reporter: Christian Kurze (Inactive) Assignee: Christopher Cho
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Documented
Epic Link: MongoDB Kafka Connector - CDC support improvements
Documentation Changes: Needed
Documentation Changes Summary:

Notes from Robert:
For the sink CDC docs, set: change.data.capture.handler=com.mongodb.kafka.connect.sink.cdc.mongodb.ChangeStreamHandler
Build is here: https://oss.sonatype.org/content/repositories/snapshots/org/mongodb/kafka/mongo-kafka[…]NAPSHOT/mongo-kafka-connect-1.4.0-20210121.161627-13-all.jar

This is 1 of 2 key features for 1.4 release (approx first week of Feb)


 Description   

Support for CDC based on MongoDB Change Events

When using MongoDB as a source for a certain topic, the Change Events of the topic should be added into the target in CDC mode, similar to the CDC handling of the existing Debezium implementation.

A prototype is available in branch mongo_cdc here:

This feature allows to replicate all changes of a database into another one. Use cases can be: 1:1 replication of master data between different services; DR into a totally separate MongoDB cluster; partial replication into other MongoDB clusters; and more.



 Comments   
Comment by Githook User [ 21/Jan/21 ]

Author:

{'name': 'Ross Lawley', 'email': 'ross.lawley@gmail.com', 'username': 'rozza'}

Message: Added sink support for MongoDB Changestream events (#45)

Added CDC style support for all CRUD style changestream messages.

KAFKA-51
Branch: master
https://github.com/mongodb/mongo-kafka/commit/983a825b35ab53321ab7592625863a812210bd9e

Comment by Ross Lawley [ 14/Jan/21 ]

Moving back into progress to simplify the approach

Comment by Ross Lawley [ 08/Jan/21 ]

https://github.com/mongodb/mongo-kafka/pull/45

Generated at Thu Feb 08 09:05:27 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.