[KAFKA-107] add data transformation logic in source connector Created: 11/May/20  Updated: 19/May/20  Resolved: 19/May/20

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: 1.0.1
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Tejas Rawat Assignee: Robert Walters
Resolution: Won't Fix Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Prod


Documentation Changes: Not Needed

 Description   

We are using mongo kafka source connector to push data into kafka from mongo change-stream.We want to perform some data transformation before sending data into Kafka , How it can be done?



 Comments   
Comment by Robert Walters [ 19/May/20 ]

While the aggregation pipeline can be used to transform and filter in some scenarios, this type of capability is best performed by utilizing the native Kafka Single Message Transforms feature.

Generated at Thu Feb 08 09:05:36 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.