[KAFKA-107] add data transformation logic in source connector Created: 11/May/20 Updated: 19/May/20 Resolved: 19/May/20 |
|
| Status: | Closed |
| Project: | Kafka Connector |
| Component/s: | None |
| Affects Version/s: | 1.0.1 |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Tejas Rawat | Assignee: | Robert Walters |
| Resolution: | Won't Fix | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Environment: |
Prod |
||
| Documentation Changes: | Not Needed |
| Description |
|
We are using mongo kafka source connector to push data into kafka from mongo change-stream.We want to perform some data transformation before sending data into Kafka , How it can be done? |
| Comments |
| Comment by Robert Walters [ 19/May/20 ] |
|
While the aggregation pipeline can be used to transform and filter in some scenarios, this type of capability is best performed by utilizing the native Kafka Single Message Transforms feature. |