[KAFKA-125] Support auto generated schema structs Created: 10/Jul/20  Updated: 28/Oct/23  Resolved: 08/Sep/20

Status: Closed
Project: Kafka Connector
Component/s: Source
Affects Version/s: None
Fix Version/s: 1.3.0

Type: Improvement Priority: Major - P3
Reporter: Ross Lawley Assignee: Ross Lawley
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on KAFKA-124 Support output to schema Closed
Documented
Epic Link: Support schema for Source connector
Documentation Changes Summary:

Added a new config:

output.schema.infer.value=[false,true]

An example use case is when publishing fulldocuments that have the same / similar shapes:

publish.full.document.only=true
output.json.formatter=com.mongodb.kafka.connect.source.json.formatter.SimplifiedJson
output.format.value=schema
output.schema.infer.value=true

Note: A schema is inferred for each document outputted by the change stream. So each document could have its own schema definition. For Bson types that are not supported by Kafka eg: minValue, ObjectId a string value will be produced using the output json formatter.


 Comments   
Comment by Githook User [ 08/Sep/20 ]

Author:

{'name': 'Ross Lawley', 'email': 'ross.lawley@gmail.com', 'username': 'rozza'}

Message: Added infer schema value support for the source connector

KAFKA-125
Branch: master
https://github.com/mongodb/mongo-kafka/commit/a68c071d362329e7ff2384b8b5a969f887bc347a

Comment by Ross Lawley [ 21/Aug/20 ]

PR: https://github.com/mongodb/mongo-kafka/pull/30/

Generated at Thu Feb 08 09:05:38 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.