Details
-
Task
-
Resolution: Done
-
Major - P3
-
None
-
0.1
-
None
-
None
-
Windows 7, CentOS Linux release 7.5.1804
Description
Hi team,
I can stream data from Kafka to MongoDB with JSON messages
However, if I send a non-JSON format message the Connector died. Please see the log file for details.
My config file:
name=mongo-sink
|
topics=testconnector.class=com.mongodb.kafka.connect.MongoSinkConnector |
tasks.max=1 |
key.ignore=true |
|
|
# Specific global MongoDB Sink Connector configuration
|
connection.uri=mongodb://localhost:27017 |
database=test_kafka
|
collection=transaction
|
max.num.retries=3 |
retries.defer.timeout=5000 |
type.name=kafka-connect
|
|
|
key.converter=org.apache.kafka.connect.json.JsonConverter
|
key.converter.schemas.enable=false |
value.converter=org.apache.kafka.connect.json.JsonConverter
|
value.converter.schemas.enable=false |
|
I have 2 separated questions:
- how to ignore the message which is non-json format?
- how to defined a default-key for this kind of message (for example: abc -> {{
{ "non-json": "abc" }
}}
Thanks