Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-299

MongoDB Sink Connector can not support Debezium update event

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Won't Fix
    • Priority: Icon: Minor - P4 Minor - P4
    • None
    • Affects Version/s: None
    • Component/s: CDC
    • Labels:

       Hi, I build an environment on my own to test Debezium MongoDB Connector with MongoDB Sink Connector

       
      I found that insert and delete are working well, but update will have error and terminate the sink task like below.

      Maybe its a version mismatch, can I know which version is stable on our document ?

      [2022-03-07 15:50:05,144] ERROR [mongo-sink-deb|task-0] Failed to put into the sink the following records: [SinkRecord\{kafkaOffset=1, timestampType=CreateTime} ConnectRecord\{topic='ktb.deb.source', kafkaPartition=0, key={id={"$oid": "62262999eb952841bb6b6a0e"}}, keySchema=null, value=\{patch={"$v": 2,"diff": {"i": {"age": "111"}}}, filter=\{"_id": {"$oid": "62262999eb952841bb6b6a0e"}}, op=u, after=null, source=\{ord=3, rs=rs777, h=null, stxnid=679518be-7538-31f7-ad33-b6ead6fe2bf6:1, collection=source, version=1.6.4.Final, sequence=null, connector=mongodb, name=ktb, tord=null, ts_ms=1646668204000, snapshot=false, db=deb}, ts_ms=1646668204960, transaction=null}, valueSchema=null, timestamp=1646668205135, headers=ConnectHeaders(headers=)}] (com.mongodb.kafka.connect.sink.MongoSinkTask:181)
java.lang.IllegalArgumentException: Invalid BSON field name diff
 

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            kuan-chun.chang@mongodb.com Caspar Chang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: