Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-144

key.projection.type and key.projection.list not respecting

    XMLWordPrintableJSON

Details

    • Icon: Task Task
    • Resolution: Works as Designed
    • Icon: Major - P3 Major - P3
    • None
    • 1.2.0
    • Sink
    • None
    • Kafka 2.6

    Description

      I am testing key.projection.type & key.projection.list options and looks like it is not respecting. On the destination database, I am receiving a field I am adding to the blocklist. Below sink configuration, I am using. Can you please let me know is there any known issue or I am doing something wrong? 

       

      curl -X POST -H "Accept:application/json" -H "Content-Type: application/json" localhost:9083/connectors/ --data '{

      "name":"mongo-sink-norevisions-mongos",

      "config": {

      "topics":"oplog.oz_mongo.oz_next.assets",

      "connector.class":"com.mongodb.kafka.connect.MongoSinkConnector",

      "tasks.max":"1",

      "key.converter":"org.apache.kafka.connect.json.JsonConverter",

      "key.converter.schemas.enable":"false",

      "value.converter":"org.apache.kafka.connect.json.JsonConverter",

      "value.converter.schemas.enable":"false",

      "connection.uri":"mongodb://xxx.xxx.xxx.xxx:27017",

      "database":"poc_oz_next",

      "collection":"poc_assets_norevision",

      "max.num.retries":"3",

      "retries.defer.timeout":"5000",

      "session.timeout.ms":"25000",

      "delete.on.null.values":"true",

      "key.projection.type":"blocklist",

      "key.projection.list":"revisions,revision_ids"}

      }'

       

      Thanks,

      Rajaramesh

      Attachments

        Activity

          People

            ross@mongodb.com Ross Lawley
            yaramati@adobe.com Rajaramesh Yaramati
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: