Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-208

Error on heartbeat setup with existing SMT

    • Type: Icon: Bug Bug
    • Resolution: Works as Designed
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 1.3.0
    • Component/s: Source
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      When trying to add a heartbeatĀ to the existing working configuration

          "heartbeat.interval.ms": 60000,
          "heartbeat.topic.name": "heartbeats-mongodb"

      I'm getting the following error:
      Caused by: org.apache.kafka.connect.errors.DataException: Only Struct objects supported for [copying fields from value to key], found: java.lang.String
      configuration example:

      {
        "connector.class": "com.mongodb.kafka.connect.MongoSourceConnector", 
        "transforms.extractKeyField.type": "org.apache.kafka.connect.transforms.ExtractField$Key",
        "output.format.value": "schema",  
        "change.stream.full.document": "updateLookup",  
        "transforms": "ValueToKey,extractKeyField",  
        "transforms.extractKeyField.field": "documentKey",  
        "collection": "test", 
        "transforms.ValueToKey.fields": "documentKey",
        "key.converter.schemas.enable": "false",  
        "database": "db", 
        "topic.prefix": "prefix", 
        "connection.uri": "mongodb://localhost", 
        "value.converter.schemas.enable": "false",  
        "name": "mongodb-source", 
        "copy.existing": "true", 
        "value.converter": "org.apache.kafka.connect.json.JsonConverter",  
        "key.converter": "org.apache.kafka.connect.json.JsonConverter",  
        "poll.max.batch.size": "100",  
        "transforms.ValueToKey.type": "org.apache.kafka.connect.transforms.ValueToKey"
      }
      

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            vlad@guesty.com Vlad Goldman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: