Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-178

MongoSinkConnector nullpointerexception with Confluent Platform 6.0

    • Type: Icon: Bug Bug
    • Resolution: Gone away
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 1.3.0
    • Component/s: Sink
    • Labels:
      None
    • Environment:
      Confluent Platform 6.0

      The MongoDBSinkConnector launched from Confluent Platform 6.0 (https://github.com/confluentinc/cp-all-in-one) immediately produces a nullpointerexception. Downgrading to Confluent Platform 5.5.2 resolves the issue, however we can't do that. 

      This is a major blocker for us, is anyone aware of a workaround?

      Thanks

       

      Config

      {
        "connector.class": "com.mongodb.kafka.connect.MongoSinkConnector",
        "name": "mongodb-sink",
        "tasks.max": "1",
        "input.data.format": "JSON",
        "topics":"mytopic",
        "connection.uri": "mongodb+srv://my-user:mypassword@myhost.mongodb.net",
        "connection.host": "myhost.mongodb.net",
        "connection.user": "myuser",
        "connection.password": "mypassword",
        "database": "mydb",
        "delete.on.null.values": "false",
        "document.id.strategy": "com.mongodb.kafka.connect.sink.processor.id.strategy.PartialValueStrategy",
        "value.projection.list":"id",
        "value.projection.type":"AllowList",
        "writemodel.strategy":"com.mongodb.kafka.connect.sink.writemodel.strategy.ReplaceOneBusinessKeyStrategy"
      }
      
      
      

      Stack trace

      connect      | [2020-11-30 11:07:57,473] INFO Opened connection [connectionId{localValue:30, serverValue:123679}] to myhost.mongodb.net:27017 (org.mongodb.driver.connection)
      connect      | [2020-11-30 11:07:57,654] INFO Closed connection [connectionId{localValue:30, serverValue:123679}] to myhost.mongodb.net:27017 because the pool has been closed. (org.mongodb.driver.connection)
      connect      | [2020-11-30 11:07:57,656] ERROR Uncaught exception in REST call to /connectors (org.apache.kafka.connect.runtime.rest.errors.ConnectExceptionMapper)
      connect      | java.lang.NullPointerException
      connect      |  at org.apache.kafka.connect.runtime.WorkerConfigDecorator$MutableConfigInfos.lambda$removeAllWithName$0(WorkerConfigDecorator.java:295)
      connect      |  at org.apache.kafka.connect.runtime.WorkerConfigDecorator$MutableConfigInfos.removeAll(WorkerConfigDecorator.java:305)
      connect      |  at org.apache.kafka.connect.runtime.WorkerConfigDecorator$MutableConfigInfos.removeAllWithName(WorkerConfigDecorator.java:294)
      connect      |  at org.apache.kafka.connect.runtime.WorkerConfigDecorator$DecorationPattern.filterValidationResults(WorkerConfigDecorator.java:432)
      connect      |  at org.apache.kafka.connect.runtime.WorkerConfigDecorator.lambda$decorateValidationResult$5(WorkerConfigDecorator.java:273)
      connect      |  at java.base/java.util.Collections$SingletonList.forEach(Collections.java:4856)
      connect      |  at org.apache.kafka.connect.runtime.WorkerConfigDecorator.decorateValidationResult(WorkerConfigDecorator.java:273)
      connect      |  at org.apache.kafka.connect.runtime.AbstractHerder.validateConnectorConfig(AbstractHerder.java:392)
      connect      |  at org.apache.kafka.connect.runtime.AbstractHerder.lambda$validateConnectorConfig$1(AbstractHerder.java:326)
      connect      |  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
      connect      |  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      connect      |  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      connect      |  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      connect      |  at java.base/java.lang.Thread.run(Thread.java:834) (edited) 
      

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            dwadge@rheglobal.com David Wadge
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: