Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-204

Uncaught exception in REST call to /connectors when starting a sink connector (java.lang.NullPointerException)

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 1.4.0
    • Component/s: Sink
    • Labels:
      None
    • Environment:
      ubuntu 20.04, confluent platform 6.1

      My configuration parameters:

      {
             	"name":"MongoSink",
      	"config":
      	{
      	       	"topics":"crawled_piaragraphed_content",
        		"connector.class":"com.mongodb.kafka.connect.MongoSinkConnector",
        		"tasks.max":1,
        		"connection.uri":"mongodb+srv://content_creator:Azordi789@10.1.3.23:27017",
        		"database":"fiu",
        		"collection":"paragraphed_content",
       		"max.num.retries":2,
       		"retries.defer.timeout":5000,
       		"key.projection.type":"none",
       		"value.projection.type":"none",
       		"document.id.strategy":"com.mongodb.kafka.connect.sink.processor.id.strategy.BsonOidStrategy",
       		"post.processor.chain":"com.mongodb.kafka.connect.sink.processor.DocumentIdAdder",
       		"delete.on.null.values":true,
       		"confluent.topic.security.protocol":"PLAINTEXT"
      	}
      }

      Command to start a connector:

      curl -X POST -H "Content-Type: application/json" --data @mongo.json http://localhost:8084/connectors

      Error:

      [2021-03-04 11:56:17,470] INFO Started o.e.j.s.ServletContextHandler@5539f9de{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:916)
      [2021-03-04 11:56:17,470] INFO REST resources initialized; server is started and ready to handle requests (org.apache.kafka.connect.runtime.rest.RestServer:324)
      [2021-03-04 11:56:17,470] INFO Kafka Connect started (org.apache.kafka.connect.runtime.Connect:57)
      [2021-03-04 11:56:17,658] INFO [Worker clientId=connect-1, groupId=connect-cluster] Successfully joined group with generation Generation{generationId=4, memberId='connect-1-6f2cbf74-cb96-4af2-9f56-7908a9801f1e', protocol='sessioned'} (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596)
      [2021-03-04 11:56:17,664] INFO [Worker clientId=connect-1, groupId=connect-cluster] Successfully synced group in generation Generation{generationId=4, memberId='connect-1-6f2cbf74-cb96-4af2-9f56-7908a9801f1e', protocol='sessioned'} (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756)
      [2021-03-04 11:56:17,665] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Deserialized new assignment: Assignment{error=0, leader='connect-1-4aa19230-0604-44e6-b6ad-4a6827063683', leaderUrl='http://127.0.1.1:8083/', offset=109, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator:189)
      [2021-03-04 11:56:17,666] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Augmented new assignment: Assignment{error=0, leader='connect-1-4aa19230-0604-44e6-b6ad-4a6827063683', leaderUrl='http://127.0.1.1:8083/', offset=109, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator:209)
      [2021-03-04 11:56:17,666] INFO [Worker clientId=connect-1, groupId=connect-cluster] Joined group at generation 4 with protocol version 2 and got assignment: Assignment{error=0, leader='connect-1-4aa19230-0604-44e6-b6ad-4a6827063683', leaderUrl='http://127.0.1.1:8083/', offset=109, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} with rebalance delay: 0 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1689)
      [2021-03-04 11:56:17,667] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Ensuring group membership is still active (org.apache.kafka.connect.runtime.distributed.DistributedHerder:328)
      [2021-03-04 11:56:17,667] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Handling completed but unresolved rebalance (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1067)
      [2021-03-04 11:56:17,667] WARN [Worker clientId=connect-1, groupId=connect-cluster] Catching up to assignment's config offset. (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1095)
      [2021-03-04 11:56:17,667] INFO [Worker clientId=connect-1, groupId=connect-cluster] Current config state offset -1 is behind group assignment 109, reading to end of config log (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1158)
      [2021-03-04 11:56:17,938] INFO [Worker clientId=connect-1, groupId=connect-cluster] Finished reading to end of log and updated config snapshot, new config log offset: 109 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1162)
      [2021-03-04 11:56:17,938] INFO [Worker clientId=connect-1, groupId=connect-cluster] Starting connectors and tasks using config offset 109 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1216)
      [2021-03-04 11:56:17,939] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Received assignment: Assignment{error=0, leader='connect-1-4aa19230-0604-44e6-b6ad-4a6827063683', leaderUrl='http://127.0.1.1:8083/', offset=109, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1217)
      [2021-03-04 11:56:17,939] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Currently running assignment: Assignment{error=0, leader='null', leaderUrl='null', offset=-1, connectorIds=[], taskIds=[], revokedConnectorIds=[], revokedTaskIds=[], delay=0} (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1218)
      [2021-03-04 11:56:17,939] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Tasks to restart from currently running assignment: [] (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1228)
      [2021-03-04 11:56:17,939] INFO [Worker clientId=connect-1, groupId=connect-cluster] Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1244)
      [2021-03-04 11:56:25,694] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Ensuring group membership is still active (org.apache.kafka.connect.runtime.distributed.DistributedHerder:328)
      [2021-03-04 11:56:25,698] DEBUG Getting plugin class loader: 'PluginClassLoader{pluginLocation=file:/usr/share/confluent-hub-components/mongodb-kafka-connect-mongodb/}' for connector: com.mongodb.kafka.connect.MongoSinkConnector (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:172)
      [2021-03-04 11:56:25,742] DEBUG Found 0 injected Confluent license properties from validation results for connector 'MongoSink' (org.apache.kafka.connect.runtime.WorkerConfigDecorator:440)
      [2021-03-04 11:56:25,742] INFO AbstractConfig values: 
       (org.apache.kafka.common.config.AbstractConfig:361)
      [2021-03-04 11:56:25,744] DEBUG [Worker clientId=connect-1, groupId=connect-cluster] Ensuring group membership is still active (org.apache.kafka.connect.runtime.distributed.DistributedHerder:328)
      [2021-03-04 11:56:25,754] DEBUG Uncaught exception in REST call to /connectors (org.apache.kafka.connect.runtime.rest.errors.ConnectExceptionMapper:39)
      java.lang.NullPointerException
      	at org.apache.kafka.connect.runtime.AbstractHerder.maybeAddConfigErrors(AbstractHerder.java:609)
      	at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$600(DistributedHerder.java:128)
      	at org.apache.kafka.connect.runtime.distributed.DistributedHerder$4$1.call(DistributedHerder.java:829)
      	at org.apache.kafka.connect.runtime.distributed.DistributedHerder$4$1.call(DistributedHerder.java:826)
      	at org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:371)
      	at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:295)
      	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
      	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at java.base/java.lang.Thread.run(Thread.java:834)
      

      I have also tried applying the solution suggested in https://developer.mongodb.com/community/forums/t/nullpointer-exception-when-creating-kafka-sink-connector/11596 to no avail!

            Assignee:
            Unassigned Unassigned
            Reporter:
            manish.chumun@gmail.com Manish Chumun
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: