Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-340

How to add multiple collections in the mongodb source config ?

    XMLWordPrintableJSON

Details

    • Icon: Question Question
    • Resolution: Done
    • Icon: Minor - P4 Minor - P4
    • None
    • None
    • None
    • None

    Description

      So I am using Mongo kafka connector as a source and here is my configĀ 

      {
        "name": "MONGO_SO",
        "config": {
          "connector.class": "com.mongodb.kafka.connect.MongoSourceConnector",
          "errors.log.include.messages": "true",
          "publish.full.document.only": "false",
          "tasks.max": "1",
          "change.stream.full.document": "updateLookup",
          "collection": "coupon",
          "key.converter.schemas.enable": "false",
          "topic.prefix": "",
          "database": "",
          "poll.await.time.ms": "5000",
          "connection.uri": "",
          "name": "MONGO_SOU",
          "value.converter.schemas.enable": "false",
          "copy.existing": "true",
          "value.converter": "org.apache.kafka.connect.json.JsonConverter",
          "errors.log.enable": "true",
          "key.converter": "org.apache.kafka.connect.json.JsonConverter",
          "poll.max.batch.size": "1000"
        }
      } 

      I want my multiple collections to migrate. According to logs it looks like only one collection is supported.Any way to include more than one collection in the config? Any thing to change in config to achieve thisĀ  ?

      Attachments

        Activity

          People

            ross@mongodb.com Ross Lawley
            rosscarvalho@gofynd.com Ross Carvalho
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: