Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-313

Sink Connector Configuration on sharded collection

    XMLWordPrintableJSON

Details

    • Icon: Question Question
    • Resolution: Gone away
    • Icon: Major - P3 Major - P3
    • None
    • 1.7.0
    • None

    Description

      We are trying to use Mongo Sink Connector for Kafka to sink the messages from a Kafka topic. Currently we are using default configuration, i.e., the default write model strategy. This configuration seems to work for a normal collection but for sharded collection we are encountering an error.

      Write errors: [BulkWriteError\{index=0, code=61, message='Failed to target upsert by query :: could not extract exact shard key', details={}}].

      Was not able to find enough documentation of what needs to be provided for a sharded collection. The intent here is to work in a similar manner as the default ReplaceOneDefaultStrategy.

      Please let us know the writemodel strategy that would be applicable for sharded collection.

      Attachments

        Activity

          People

            robert.walters@mongodb.com Robert Walters
            rajesh.vinayagam@mongodb.com Rajesh Vinayagam
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: