Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-313

Sink Connector Configuration on sharded collection

    • Type: Icon: Question Question
    • Resolution: Gone away
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 1.7.0
    • Labels:

      We are trying to use Mongo Sink Connector for Kafka to sink the messages from a Kafka topic. Currently we are using default configuration, i.e., the default write model strategy. This configuration seems to work for a normal collection but for sharded collection we are encountering an error.

      Write errors: [BulkWriteError\{index=0, code=61, message='Failed to target upsert by query :: could not extract exact shard key', details={}}].

      Was not able to find enough documentation of what needs to be provided for a sharded collection. The intent here is to work in a similar manner as the default ReplaceOneDefaultStrategy.

      Please let us know the writemodel strategy that would be applicable for sharded collection.

            robert.walters@mongodb.com Robert Walters
            rajesh.vinayagam@mongodb.com Rajesh Vinayagam
            0 Vote for this issue
            4 Start watching this issue