Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-307

Investigate using batch based sizing

XMLWordPrintableJSON

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • 1.9.0
    • Affects Version/s: None
    • Component/s: Source
    • None
    • None
    • None
    • None
    • None
    • None

      Currently, max.batch.size - determines the size of the batch returned from poll.

      Investigate allowing for the SourceTask.poll method to just return the batch per poll. This would link each poll() call to a getMore() and potentially improve through put of the connector.

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            ross@mongodb.com Ross Lawley
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved:
              None
              None
              None
              None