Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-254

Allow Source Connector to Automatically Restart After "Resume Token Not Found"

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • 1.3.0
    • Affects Version/s: None
    • Component/s: Source
    • Labels:
    • Needed
    • Hide

      If implemented, this new behavior will need to be properly documented.

      Show
      If implemented, this new behavior will need to be properly documented.

      Hi Team,

      Right now, when the Source Connector encounters a "Resume Token Not Found" error it fails and doesn't automatically recover. The reasoning behind this decision is that there are data loss implications when this happens and the safe approach is to stop, allow the user to understand the implications, and carefully decide the next steps.

      Would it be possible to make this more flexible by adding a configuration option that allows the Source Connector to automatically restart from scratch whenever a "Resume Token Not Found" error is found?

      A clear message that this happened and the implications should be written to the logs, as well as a startup banner that states the currently configured behavior and its implications.

      Thanks
      Diego

            Assignee:
            ross@mongodb.com Ross Lawley
            Reporter:
            diego.rodriguez@mongodb.com Diego Rodriguez (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: