Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-302

Extended debugging for Kafka Connector

    • Type: Icon: Epic Epic
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 1.8.0
    • Affects Version/s: None
    • Component/s: Sink, Source
    • Labels:
    • 3
    • 1
    • 3
    • 100
    • Hide

      Engineer(s): Maxim

      Summary: Improve logging for the Kafka connector

      2022-08-09: 

      Status update:

      • First set of logging improvements are in review
      • Add connector id to all log messages is up next

      Rationale for delays:

      • No delays

      Risks:

      • No risks

      Show
      Engineer(s): Maxim Summary: Improve logging for the Kafka connector 2022-08-09:  Status update: First set of logging improvements are in review Add connector id to all log messages is up next Rationale for delays: No delays Risks: No risks

      Information To Be Logged

      • For Both Source and Sink
        • Log the timestamp and execution time (when applicable) for all the events written under this extended debugging feature.
        • Any event that is currently logged as part of the standard Kafka Connect logging should also be written to the target MongoDB deployment defined by this extended debugging feature.
        • Log the key and value of the related Kafka message.
      • For the Sink Connector
        • Log which post-processors were executed, and in which order.
        • Log the execution time of the associated write operation in MongoDB.
      • For the Source Connector
        • Log the most recent Resume Token and/or the Heartbeat Token value.
        • Log the execution time of the `getMore` requests on the Change Stream cursor.

            Assignee:
            maxim.katcharov@mongodb.com Maxim Katcharov
            Reporter:
            robert.walters@mongodb.com Robert Walters
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved:
              2 weeks, 4 days