[KAFKA-64] Expose monitoring metrics over JMX Created: 22/Aug/19  Updated: 28/Oct/23  Resolved: 16/Aug/22

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: 1.8.0

Type: New Feature Priority: Major - P3
Reporter: Kai Orend Assignee: Maxim Katcharov
Resolution: Fixed Votes: 5
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by KAFKA-327 Add documentation fields to JMX bean Closed
Documented
Duplicate
is duplicated by KAFKA-229 Monitor the Kafka Source Connector La... Closed
Related
related to KAFKA-229 Monitor the Kafka Source Connector La... Closed
Epic Link: Monitoring and troubleshooting Kafka Connector
Case:
Documentation Changes: Needed

 Description   

Exposing monitoring metrics using JMX would allow users of the connector to measure the progress of their data streams.

Add an MBean to expose the following metrics for monitoring for the Source Connector:

  • Current source clusterTime (poll this directly from server, not from the last event)
  • clusterTime of the last processed changeEvent
  • Difference between the previous two: The lag between cluster and Source Connector

Add an MBean to expose the following metrics to the Sink Connector:

  • clusterTime of the last processed change Event
  • (if possible) the delta between the last processed clusterTime and the newest event in the topic: The lag of the Sink Connector


 Comments   
Comment by Maxim Katcharov [ 16/Aug/22 ]

New JMX stats should be documented. Check with robert.walters@mongodb.com for details.

Comment by Bartłomiej Klimczak [ 15/Jul/21 ]

this feature would be verrry helpful

Generated at Thu Feb 08 09:05:29 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.