[KAFKA-282] Mongo-Source Connector not able to commit offset sometimes Created: 25/Jan/22  Updated: 27/Oct/23  Resolved: 07/Mar/22

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Question Priority: Major - P3
Reporter: Avijit Ghosh Assignee: Ross Lawley
Resolution: Works as Designed Votes: 0
Labels: external-user
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File offestCommitted.PNG     PNG File offsetNotCommitted.PNG    

 Description   

Hi Team,
There is a Spring Task application running which responsibility is to copy document from one MongoDB collection to a temp collection. The Mongo-Kafka source connector is configured with temp collection, so whenever data inserted through Spring Task application to the temp collection data will be shipped to Kafka topic through Mongo-Kafka source connector.
But sometimes data got inserted in the temp collection but not shipped to Kafka topic.
I can see "new change stream cursor created without offset" in the connect log but sometimes not see
"Finished commitOffsets successfully in" (when event not posted in Kafka topic)

Attaching the two connect logs 
a> offsetCommitted -> when data shipped successfully to Kafka topic
b> offsetNotCommitted -> when data not shipped to Kafka topic



 Comments   
Comment by Avijit Ghosh [ 26/Jan/22 ]

Hi Ross Lawley,

Thank you for the quick response.
I have created a support ticket in MongoDB community portal.

Thanks 
Avijit Ghosh

Comment by Ross Lawley [ 25/Jan/22 ]

Hi avi54work@gmail.com

Thank you for reaching out. As this sounds like a support issue, I wanted to give you some resources to get this question answered more quickly:

  • Our MongoDB support portal, located at support.mongodb.com
  • Our MongoDB community portal, located here
  • If you are an Atlas customer, there is free support offered 24/7 in the lower right hand corner of the UI

Just in case you have already opened a support case and are not receiving sufficient help, please let me know and I can facilitate escalating your issue.

All the best,

Ross Lawley

Generated at Thu Feb 08 09:06:00 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.