[DOCS-13647] Add deadletterqueue to the Kafka Sink documentation Created: 14/May/20  Updated: 29/Oct/23  Resolved: 03/Jun/20

Status: Closed
Project: Documentation
Component/s: Kafka
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: Robert Walters Assignee: Christopher Cho
Resolution: Fixed Votes: 0
Labels: kafka-connect, kafka-documentation
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Participants:
Days since reply: 3 years, 36 weeks ago
Story Points: 2

 Description   

Description

While not specific to the MongoDB Kafka Connector, the default behavior without defining a dead letter queue will be for the connector to stop and need to be restarted upon the first mal-formed message in the topic.  Thus, we should add documentation to the Kafka connector to use a dead letter queue and specify an error tolerance.

Here is a link to a blog on dead letter queues for reference

https://www.confluent.io/blog/kafka-connect-deep-dive-error-handling-dead-letter-queues/

 

Scope of changes

Impact to Other Docs

MVP (Work and Date)

Resources (Scope or Design Docs, Invision, etc.)



 Comments   
Comment by Githook User [ 03/Jun/20 ]

Author:

{'name': 'Chris Cho', 'email': 'chris.cho@10gen.com', 'username': 'ccho-mongodb'}

Message: DOCS-13647: Add dead letter queue configuration information (#19)
Branch: v1.0
https://github.com/10gen/docs-kafka-connector/commit/aaeef35658b9c608b71bd604c4a8d05cf13365fe

Comment by Githook User [ 03/Jun/20 ]

Author:

{'name': 'Chris Cho', 'email': 'chris.cho@10gen.com', 'username': 'ccho-mongodb'}

Message: DOCS-13647: Add dead letter queue configuration information (#19)
Branch: v1.1
https://github.com/10gen/docs-kafka-connector/commit/0267a478c8f5a188e7d5340aacd4cc1a7d04efbb

Comment by Githook User [ 03/Jun/20 ]

Author:

{'name': 'Chris Cho', 'email': 'chris.cho@10gen.com', 'username': 'ccho-mongodb'}

Message: DOCS-13647: Add dead letter queue configuration information (#19)
Branch: master
https://github.com/10gen/docs-kafka-connector/commit/e6e358655952125d9ee6b6f2e1f4fdd1b43fc380

Comment by Christopher Cho [ 02/Jun/20 ]

Ready for review:

https://github.com/10gen/docs-kafka-connector/pull/19

Generated at Thu Feb 08 08:08:22 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.