[KAFKA-222] Create an uber jar with all dependencies Created: 19/May/21  Updated: 28/Oct/23  Resolved: 11/Jun/21

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: 1.6.0

Type: Improvement Priority: Major - P3
Reporter: Ross Lawley Assignee: Ross Lawley
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Documented
Case:
Documentation Changes: Needed

 Description   

The mongo kafka connector has two runtime dependencies:

  • org.apache.kafka:connect-api:2.6.0
  • org.apache.avro:avro:1.9.2

Users outside the Kafka Connect ecosystem will also need to include these dependencies and any child dependencies in the plugin directory.

Currently the mongo-kafka-connect-1.5.0-all.jar only includes the mongo dependencies.

Fix

Added a new jar `mongo-kafka-connect-<version>-confluent.jar` which just contains the dependencies needed for running the connector with confluent.
Updated mongo-kafka-connect-<version>-all.jar to now also include Avro dependencies for ease of deployment for alternative Kafka connect runtimes.



 Comments   
Comment by Githook User [ 29/Jun/21 ]

Author:

{'name': 'Ross Lawley', 'email': 'ross.lawley@gmail.com', 'username': 'rozza'}

Message: Build: Fix publishing of shadow jars

Disable the default shadowJar configuration and ensure
publishing includes both confluent and all shadow versions.

KAFKA-222
Branch: master
https://github.com/mongodb/mongo-kafka/commit/414162109c30ada6a0a380d48e3847171e6b4614

Comment by Githook User [ 11/Jun/21 ]

Author:

{'name': 'Ross Lawley', 'email': 'ross.lawley@gmail.com', 'username': 'rozza'}

Message: Changelog update for new jars

KAFKA-222
Branch: master
https://github.com/mongodb/mongo-kafka/commit/9ecef4f6c4ddd64b0b7a0f542b447daa7a108547

Comment by Githook User [ 11/Jun/21 ]

Author:

{'name': 'Ross Lawley', 'email': 'ross.lawley@gmail.com', 'username': 'rozza'}

Message: Added a Jar containing the Avro dependency as well

KAFKA-222
Branch: master
https://github.com/mongodb/mongo-kafka/commit/1eeafb87c2683b5674e7a9767d6271bd664c3044

Comment by Ross Lawley [ 11/Jun/21 ]

PR: https://github.com/mongodb/mongo-kafka/pull/74

Comment by Ross Lawley [ 11/Jun/21 ]

Went for:

Added a new Jar: mongo-kafka-connect-<version>-confluent.jar contains the connector and mongodb / bson code that can run in confluents connect runtime.
Updated the all Jar: mongo-kafka-connect-<version>-all.jar so that it now also includes the Avro dependency, that users not using confluent's connect runtime will also need.

Generated at Thu Feb 08 09:05:53 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.