[KAFKA-50] MongoDB & Kafka Docker end to end example does not work Created: 24/Jul/19  Updated: 28/Oct/23  Resolved: 09/Sep/19

Status: Closed
Project: Kafka Connector
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Bargavi Krishnamoorthy Assignee: Ross Lawley
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

MAC OS


Attachments: JPEG File 2019-07-24_13-33-06.jpg     PNG File Screenshot from 2019-08-18 14-07-19.png     PNG File Screenshot from 2019-08-18 14-07-28.png     PNG File image-2019-07-25-11-06-19-650.png    

 Description   

I checked out the latest master branch today and i followed the instructions to run the example as specified in https://github.com/mongodb/mongo-kafka/blob/master/docker/README.md

While running the example using ./run.sh, the script just says "waiting for the systems to be ready" for a long time. Please refer screenshot attached.

 



 Comments   
Comment by Ross Lawley [ 09/Sep/19 ]

I was able to replicate the issue and found that increasing the RAM and CPU allowance for Docker to 4GB RAM and 6 CPU fixed the issue for me.

I've also updated the to the 5.3.0 images from confluent.

Ross

Comment by Githook User [ 09/Sep/19 ]

Author:

{'username': 'rozza', 'email': 'ross.lawley@gmail.com', 'name': 'Ross Lawley'}

Message: Updated Docker to 5.3.0

Added OSX help message regarding RAM & CPU allowance.

KAFKA-50
Branch: master
https://github.com/mongodb/mongo-kafka/commit/8a62d7ae209029065242724ff06a2bd01e673cf5

Comment by Mostafa Ghadimi [ 18/Aug/19 ]

Hi Ross,

I have the same issue, I have problem with curl. I have curl installed on my local computer. What should I do to solve this problem?

Thanks

 

Comment by Ross Lawley [ 05/Aug/19 ]

Thanks baru_1990@yahoo.co.in,

I'm not sure why that would be - its just running a local docker instance. Perhaps running the steps locally from the shell file and then checking the docker logs would provide more insight.

Ross

Comment by Bargavi Krishnamoorthy [ 25/Jul/19 ]

Yes. Curl is installed. Actually it works well for rest proxy 8082 but not for kafka connect 8083.

Comment by Ross Lawley [ 25/Jul/19 ]

There shouldn't be any issue - its been tested locally on linux. Do you have curl installed?

Comment by Bargavi Krishnamoorthy [ 25/Jul/19 ]

Thank you for your quick response @Ross Lawley. I tried the new script. Yes it could not reach 8083 port which is kafka connect. I am not sure why it couldn't reach. Is there any issue with the docker compose file ?
I have attached the console logs for run.sh

Comment by Ross Lawley [ 25/Jul/19 ]

Hi baru_1990@yahoo.co.in,

Thanks for the ticket. The system is hanging when trying to contact the rest proxy and the Kafka connect. The script uses curl to connect and configure Kafka connect. So if curl is not available it will fail.

I've updated the script - to help improve debugging and limit how long it attempts to connect to these systems.

Ross

Generated at Thu Feb 08 09:05:27 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.