[KAFKA-306] Ensure `poll.await.time.ms`only is used if there are no results. Created: 06/Apr/22  Updated: 28/Oct/23  Resolved: 10/Jan/23

Status: Closed
Project: Kafka Connector
Component/s: Source
Affects Version/s: None
Fix Version/s: 1.9.0

Type: Improvement Priority: Major - P3
Reporter: Ross Lawley Assignee: Ross Lawley
Resolution: Fixed Votes: 1
Labels: size-xsmall
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to KAFKA-356 Update poll.await.time.ms documentation Closed
Quarter: FY23Q4
Case:

 Description   

Clarify the description of how it is used to block and mention the poll.interval.ms configuration which is the time between poll calls.

Simplify the logic by using poll.await.time.ms via ChangeStreamIterable.maxAwaitTime instead of in the MongoSourceTask.poll().



 Comments   
Comment by Githook User [ 10/Jan/23 ]

Author:

{'name': 'Ross Lawley', 'email': 'ross.lawley@gmail.com', 'username': 'rozza'}

Message: Align change stream cursor and batching with poll batching (#127)

Use `poll.await.time.ms` as the `maxAwaitTime` for the cursor
Use getMore batches for polling up to `poll.max.batch.size`.

KAFKA-306
KAFKA-307
Branch: master
https://github.com/mongodb/mongo-kafka/commit/013d09fe275a4402680ffde7e32480d2482184b4

Generated at Thu Feb 08 09:06:04 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.