-
Type: Task
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: None
-
Atlas Streams
-
Fully Compatible
-
Sprint 52
A follow up to: https://github.com/10gen/mongo/pull/20756
- In order to commit the Kafka consumer group offsets one last time, during stopStreamProcessor, mongostream should wait for a notifyFlush call from the Agent. An alternative simpler implementation is just always commit the consumer group offsets after locally writing the final checkpoint, don't wait for notifyFlush from Agent. This has some risk of updating the consumer group offsets before the checkpoint upload to S3 succeeds.
Also, make a follow up ticket for:
- For the very first checkpoint, mongostream should wait for it to be flushed before beginning output.
- mentioned in
-
Page Loading...