Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-80928

KafkaPartitionConsumer should have a byte limit on prefetching.

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Atlas Streams
    • Fully Compatible
    • ALL
    • Sprint 35, Sprint 36, Sprint 37

      Currently it uses `maxNumDocsToPrefetch` to decide how many docs to prefetch.

      Instead we should make it prefetch up to 10 batches each of size kDataMsgMaxByteSize. Note that it already emits batches of size kDataMsgMaxByteSize.

            Assignee:
            kunaal.kumar@mongodb.com Kunaal Kumar
            Reporter:
            sandeep.dhoot@mongodb.com Sandeep Dhoot
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: