Uploaded image for project: 'Kafka Connector'
  1. Kafka Connector
  2. KAFKA-381

Support change stream split large events

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • 1.12.0
    • None
    • None
    • None

    Description

      Server version 6.0.9+ adds support for splitting large change stream events.

      If a change stream has large events that exceed 16 MB, a BSONObjectTooLarge exception is returned. Starting in MongoDB 6.0.9, you can use a $changeStreamSplitLargeEvent stage to split the events into smaller fragments.

      You should only use $changeStreamSplitLargeEvent when strictly necessary. For example, if your application requires full document pre- or post-images, and generates large events that exceed 16 MB, use $changeStreamSplitLargeEvent.

      See: $changeStreamSplitLargeEvent .

      Recommend adding a new configuration so users can opt in to support this feature.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ross@mongodb.com Ross Lawley
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: