Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-102181

Create a DLQ message whenever a stream processor fails due to "large message" error

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Atlas Streams
    • None
    • None
    • None
    • None
    • None
    • None
    • None

       

      We currently fail the processor and only provide this log message. We'd like to do the following:

       

      1. Improve the error message. Add the size of the message that caused this error to occur
      2. Add a DLQ message

       

      The message indicates that this is an error encountered by the broker so we should look here to make changes

       

      https://github.com/10gen/mongo/blob/e8a55b0485af400baef573e7004fc9032156c093/src/mongo/db/modules/enterprise/src/streams/exec/kafka_emit_operator.cpp#L779-L783

       

            Assignee:
            Unassigned Unassigned
            Reporter:
            andrew.chen@mongodb.com Andrew Chen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              None
              None
              None
              None