Don't fail processor in https if payload document is larger than 16MB

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Fixed
    • Priority: Major - P3
    • 8.1.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Atlas Streams
    • Fully Compatible
    • Sprint 64
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      The toBSON call can fail if the doc is larger than 16MB. User can create arbitrarily large docs in their pipeline, so we should handle this case. In this case we should send a DLQ message instead of failing the processor (we do the same thing for failures to write a doc in $merge or $emit).

              case HttpClient::HttpMethod::kPATCH: {
                  rawDoc = tojson(payloadDoc.toBson(), mongo::JsonStringFormat::ExtendedRelaxedV2_0_0);
                  headers.emplace_back("Content-Type: application/json");
                  break;

              Assignee:
              Nathan Frank
              Reporter:
              Matthew Normyle
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: