-
Type:
Task
-
Resolution: Unresolved
-
Priority:
Minor - P4
-
Affects Version/s: None
-
Labels:
Original Downstream Change Summary
I don't think we already document the schema of DLQ messages in the Atlas Stream Processing documentation. At some point we should document this schema. We can treat this ticket as the source of truth for the DLQ schema.
Description of Linked Ticket
In order for the customer to be able to successfully re-process DLQ messages we would like some additional information added when DLQ documents are written.
{
doc: {
_ts: ISODate("2023-01-01T00:00:00Z"),
_stream_meta: {
source.offset: 42, // kafka offset/partition info
source.partition: 1,
...
},
a: 1
},
errInfo: {
reason: "Input document arrived late."
},
processorName: "foo123" // processor name that originated this message
instanceName: "mySP01". // instance name that originated this message
// Other fields for the specific error. The missedWindowStartTimes is an example for late arriving documents.
missedWindowStartTimes: [ISODate("2023-01-01T00:00:00Z")]
}
- documents
-
-
- Closed
-