-
Type: Task
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: None
-
Atlas Streams
-
Fully Compatible
-
Sprint 41, Sprint 42, Sprint 43, Sprint 47, Sprint 48
Currently, a lot of parsing logic to find connectionName fields in a streams pipeline is duplicated across the c++ (engine) and Go (services) codebases for Atlas Stream Processing.
With this ticket, we want to introduce a new engine command in streams_ops that takes a user pipeline, returns a array<string> of connection names in the pipeline (the connectionName fields from $source, $merge, and $emit stages).
The streams Agent (Go code) will use this new command to determine the connectionNames involved in a streams pipeline. This will allow the streams Agent to call the MMS APIs to resolve connection details and secrets required for a pipeline.