Integrate per target input/output counts with checkpointing

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Fixed
    • Priority: Major - P3
    • 8.2.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Atlas Streams
    • Fully Compatible
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      To retain lifetime per-target input/output counts for a stream processor, we will save this information in checkpoint. We already save operator stats in checkpoints, so this will just build on that.

      1. Modify the OperatorStatsDoc IDL struct to contain fields for the new fields in the in-memory OperatorStats struct. We can use array<PerTargetStatsDoc>
      2. When then need to modify the utility methods toOperatorStatsDoc and to OperatorStats to save and restore per target states
      3. Make sure to add tests using commonTest!
      4. Enable the feature flag, put things under isInternal

            Assignee:
            Matthew Normyle
            Reporter:
            Matthew Normyle
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: