Stop waking up consumer thread when there are no in-progress files for S3 $emit operator

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Won't Do
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Atlas Streams
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Currently we will wake up the S3EmitWriter consumer thread every writeOptions.interval to upload in-progress files if there are any.

       

      We can improve this by not waking the consumer thread anymore if there are none left to upload.

       

      We're waiting on the "record metrics" ticket to get a member variable that we can use as part of notifyConsumerOnIdleMillis

              Assignee:
              Andrew Chen
              Reporter:
              Andrew Chen
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: