Stop waking up consumer thread when there are no in-progress files for S3 $emit operator

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Won't Do
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Atlas Streams
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Currently we will wake up the S3EmitWriter consumer thread every writeOptions.interval to upload in-progress files if there are any.

       

      We can improve this by not waking the consumer thread anymore if there are none left to upload.

       

      We're waiting on the "record metrics" ticket to get a member variable that we can use as part of notifyConsumerOnIdleMillis

            Assignee:
            Andrew Chen
            Reporter:
            Andrew Chen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: