Uploaded image for project: 'Evergreen'
  1. Evergreen
  2. EVG-5927

Parallelize event dispatch loop

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v2019.04.01
    • Component/s: Notifications
    • Labels:
      None

      Description

      It currently takes us a couple minutes to run the event dispatch loop, and on 3/7/19 we were pinned at processing 1000 events per loop iteration for several hours, which means that we were behind in processing events. We should

      1. Parallelize the loop. https://github.com/evergreen-ci/evergreen/blob/02c7b0e2d9305c8afab331b730693665b02731d6/units/event_metajob.go#L157
      2. Add logging for the number of tasks remaining. Currently the query gets 1000 tasks. We should have an additional query for the total number of tasks remaining so that if we get behind we can measure how behind we are.

        Attachments

          Activity

            People

            • Assignee:
              sam.kleinman Sam Kleinman
              Reporter:
              brian.samek Brian Samek
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: