Uploaded image for project: 'Evergreen'
  1. Evergreen
  2. EVG-7285

Check Commit Queue Isn't Stuck

    XMLWordPrintable

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • v2020.05.01
    • app

    Description

      Currently, we have an email alert set up for if  "processing_seconds" > 3600, from the commitQueueJob. It seems like usually if a commit queue is stuck, it's because a notification wasn't created for some reason. 

      Instead, we should (if processing_seconds is > than some constant) check if the item at the top of the queue is in fact finished, and in that case remove it.

      In this case, instead of logging info, if we do remove an item at the top of the queue, we should grip.Critical that we've Unstuck the queue so that we can investigate that item.

       

      Attachments

        Activity

          People

            chaya.malik@mongodb.com Chaya Malik
            annie.black@mongodb.com Annie Black
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: