Run flaky tests with verbose logging to make diagnosing easier

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Testing
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      We have several tickets for tests that fail non-deterministically in Evergreen.

      See the flaky-tests label for a list of all such tests.

      To more easily diagnose these, let's consider:

      • running these tests "n" times on a dedicated variant.
      • enabling trace logging for that variant to get verbose log output
        • take into consideration that trace logging could be verbose. E.g. if we run AWS tests or Atlas auth tests with tracing, those should not place trace logging output anywhere public.
      • scheduling this variant at a lower cadence, perhaps once a week, and have it not be a part of patch builds

            Assignee:
            Unassigned
            Reporter:
            Kevin Albertson
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: