Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-29060

Add etc/test_retrial.yml resmoke.py tag file

    XMLWordPrintable

Details

    • Task
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • 3.5.9
    • Testing Infrastructure
    • None
    • Fully Compatible
    • TIG 2017-05-29, TIG 2017-06-19

    Description

      Similar to the etc/test_lifecycle.yml tag file from SERVER-28440, an etc/test_retrial.yml tag file should be added for marking tests with a "retry_on_failure*" tag. Since a human is intended to edit the etc/test_retrial.yml, there should be a header comment that explains how to be specific in indicating that

      • the test sometimes fails in any task on any build variant with any distro,
      • the test sometimes fails in a specific task on any build variant with any distro,
      • the test sometimes fails in a specific task on a specific build variant with any distro, or
      • the test sometimes fails in a specific task on a specific build variant with a specific distro.

      by giving examples of the

      • retry_on_failure,
      • retry_on_failure|${task_name},
      • retry_on_failure|${task_name}|${build_variant}, and
      • retry_on_failure|${task_name}|${build_variant}|${distro_id} tags, respectively.

      Additionally, there should be a warning that making it possible to ignore the test failures increases the risk we won't (or will take longer to) discover a bug and that therefore tests should be tagged judiciously.

      Attachments

        Issue Links

          Activity

            People

              eddie.louie Eddie Louie
              max.hirschhorn@mongodb.com Max Hirschhorn
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: