Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-29060

Add etc/test_retrial.yml resmoke.py tag file

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.5.9
    • Component/s: Testing Infrastructure
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible
    • Sprint:
      TIG 2017-05-29, TIG 2017-06-19

      Description

      Similar to the etc/test_lifecycle.yml tag file from SERVER-28440, an etc/test_retrial.yml tag file should be added for marking tests with a "retry_on_failure*" tag. Since a human is intended to edit the etc/test_retrial.yml, there should be a header comment that explains how to be specific in indicating that

      • the test sometimes fails in any task on any build variant with any distro,
      • the test sometimes fails in a specific task on any build variant with any distro,
      • the test sometimes fails in a specific task on a specific build variant with any distro, or
      • the test sometimes fails in a specific task on a specific build variant with a specific distro.

      by giving examples of the

      • retry_on_failure,
      • retry_on_failure|${task_name},
      • retry_on_failure|${task_name}|${build_variant}, and
      • retry_on_failure|${task_name}|${build_variant}|${distro_id} tags, respectively.

      Additionally, there should be a warning that making it possible to ignore the test failures increases the risk we won't (or will take longer to) discover a bug and that therefore tests should be tagged judiciously.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: