Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-29192

resmoke.py shouldn't use "silentfail" test status for dynamic tests

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Fixed
    • Icon: Major - P3 Major - P3
    • 3.5.9
    • None
    • Testing Infrastructure
    • None
    • Fully Compatible
    • TIG 2017-06-19

    Description

      Tests that are started dynamically by resmoke.py tend to perform data consistency checks. Failures when running these "hooks" represent potential data corruption issues and shouldn't be caused by a test being unable to run reliably.

      The combine_reports.py script has special logic to treat silent failures in dynamic tests as real failures, but the logic would be simpler if the report.json file never contained silent failures for those tests in the first place. This also has the advantage of making it so that test failures which cause the task to fail are displayed in the Evergreen sidebar using #d9534f rather than #e7908e.

      Attachments

        Activity

          People

            yves.duhem Yves Duhem
            max.hirschhorn@mongodb.com Max Hirschhorn
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: