Store test results in Evergreen

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Works as Designed
    • Priority: Unknown
    • None
    • Affects Version/s: None
    • Component/s: Tests
    • None
    • None
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      PHP's run-tests file supports passing a result file using the -W option, although this has to be injected using the TESTS variable:

      make test TESTS="-W results.log"
      

      This results in the following output (I've only run a single test):

      PASSED  /Users/alcaeus/Code/mongodb/mongo-php-driver/tests/smoketest.phpt
      

      While this file only contains the name of the test and the status, it would allow us to assemble an XUnit file containing information about all tests (including the diff for the corresponding test) which can then be stored on the patch build using Evergreen's attach.results command.

              Assignee:
              Unassigned
              Reporter:
              Andreas Braun
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: