Uploaded image for project: 'Evergreen'
  1. Evergreen
  2. EVG-14902

new UI issues

    XMLWordPrintable

Details

    Description

      We encountered a few issue with the new Task UI that we would like to address, as well as some improvements that we would like to ask for.

      Old to new UI - test status within a task:
      In the old UI, upon loading the task page, the user can directly see all tests sorted by status along with pass/fail counters.

      In the current patch UI, when navigating to the task itself, we get only a pass/fail status but without any details. The user must go to another tab for that. even then - there is no pass/fail count. you can't know how many tests failed. Especially with tasks in MMS that have at times thousands of tests running - this makes it very hard to tell how bad the problem is. Is there a single failing test or 4,000.

      Another sub point to the above is about the default sorting. I'm not sure what it is right now (likely by name?!) - but that prevents from seeing the important information about the failed tasks being first.

      Improvement - pass ratio compared to base commit

      Some tasks are known to have many flaky tests, the task will "always" fail. It would be nice to know how bad a failure is in comparison to the base commit. For example, if in the base commit 4 out of 4,000 tests failed, it would help to know if the test fail ratio (in this case 0.1%) remained similar to the base commit or not. Did we introduce 1 more failure or 1,000 more. It helps the developers focus on the bigger problems first.

       

      see attached images for examples.

      Attachments

        1. After sorting - we can see a failed test - what if 1000 failed.png
          502 kB
          Ron Neuman
        2. Old UI - directly shows the pass-to-fail ratio.png
          461 kB
          Ron Neuman
        3. Screen Shot 2021-07-08 at 10.27.11 AM.png
          191 kB
          Maria van Keulen
        4. Screen Shot 2021-07-08 at 10.27.19 AM.png
          176 kB
          Maria van Keulen
        5. Shows logs by default - have to click to get to test failure.png
          751 kB
          Ron Neuman
        6. The task failed - what are the failing tests - how many failed.png
          553 kB
          Ron Neuman
        7. Where are the tests - there is sometimes about a 30 seconds wait time for the tests to load.png
          276 kB
          Ron Neuman

        Issue Links

          Activity

            People

              backlog-server-evg Backlog - Evergreen Team
              ron.neuman@mongodb.com Ron Neuman
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: