[SERVER-32087] Run test stage of sys-perf and mongo-perf failures should lead to red evergreen boxes Created: 11/Oct/17 Updated: 30/Oct/23 Resolved: 08/Dec/17 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | 3.0.16, 3.2.19, 3.4.11, 3.6.1 |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | David Daly | Assignee: | Vick Mena (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||
| Backport Requested: |
v3.6, v3.4, v3.2, v3.0
|
||||||||||||
| Sprint: | Performance 2017-12-11 | ||||||||||||
| Participants: | |||||||||||||
| Description |
|
Currently only the analysis phase of our tests will turn an evergreen box red. Failures during the test themselves turn the evergreen box purple. Those purple boxes should be red. Failures during provisioning and mongo setup should remain purple. https://github.com/mongodb/mongo/blob/master/etc/perf.yml |
| Comments |
| Comment by Githook User [ 08/Dec/17 ] |
|
Author: {'name': 'Vick Mena', 'email': 'vickmena@gmail.com', 'username': 'vmenajr'}Message: |
| Comment by Githook User [ 08/Dec/17 ] |
|
Author: {'name': 'Vick Mena', 'email': 'vickmena@gmail.com', 'username': 'vmenajr'}Message: |
| Comment by Githook User [ 08/Dec/17 ] |
|
Author: {'name': 'Vick Mena', 'email': 'vickmena@gmail.com', 'username': 'vmenajr'}Message: |
| Comment by Githook User [ 08/Dec/17 ] |
|
Author: {'name': 'Vick Mena', 'email': 'vickmena@gmail.com', 'username': 'vmenajr'}Message: |
| Comment by Githook User [ 08/Dec/17 ] |
|
Author: {'name': 'Vick Mena', 'email': 'vickmena@gmail.com', 'username': 'vmenajr'}Message: |
| Comment by Henrik Ingo (Inactive) [ 27/Nov/17 ] |
|
Btw, after doing this change for System Performance, we now have a case where a test times out, and this is also reported as red, rather than purple, but still no test results: https://evergreen.mongodb.com/task/sys_perf_linux_3_node_replSet_core_workloads_WT_611220640b0fd32fcf81f47cdae6882a26bbac0b_17_11_26_17_15_01 I'm not sure this was what we expected from Evergreen? I'll investigate further. |
| Comment by Henrik Ingo (Inactive) [ 27/Nov/17 ] |
|
On second thought, |
| Comment by Henrik Ingo (Inactive) [ 27/Nov/17 ] |
|
This change was done as part of |
| Comment by David Daly [ 13/Nov/17 ] |
|
Adding this to PM-820 after discussion. It is relevant to the test control work. |
| Comment by Githook User [ 13/Nov/17 ] |
|
Author: {'name': 'Henrik Ingo', 'username': 'henrikingo', 'email': 'henrik.ingo@mongodb.com'}Message: PERF-1152 Disable iperf3 (emergency fix) Somehow iperf3 tests are failing, causing system failure. This makes tests See also |