[SERVER-65700] list-append's Evergreen report generator masks failures if a single iteration succeeds Created: 15/Apr/22 Updated: 29/Oct/23 Resolved: 31/May/22 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Testing Infrastructure |
| Affects Version/s: | None |
| Fix Version/s: | 6.1.0-rc0, 6.0.6 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Richard Samuels (Inactive) | Assignee: | Richard Samuels (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||
| Operating System: | ALL | ||||||||||||
| Backport Requested: |
v6.0
|
||||||||||||
| Sprint: | Dev Platform 2022-04-18, Dev Platform 2022-05-02, Dev Platform 2022-05-16, Dev Platform 2022-05-30 | ||||||||||||
| Participants: | |||||||||||||
| Description |
|
The list-append workload, unlike all other jepsen workloads, runs 30 times (as opposed to 1). jepsen_report.sh erroneously flags a single test's success as success for all 30 tests. This task shows a test that had a failure masked by this bug. Fix jepsen_report.sh so that one failure causes the whole task to fail. |
| Comments |
| Comment by Githook User [ 21/Apr/23 ] |
|
Author: {'name': 'Richard Samuels', 'email': 'richard.l.samuels@gmail.com', 'username': 'richardsamuels'}Message: (cherry picked from commit 48d37ac38656aab14427a985653e221b6ed78550) Also adds the simple_report.py module to satisfy the dependency of the |
| Comment by Githook User [ 24/May/22 ] |
|
Author: {'name': 'Richard Samuels', 'email': 'richard.l.samuels@gmail.com', 'username': 'richardsamuels'}Message: |
| Comment by Robert Guo (Inactive) [ 16/May/22 ] |
|
Will do! |
| Comment by Iryna Zhuravlova [ 16/May/22 ] |
|
hey robert.guo@mongodb.com, can you review this ticket |