[SERVER-62191] Analog to burn_in_tests for running any user-specified test Created: 24/Feb/21  Updated: 29/Oct/23  Resolved: 20/Dec/21

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 5.3.0

Type: New Feature Priority: Major - P3
Reporter: Maria van Keulen Assignee: David Bradford (Inactive)
Resolution: Fixed Votes: 0
Labels: dp-qp-stakeholder-request-2021-04, dp-qp-stakeholder-request-2021-07
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
Backwards Compatibility: Fully Compatible
Sprint: DAG 2021-12-27
Participants:
Story Points: 2

 Description   

Motivation for Request

Server team engineers would like to rerun individual failing tests in their patch builds without needing to rerun the entire test suite. The use case for this is when running multiple patch builds for a given ticket. If a fix needs to be made and the user is certain that only one test in a suite needs to be run in order to release the change, e.g., a tag must be added to the test, the user would prefer to run only that test. Running locally is not sufficient since it would not provide full platform coverage.

Context

This request originally comes from EVG-13806, which will be closed out in favor of linking to related work.

Description

The request is for an analog to burn_in_tests which allows a user to specify the name of the test to be run – potentially using Parameterized Builds – and only run that test. If possible, we could also allow users to specify the number of times they'd like the test to be run.



 Comments   
Comment by Githook User [ 21/Dec/21 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-62191: Don't attempt burn-in-test when no tests are found
Branch: master
https://github.com/mongodb/mongo/commit/8c1ac4b85d016531709fce34dbd4fde1f33adbbe

Comment by Githook User [ 20/Dec/21 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-62191: Allows users to specify tests for burn_in_tests
Branch: master
https://github.com/mongodb/mongo/commit/e033084511b09375df39c775b09c6841d0e3c495

Comment by James Wahlin [ 04/Mar/21 ]

brooke.miller - added. I mentioned as well in that line item that this would ideally be paired with a way to reuse previously built binaries. This would allow for quick iterations on a Javascript test for example.

Comment by Brooke Miller [ 04/Mar/21 ]

david.bradford mentioned that this should likely be converted to a project. (I'll do that as a follow-up after triage.)

james.wahlin, can you be sure to include this request in the next stakeholder spreadsheet (for April), to help us understand the priority and impact of this, alongside other requests for next quarter? Thank you!

Generated at Thu Feb 08 05:54:25 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.