[SERVER-43865] Add backports_required_for_multiversion_tests.yml and exclude appropriate tests on multiversion generation Created: 07/Oct/19  Updated: 29/Oct/23  Resolved: 11/Nov/19

Status: Closed
Project: Core Server
Component/s: Replication
Affects Version/s: 4.3 Required
Fix Version/s: 4.3.1

Type: Task Priority: Major - P3
Reporter: Jason Chan Assignee: Jason Chan
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Problem/Incident
Backwards Compatibility: Fully Compatible
Sprint: Build 2019-10-07, Repl 2019-11-04, Repl 2019-11-18
Participants:
Linked BF Score: 0

 Description   
  1. Any commits that add server code intended for backport and include .js tests run as part of multiversion testing should include a change to a backports_required_for_multiversion_tests.yml file. This yaml file will contain root level keys for each of the supported multiversion test directories like core, sharding, replication, etc. Engineers should add the test to be blacklisted from multiversion tests along with the SERVER ticket number associated with the commit. 

 

For instance, if I intend to blacklist jstests/core/some_test.js as part of SERVER-1000 I will add the following to backports_required_for_multiversion_tests.yml:

core:

  ...

test_file: jstests/core/some_test.js

 

Changes to backports_required_for_multiversion_tests.yml will be part of the backports made to the last-stable development branch. On each run of the multiversion tests, we will grab the commit hash of the last-stable nightly build binary and then find the state of backports_required_for_multiversion_tests.yml at that commit hash. We will exclude any tests in (test, ticket) pairs that appear in the latest branch file but not in the last-stable branch file as this would indicate the backport to last-stable has not yet made its way into the last-stable nightly build. Tests that appear in the last-stable branch but not on the latest branch will continue to be run in our multiversion suites.

  • The backports_required_for_multiversion_tests.yml file will be cleared  on the latest branch upon each time we branch during release. This will be safe because the two files will be identical at branch time.


 Comments   
Comment by Githook User [ 11/Nov/19 ]

Author:

{'name': 'Jason Chan', 'username': 'jasonjhchan', 'email': 'jason.chan@mongodb.com'}

Message: SERVER-43865 Add blacklist logic on multiversion test generation
Branch: master
https://github.com/mongodb/mongo/commit/bc83ae1a06ffdceb8b42623d82585418f7f9711c

Comment by Githook User [ 07/Nov/19 ]

Author:

{'username': 'jasonjhchan', 'email': 'jason.chan@mongodb.com', 'name': 'Jason Chan'}

Message: SERVER-43865 Fix trailing whitespaces in etc/backports_required_for_multiversion_tests.yml
Branch: v4.2
https://github.com/mongodb/mongo/commit/ce1ee99c04195d3f1796505f1963fa5b2906c06c

Comment by Githook User [ 31/Oct/19 ]

Author:

{'name': 'Jason Chan', 'username': 'jasonjhchan', 'email': 'jason.chan@mongodb.com'}

Message: SERVER-43865 Add "backports_required_for_multiversion_tests.yml"
Branch: v4.2
https://github.com/mongodb/mongo/commit/f210bc645453c05979067c556bf6f2bd43e64134

Generated at Thu Feb 08 05:04:20 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.