[SERVER-40044] burn_in_tests.py shouldn't construct a suite.Suite for dbtest.yml Created: 08/Mar/19  Updated: 29/Oct/23  Resolved: 08/Mar/19

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.1.9

Type: Bug Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Max Hirschhorn
Resolution: Fixed Votes: 0
Labels: tig-burnin
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Problem/Incident
is caused by SERVER-39986 The dbtest binary should not be built... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Sprint: STM 2019-03-25
Participants:

 Description   

The changes from ef8733f as part of SERVER-39986 made it so the dbtest executable is no longer included in the artifacts tarball. burn_in_tests.py constructs a suite.Suite for the dbtest.yml suite file, which causes it to try and invoke dbtest --list to get the names of all of the test suites. Since it isn't possible to burn-in a new dbtest test suite anyway, we should have burn_in_tests.py specify an appropriate test_kind filter to resmokelib.suitesconfig.create_test_membership_map() to avoid constructing the suite.Suite.



 Comments   
Comment by Githook User [ 08/Mar/19 ]

Author:

{'name': 'Max Hirschhorn', 'username': 'visemet', 'email': 'max.hirschhorn@mongodb.com'}

Message: SERVER-40044 Whitelist specific test kinds in burn_in_tests.py.

Changes burn_in_tests.py to not attempt to run `dbtest --list` when
selecting files to run from all the available test suites.
Branch: master
https://github.com/mongodb/mongo/commit/18c3a38309585f1e18d2de2a75a5a2b8a17ec890

Comment by Max Hirschhorn [ 08/Mar/19 ]

This caused a system failure in my patch build due to the dbtest.exe executable not being present anymore.

[2019/03/08 16:53:46.216] PATH=$PATH:$HOME $python buildscripts/burn_in_tests.py --branch=master --buildVariant=$build_variant --testListOutfile=jstests/new_tests.json --noExec $burn_in_args
[2019/03/08 16:54:12.009] Traceback (most recent call last):
[2019/03/08 16:54:12.009]   File "buildscripts/burn_in_tests.py", line 539, in <module>
[2019/03/08 16:54:12.009]     main()
[2019/03/08 16:54:12.009]   File "buildscripts/burn_in_tests.py", line 522, in main
[2019/03/08 16:54:12.009]     tests_by_executor = create_executor_list(suites, exclude_suites)
[2019/03/08 16:54:12.009]   File "buildscripts/burn_in_tests.py", line 288, in create_executor_list
[2019/03/08 16:54:12.009]     test_membership = resmokelib.suitesconfig.create_test_membership_map()
[2019/03/08 16:54:12.009]   File "C:\data\mci\a567201f9e435e120ce46306faf47458\burn_in_tests_clonedir\buildscripts\resmokelib\suitesconfig.py", line 40, in create_test_membership_map
[2019/03/08 16:54:12.009]     suite = _suite.Suite(suite_name, suite_config)
[2019/03/08 16:54:12.009]   File "C:\data\mci\a567201f9e435e120ce46306faf47458\burn_in_tests_clonedir\buildscripts\resmokelib\testing\suite.py", line 74, in __init__
[2019/03/08 16:54:12.009]     self.tests, self.excluded = self._get_tests_for_kind(self.test_kind)
[2019/03/08 16:54:12.009]   File "C:\data\mci\a567201f9e435e120ce46306faf47458\burn_in_tests_clonedir\buildscripts\resmokelib\testing\suite.py", line 101, in _get_tests_for_kind
[2019/03/08 16:54:12.009]     return _selector.filter_tests(test_kind, selector_config)
[2019/03/08 16:54:12.009]   File "C:\data\mci\a567201f9e435e120ce46306faf47458\burn_in_tests_clonedir\buildscripts\resmokelib\selector.py", line 728, in filter_tests
[2019/03/08 16:54:12.009]     return selector.select(selector_config)
[2019/03/08 16:54:12.009]   File "C:\data\mci\a567201f9e435e120ce46306faf47458\burn_in_tests_clonedir\buildscripts\resmokelib\selector.py", line 617, in select
[2019/03/08 16:54:12.009]     raise IOError(errno.ENOENT, "File not found", selector_config.binary)
[2019/03/08 16:54:12.009] IOError: [Errno 2] File not found: '.\\dbtest.exe'

Generated at Thu Feb 08 04:53:52 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.