[SERVER-61853] suitesconfig.get_suite is occasionally unable to find test suite Created: 02/Dec/21  Updated: 29/Oct/23  Resolved: 17/Mar/22

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 5.3.2, 6.0.0-rc0

Type: Bug Priority: Major - P3
Reporter: David Bradford (Inactive) Assignee: David Bradford (Inactive)
Resolution: Fixed Votes: 0
Labels: tig-resmoke
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v5.3
Sprint: DAG 2022-03-21
Participants:
Linked BF Score: 34
Story Points: 1

 Description   

We have seen a few instances in patch builds where we are unable to generate tasks because the test suite definitions appear to be missing. There are not in fact missing, because rerunning the task is successful, but the code is reporting them missing.

Note: The only examples I've seen of this have been on windows.

A sample stack trace looks like this:

[2021/12/02 15:08:45.043] Traceback (most recent call last):
[2021/12/02 15:08:45.043]   File "buildscripts/evergreen_gen_build_variant.py", line 414, in <module>
[2021/12/02 15:08:45.044]     main()  # pylint: disable=no-value-for-parameter
[2021/12/02 15:08:45.044]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\venv\lib\site-packages\click\core.py", line 829, in __call__
[2021/12/02 15:08:45.044]     return self.main(*args, **kwargs)
[2021/12/02 15:08:45.044]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\venv\lib\site-packages\click\core.py", line 782, in main
[2021/12/02 15:08:45.045]     rv = self.invoke(ctx)
[2021/12/02 15:08:45.045]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\venv\lib\site-packages\click\core.py", line 1066, in invoke
[2021/12/02 15:08:45.046]     return ctx.invoke(self.callback, **ctx.params)
[2021/12/02 15:08:45.046]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\venv\lib\site-packages\click\core.py", line 610, in invoke
[2021/12/02 15:08:45.046]     return callback(*args, **kwargs)
[2021/12/02 15:08:45.046]   File "buildscripts/evergreen_gen_build_variant.py", line 407, in main
[2021/12/02 15:08:45.046]     orchestrator.generate(evg_expansions.task_id, evg_expansions.build_variant, output_file)
[2021/12/02 15:08:45.047]   File "buildscripts/evergreen_gen_build_variant.py", line 272, in generate
[2021/12/02 15:08:45.047]     builder = self.generate_build_variant(builder, build_variant_name)
[2021/12/02 15:08:45.047]   File "buildscripts/evergreen_gen_build_variant.py", line 309, in generate_build_variant
[2021/12/02 15:08:45.047]     [j.result() for j in jobs]  # pylint: disable=expression-not-assigned
[2021/12/02 15:08:45.047]   File "buildscripts/evergreen_gen_build_variant.py", line 309, in <listcomp>
[2021/12/02 15:08:45.047]     [j.result() for j in jobs]  # pylint: disable=expression-not-assigned
[2021/12/02 15:08:45.047]   File "C:\python\python37\lib\concurrent\futures\_base.py", line 428, in result
[2021/12/02 15:08:45.057]     return self.__get_result()
[2021/12/02 15:08:45.057]   File "C:\python\python37\lib\concurrent\futures\_base.py", line 384, in __get_result
[2021/12/02 15:08:45.057]     raise self._exception
[2021/12/02 15:08:45.057]   File "C:\python\python37\lib\concurrent\futures\thread.py", line 57, in run
[2021/12/02 15:08:45.058]     result = self.fn(*self.args, **self.kwargs)
[2021/12/02 15:08:45.058]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\task_generation\evg_config_builder.py", line 71, in generate_suite
[2021/12/02 15:08:45.058]     generated_suite = self.suite_split_service.split_suite(split_params)
[2021/12/02 15:08:45.058]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\task_generation\suite_split.py", line 213, in split_suite
[2021/12/02 15:08:45.059]     return self.calculate_suites_from_evg_stats(evg_stats, params)
[2021/12/02 15:08:45.059]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\task_generation\suite_split.py", line 244, in calculate_suites_from_evg_stats
[2021/12/02 15:08:45.059]     tests_runtimes = self.filter_tests(test_stats.get_tests_runtimes(), params)
[2021/12/02 15:08:45.059]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\task_generation\suite_split.py", line 300, in filter_tests
[2021/12/02 15:08:45.059]     normalize_test_name(test) for test in self.resmoke_proxy.list_tests(params.suite_name)
[2021/12/02 15:08:45.059]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\task_generation\resmoke_proxy.py", line 41, in list_tests
[2021/12/02 15:08:45.059]     suite = self._suite_config.get_suite(suite_name)
[2021/12/02 15:08:45.059]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\resmokelib\suitesconfig.py", line 336, in get_suite
[2021/12/02 15:08:45.060]     suite_config = _get_suite_config(suite_name_or_path)
[2021/12/02 15:08:45.060]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\resmokelib\suitesconfig.py", line 118, in _get_suite_config
[2021/12/02 15:08:45.060]     return SuiteFinder.get_config_obj(suite_name_or_path)
[2021/12/02 15:08:45.060]   File "Z:\data\mci\c754c19e28f875b9f4d0811d6a755f1a\src\buildscripts\resmokelib\suitesconfig.py", line 325, in get_config_obj
[2021/12/02 15:08:45.060]     raise errors.SuiteNotFound("Unknown suite '%s'" % suite_path)
 [2021/12/02 15:08:45.228] buildscripts.resmokelib.errors.SuiteNotFound: Unknown suite 'ssl_x509'

It seems like it might be a problem in the `get_named_suite` function called here.



 Comments   
Comment by Githook User [ 02/May/22 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-61853: Sync get_named_suites lookups in resmoke

(cherry picked from commit ca7a22da6fb96561f0520c0b5084d32fc2bac67f)
Branch: v5.3
https://github.com/mongodb/mongo/commit/d03ca3eebefaca35c6d6f1238034f9a964679e79

Comment by Uladzimir Makouski [ 27/Apr/22 ]

Requesting a backport, since this issue is reoccurring on v5.3:
BFG-1154487, BFG-1139350

Comment by Githook User [ 17/Mar/22 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-61853: Sync get_named_suites lookups in resmoke
Branch: master
https://github.com/mongodb/mongo/commit/ca7a22da6fb96561f0520c0b5084d32fc2bac67f

Generated at Thu Feb 08 05:53:29 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.