[SERVER-33438] burn_in_tests.py fails if there are new or modified files and build/benchmarks.txt doesn't exist Created: 22/Feb/18  Updated: 29/Oct/23  Resolved: 22/Feb/18

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 3.6.5, 3.7.3

Type: Bug Priority: Critical - P2
Reporter: Max Hirschhorn Assignee: Robert Guo (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Problem/Incident
is caused by SERVER-33199 Add Resmoke Benchmark suite Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v3.6
Sprint: TIG 2018-03-12
Participants:

 Description   

Running burn_in_tests.py shouldn't require having previously generated the build/benchmarks.txt file. The "build/benchmarks.txt" path should be added to the EXTERNAL_SUITE_SELECTORS list defined in resmokelib/config.py similar to how we handle build/unittests.txt and build/integration_tests.txt.

[2018/02/21 21:01:01.080] # Capture a list of new and modified tests.
[2018/02/21 21:01:01.080] $python buildscripts/burn_in_tests.py --branch=master --buildVariant=enterprise-rhel-62-64-bit --testListOutfile=jstests/new_tests.json --noExec $burn_in_args
[2018/02/21 21:01:05.418] Traceback (most recent call last):
[2018/02/21 21:01:05.418]   File "buildscripts/burn_in_tests.py", line 419, in <module>
[2018/02/21 21:01:05.419]     main()
[2018/02/21 21:01:05.419]   File "buildscripts/burn_in_tests.py", line 388, in main
[2018/02/21 21:01:05.419]     tests_by_executor = create_executor_list(suites, exclude_suites)
[2018/02/21 21:01:05.419]   File "buildscripts/burn_in_tests.py", line 261, in create_executor_list
[2018/02/21 21:01:05.419]     test_membership = resmokelib.parser.create_test_membership_map()
[2018/02/21 21:01:05.419]   File "/data/mci/dd115ca7fb18716dee9acf6592fb1bad/burn_in_tests_clonedir/buildscripts/resmokelib/parser.py", line 442, in create_test_membership_map
[2018/02/21 21:01:05.419]     suite = testing.suite.Suite(suite_name, suite_config)
[2018/02/21 21:01:05.419]   File "/data/mci/dd115ca7fb18716dee9acf6592fb1bad/burn_in_tests_clonedir/buildscripts/resmokelib/testing/suite.py", line 45, in __init__
[2018/02/21 21:01:05.419]     self.tests, self.excluded = self._get_tests_for_kind(self.test_kind)
[2018/02/21 21:01:05.419]   File "/data/mci/dd115ca7fb18716dee9acf6592fb1bad/burn_in_tests_clonedir/buildscripts/resmokelib/testing/suite.py", line 75, in _get_tests_for_kind
[2018/02/21 21:01:05.419]     tests, excluded = _selector.filter_tests(test_kind, test_info)
[2018/02/21 21:01:05.419]   File "/data/mci/dd115ca7fb18716dee9acf6592fb1bad/burn_in_tests_clonedir/buildscripts/resmokelib/selector.py", line 582, in filter_tests
[2018/02/21 21:01:05.419]     return selector.select(selector_config)
[2018/02/21 21:01:05.419]   File "/data/mci/dd115ca7fb18716dee9acf6592fb1bad/burn_in_tests_clonedir/buildscripts/resmokelib/selector.py", line 492, in select
[2018/02/21 21:01:05.419]     return _Selector.select(self, selector_config)
[2018/02/21 21:01:05.419]   File "/data/mci/dd115ca7fb18716dee9acf6592fb1bad/burn_in_tests_clonedir/buildscripts/resmokelib/selector.py", line 421, in select
[2018/02/21 21:01:05.419]     roots = self._test_file_explorer.read_root_file(selector_config.root)
[2018/02/21 21:01:05.419]   File "/data/mci/dd115ca7fb18716dee9acf6592fb1bad/burn_in_tests_clonedir/buildscripts/resmokelib/selector.py", line 69, in read_root_file
[2018/02/21 21:01:05.419]     with open(root_file_path, "rb") as filep:
[2018/02/21 21:01:05.419] IOError: [Errno 2] No such file or directory: 'build/benchmarks.txt'



 Comments   
Comment by Githook User [ 26/Apr/18 ]

Author:

{'email': 'robert.guo@10gen.com', 'username': 'guoyr', 'name': 'Robert Guo'}

Message: SERVER-33438 ignore benchmarks in burn_in_tests.py

(cherry picked from commit f19ec3f130458864e082ffcaca831f8664ed7478)
Branch: v3.6
https://github.com/mongodb/mongo/commit/d8708316ad5016a3bce834c964b2226173b83a12

Comment by Githook User [ 22/Feb/18 ]

Author:

{'email': 'robert.guo@10gen.com', 'name': 'Robert Guo', 'username': 'guoyr'}

Message: SERVER-33438 ignore benchmarks in burn_in_tests.py
Branch: master
https://github.com/mongodb/mongo/commit/f19ec3f130458864e082ffcaca831f8664ed7478

Generated at Thu Feb 08 04:33:24 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.