[SERVER-53960] burn_in_tests tries to run enterprise test against non-enterprise build variant Created: 21/Jan/21  Updated: 29/Oct/23  Resolved: 25/Jan/21

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.9.0, 4.4.4

Type: Bug Priority: Major - P3
Reporter: David Storch Assignee: David Bradford (Inactive)
Resolution: Fixed Votes: 0
Labels: tig-burnin
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v4.4
Sprint: DAG 2021-02-08
Participants:
Story Points: 3

 Description   

I had a recent set of changes for SERVER-51970 which required modifications to a slew of jstests in both the community repository and the enterprise modules. The burn_in_tests task failed against the "! Linux (No Journal)" build variant. Based on reading etc/evergreen.yml, I believe this build variant uses a community build of the server, excluding enterprise. However, burn_in_tests appeared to still try to run the changed jstests from the enterprise modules. Since the enterprise modules git repo was presumably not ever cloned, the test then fails because it cannot find the jstest file. For example:

 [2021/01/21 17:41:42.099] [resmoke] 2021-01-21T17:41:42.099+0000 verbatim resmoke.py invocation: buildscripts/resmoke.py run --suites=no_passthrough --storageEngine=wiredTiger --nojournal --excludeWithAnyTags=requires_journaling,requires_replication,requires_sharding,uses_transactions,requires_http_client --repeatTestsSecs=600 --repeatTestsMin=2 --repeatTestsMax=1000 src/mongo/db/modules/enterprise/jstests/hot_backups/backup_cursor_extend_waiting_logic.js --jobs=4 --shuffle --continueOnFailure --storageEngineCacheSizeGB=1 --nojournal --excludeWithAnyTags=requires_journaling,requires_replication,requires_sharding,uses_transactions,requires_http_client --log=buildlogger --staggerJobs=on --installDir=dist-test/bin --buildId=mongodb_mongo_master_linux_64_duroff_required_patch_a8da10cfe4af613248696f8d6caa696baa92d993_6009a26032f417231ddf651f_21_01_21_15_54_31 --distroId=rhel62-small --executionNumber=0 --projectName=mongodb-mongo-master --gitRevision=a8da10cfe4af613248696f8d6caa696baa92d993 --revisionOrderId=david.storch_1280 --taskId=mongodb_mongo_master_linux_64_duroff_required_burn_in:noPassthrough_225_linux_64_duroff_required_patch_a8da10cfe4af613248696f8d6caa696baa92d993_6009a26032f417231ddf651f_21_01_21_15_54_31 --taskName=burn_in:noPassthrough_225_linux-64-duroff-required --variantName=linux-64-duroff-required --versionId=6009a26032f417231ddf651f --reportFile=report.json --perfReportFile=perf.json
 [2021/01/21 17:41:42.106] [resmoke] 2021-01-21T17:41:42.106+0000 resmoke.py invocation for local usage: buildscripts/resmoke.py run --suites=no_passthrough --storageEngine=wiredTiger --installDir=dist-test/bin --continueOnFailure --excludeWithAnyTags=requires_journaling,requires_replication,requires_sharding,uses_transactions,requires_http_client --excludeWithAnyTags=requires_journaling,requires_replication,requires_sharding,uses_transactions,requires_http_client --jobs=4 --nojournal --repeatTestsMax=1000 --repeatTestsMin=2 --repeatTestsSecs=600.0 --shuffle --storageEngineCacheSizeGB=1 src/mongo/db/modules/enterprise/jstests/hot_backups/backup_cursor_extend_waiting_logic.js
 [2021/01/21 17:41:42.112] /sbin/sysctl -n "kernel.core_pattern"
 [2021/01/21 17:41:42.112] uname -s)
 [2021/01/21 17:41:42.112] uname -s
 [2021/01/21 17:41:42.112] Traceback (most recent call last):
 [2021/01/21 17:41:42.112]   File "buildscripts/resmoke.py", line 14, in <module>
 [2021/01/21 17:41:42.112]     cli.main(sys.argv)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/cli.py", line 17, in main
 [2021/01/21 17:41:42.112]     subcommand.execute()
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/run/__init__.py", line 121, in execute
 [2021/01/21 17:41:42.112]     self.run_tests()
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/run/__init__.py", line 190, in run_tests
 [2021/01/21 17:41:42.112]     suites = self._get_suites()
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/run/__init__.py", line 525, in _get_suites
 [2021/01/21 17:41:42.112]     for suite in TestRunner._get_suites(self):
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/run/__init__.py", line 274, in _get_suites
 [2021/01/21 17:41:42.112]     return suitesconfig.get_suites(config.SUITE_FILES, config.TEST_FILES)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/suitesconfig.py", line 99, in get_suites
 [2021/01/21 17:41:42.112]     suite = _suite.Suite(suite_filename, suite_config)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/testing/suite.py", line 74, in __init__
 [2021/01/21 17:41:42.112]     self.tests, self.excluded = self._get_tests_for_kind(self.test_kind)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/testing/suite.py", line 105, in _get_tests_for_kind
 [2021/01/21 17:41:42.112]     return _selector.filter_tests(test_kind, selector_config)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/selector.py", line 738, in filter_tests
 [2021/01/21 17:41:42.112]     return selector.select(selector_config)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/selector.py", line 482, in select
 [2021/01/21 17:41:42.112]     return _Selector.select(self, selector_config)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/selector.py", line 433, in select
 [2021/01/21 17:41:42.112]     test_list = _TestList(self._test_file_explorer, roots, self._tests_are_files)
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/selector.py", line 155, in __init__
 [2021/01/21 17:41:42.112]     self._roots = self._expand_files(roots) if tests_are_files else roots
 [2021/01/21 17:41:42.112]   File "/data/mci/18d41e3db233a8421d6b7e3733deee59/src/buildscripts/resmokelib/selector.py", line 165, in _expand_files
 [2021/01/21 17:41:42.112]     raise ValueError("Unrecognized test file: {}".format(test))
 [2021/01/21 17:41:42.112] ValueError: Unrecognized test file: src/mongo/db/modules/enterprise/jstests/hot_backups/backup_cursor_extend_waiting_logic.js
 [2021/01/21 17:41:42.186] Command failed: command encountered problem: error waiting on process '495dc30f-a872-4beb-8840-42fc39e8e753': exit status 1

Note that this task fails because the file src/mongo/db/modules/enterprise/jstests/hot_backups/backup_cursor_extend_waiting_logic.js is not found.

Hopefully I'm reading the logs correctly and this is a real problem!



 Comments   
Comment by Githook User [ 25/Jan/21 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-53960: Don't generate enterprise tests with burn_in on non-enterprise builds

(cherry picked from commit ba2320f093a1c138e250f27dcaf937f2a635b91b)
Branch: v4.4
https://github.com/mongodb/mongo/commit/5fad1f69662696c5b789392622aa34d370fb4825

Comment by Githook User [ 25/Jan/21 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-53960: Don't generate enterprise tests with burn_in on non-enterprise builds
Branch: master
https://github.com/mongodb/mongo/commit/ba2320f093a1c138e250f27dcaf937f2a635b91b

Comment by David Bradford (Inactive) [ 25/Jan/21 ]

The problem here is with `burn_in_tags`. It runs on an enterprise build but generates the burn_in_tests tasks for non-enterprise builds. I'm a little surprised we haven't seen it before. We just need to filter out any enterprise tests when generating for a non-enterprise build variant.

Generated at Thu Feb 08 05:32:18 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.