[SERVER-30563] FSM blacklisting should fail if blacklisted test does not exist Created: 08/Aug/17  Updated: 08/Jun/18  Resolved: 08/Jun/18

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Minor - P4
Reporter: Nathan Myers Assignee: DO NOT USE - Backlog - Test Infrastructure Group (TIG)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
is related to SERVER-30531 nonexistent tests blacklisted Closed
Participants:

 Comments   
Comment by Max Hirschhorn [ 08/Jun/18 ]

$ python buildscripts/resmoke.py --suites=concurrency jstests/concurrency/fsm_workloads/does_not_exist.js
[resmoke] 2018-06-08T18:13:41.351-0400 resmoke.py invocation: buildscripts/resmoke.py --suites=concurrency jstests/concurrency/fsm_workloads/does_not_exist.js
Traceback (most recent call last):
  File "buildscripts/resmoke.py", line 269, in <module>
    main()
  File "buildscripts/resmoke.py", line 265, in main
    resmoke.run()
  File "buildscripts/resmoke.py", line 86, in run
    self.run_tests()
  File "buildscripts/resmoke.py", line 134, in run_tests
    suites = self._get_suites()
  File "buildscripts/resmoke.py", line 215, in _get_suites
    return suitesconfig.get_suites(self._config.suite_files, self._config.test_files)
  File "/Users/maxh/debugging/mongo/buildscripts/resmokelib/suitesconfig.py", line 83, in get_suites
    suite = _suite.Suite(suite_filename, suite_config)
  File "/Users/maxh/debugging/mongo/buildscripts/resmokelib/testing/suite.py", line 39, in __init__
    self.tests, self.excluded = self._get_tests_for_kind(self.test_kind)
  File "/Users/maxh/debugging/mongo/buildscripts/resmokelib/testing/suite.py", line 66, in _get_tests_for_kind
    return _selector.filter_tests(test_kind, selector_config)
  File "/Users/maxh/debugging/mongo/buildscripts/resmokelib/selector.py", line 706, in filter_tests
    return selector.select(selector_config)
  File "/Users/maxh/debugging/mongo/buildscripts/resmokelib/selector.py", line 428, in select
    test_list = _TestList(self._test_file_explorer, roots, self._tests_are_files)
  File "/Users/maxh/debugging/mongo/buildscripts/resmokelib/selector.py", line 157, in __init__
    self._roots = self._expand_files(roots) if tests_are_files else roots
  File "/Users/maxh/debugging/mongo/buildscripts/resmokelib/selector.py", line 167, in _expand_files
    raise ValueError("Unrecognized test file: {}".format(test))
ValueError: Unrecognized test file: jstests/concurrency/fsm_workloads/does_not_exist.js

Comment by Max Hirschhorn [ 08/Aug/17 ]

nathan.myers, this behavior already exists for resmoke.py as long as the filename is written explicitly (i.e. not using a glob pattern). We're planning to have the FSM workloads able to be run directly through resmoke.py to achieve this and many other benefits.

Generated at Thu Feb 08 04:24:15 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.