[SERVER-46458] Cannot run unittest suite locally Created: 27/Feb/20  Updated: 29/Oct/23  Resolved: 05/Mar/20

Status: Closed
Project: Core Server
Component/s: Build
Affects Version/s: None
Fix Version/s: 4.3.5, 4.4.0-rc3

Type: Bug Priority: Major - P3
Reporter: Eric Milkie Assignee: Mathew Robinson (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Related
is related to SERVER-49395 Cannot run unittest suite locally (re... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v4.4
Sprint: Dev Platform 2020-03-09
Participants:

 Description   

If I build everything, even with hygienic builds, using ninja, one of the generated targets is build/unittests.txt. This file seems to have incorrect formatting, as this is the error I get when running resmoke:

$ buildscripts/resmoke.py --suite=unittests -j20
[resmoke] 2020-02-27T13:46:59.344-0500 verbatim resmoke.py invocation: buildscripts/resmoke.py --suite=unittests -j20
Traceback (most recent call last):
  File "buildscripts/resmoke.py", line 400, in <module>
    main()
  File "buildscripts/resmoke.py", line 396, in main
    resmoke.run()
  File "buildscripts/resmoke.py", line 113, in run
    self.run_tests()
  File "buildscripts/resmoke.py", line 168, in run_tests
    suites = self._get_suites()
  File "buildscripts/resmoke.py", line 252, in _get_suites
    return suitesconfig.get_suites(self._config.suite_files, self._config.test_files)
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/suitesconfig.py", line 99, in get_suites
    suite = _suite.Suite(suite_filename, suite_config)
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/testing/suite.py", line 74, in __init__
    self.tests, self.excluded = self._get_tests_for_kind(self.test_kind)
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/testing/suite.py", line 105, in _get_tests_for_kind
    return _selector.filter_tests(test_kind, selector_config)
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/selector.py", line 727, in filter_tests
    return selector.select(selector_config)
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/selector.py", line 581, in select
    return _Selector.select(self, selector_config)
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/selector.py", line 429, in select
    test_list = _TestList(self._test_file_explorer, roots, self._tests_are_files)
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/selector.py", line 155, in __init__
    self._roots = self._expand_files(roots) if tests_are_files else roots
  File "/DATA1/data/2/mongo/buildscripts/resmokelib/selector.py", line 165, in _expand_files
    raise ValueError("Unrecognized test file: {}".format(test))
ValueError: Unrecognized test file: build/install/bin/base_test\nbuild/install/bin/bson_mutable_test\nbuild/install/bin/bson_util_test\nbuild/install/bin/bson_test\nbuild/install/bin/topology_description_test\nbuild/install/bin/server_description_test\nbuild/install/bin/topology_manager_test\nbuild/install/bin/topology_state_machine_test\nbuild/install/bin/client_test\nbuild/install/bin/client_rs_test\nbuild/install/bin/crypto_test\nbuild/install/bin/db_auth_test\nbuild/install/bin/db_bson_test\nbuild/install/bin/db_catalog_util_test\nbuild/install/bin/db_catalog_test\nbuild/install/bin/map_reduce_agg_test\nbuild/install/bin/db_commands_test\nbuild/install/bin/db_concurrency_test\nbuild/install/bin/db_exec_test\nbuild/install/bin/db_free_mon_test\nbuild/install/bin/db_fts_unicode_test\nbuild/install/bin/db_fts_test\nbuild/install/bin/db_ftdc_test\nbuild/install/bin/db_geo_test\nbuild/install/bin/db_index_test\nbuild/install/bin/db_matcher_test\nbuild/install/bin/db_ops_test\nbuild/install/bin/process_interface_test\nbuild/install/bin/db_pipeline_test\nbuild/install/bin/db_query_collation_test\nbuild/install/bin/query_datetime_test\nbuild/install/bin/db_query_test\nbuild/install/bin/db_repl_test\nbuild/install/bin/db_repl_coordinator_test\nbuild/install/bin/topology_version_observer_test\nbuild/install/bin/db_repl_cloners_test\nbuild/install/bin/db_s_test\nbuild/install/bin/db_s_balancer_test\nbuild/install/bin/db_s_shard_server_test\nbuild/install/bin/db_s_collection_sharding_runtime_test\nbuild/install/bin/db_s_transaction_coordinator_test\nbuild/install/bin/db_s_sharding_catalog_manager_test\nbuild/install/bin/db_sorter_test\nbuild/install/bin/db_stats_test\nbuild/install/bin/storage_biggie_test\nbuild/install/bin/storage_ephemeral_for_test_test\nbuild/install/bin/storage_wiredtiger_test\nbuild/install/bin/storage_wiredtiger_record_store_and_index_test\nbuild/install/bin/storage_wiredtiger_prefixed_record_store_and_index_test\nbuild/install/bin/db_storage_test\nbuild/install/bin/db_update_test\nbuild/install/bin/db_views_test\nbuild/install/bin/db_unittests\nbuild/install/bin/db_unittests_with_config_server_test_fixture\nbuild/install/bin/mongo_embedded_test\nbuild/install/bin/stitch_support_test\nbuild/install/bin/executor_test\nbuild/install/bin/idl_test\nbuild/install/bin/logger_test\nbuild/install/bin/log_test_v2\nbuild/install/bin/platform_test\nbuild/install/bin/rpc_test\nbuild/install/bin/s_catalog_test\nbuild/install/bin/mongos_client_test\nbuild/install/bin/mongos_client_local_test\nbuild/install/bin/s_commands_test\nbuild/install/bin/s_query_test\nbuild/install/bin/s_write_ops_test\nbuild/install/bin/s_test\nbuild/install/bin/scripting_test\nbuild/install/bin/shell_test\nbuild/install/bin/stdx_test\nbuild/install/bin/sigaltstack_location_test\nbuild/install/bin/set_terminate_dispatch_test\nbuild/install/bin/set_terminate_from_main_die_in_thread_test\nbuild/install/bin/set_terminate_from_thread_die_in_main_test\nbuild/install/bin/set_terminate_from_thread_die_in_thread_test\nbuild/install/bin/transport_test\nbuild/install/bin/unittest_test\nbuild/install/bin/util_concurrency_test\nbuild/install/bin/util_net_test\nbuild/install/bin/util_net_ssl_test\nbuild/install/bin/options_parser_test\nbuild/install/bin/util_test\nbuild/install/bin/stacktrace_test\nbuild/install/bin/stacktrace_libunwind_test\nbuild/install/bin/watchdog_test



 Comments   
Comment by Githook User [ 26/Apr/20 ]

Author:

{'name': 'Mathew Robinson', 'email': 'mathew@chasinglogic.io', 'username': 'chasinglogic'}

Message: SERVER-46458 build/unittests.txt does not expand newlines with ninja

(cherry picked from commit 7d095214ed875903d6531a9ba553cd0b94deea14)
Branch: v4.4
https://github.com/mongodb/mongo/commit/d9bb2fb9a9ad973c9599dae84d60f78b69422468

Comment by Andrew Morrow (Inactive) [ 24/Apr/20 ]

This is marked as fixed in 4.3.5, but it doesn't actually appear on the v4.4 branch. Marking for backport.

Comment by Githook User [ 04/Mar/20 ]

Author:

{'name': 'Mathew Robinson', 'username': 'chasinglogic', 'email': 'mathew@chasinglogic.io'}

Message: SERVER-46458 build/unittests.txt does not expand newlines with ninja
Branch: master
https://github.com/mongodb/mongo/commit/7d095214ed875903d6531a9ba553cd0b94deea14

Generated at Thu Feb 08 05:11:32 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.