[SERVER-38110] Generate resmoke config YAML for a sub-suite Created: 13/Nov/18  Updated: 29/Oct/23  Resolved: 07/Dec/18

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.0.6, 4.1.7

Type: Improvement Priority: Major - P3
Reporter: David Bradford (Inactive) Assignee: James O'Leary
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Duplicate
is duplicated by SERVER-34569 generate_resmoke_suites.py should con... Closed
Related
Backwards Compatibility: Fully Compatible
Backport Requested:
v4.0
Sprint: DAG 2018-12-17
Participants:
Linked BF Score: 0
Story Points: 2

 Description   

When dividing a suite into sub-suites, the 'generate_resmoke_suite.py' file needs to create a resmoke yaml configuration file for each sub-suite that is being created. To generate this file, the original suite yaml should be read, the selector section should be updated to include the chosen test files for the sub-suite, and the new configuration should be written to disk.



 Comments   
Comment by Githook User [ 21/Dec/18 ]

Author:

{'username': 'dbradf', 'email': 'david.bradford@mongodb.com', 'name': 'David Bradford'}

Message: SERVER-38110 SERVER-38113: Generate resmoke config and evg config for a sub-suite

(cherry picked from commit baf4fa098e091da7107b33dce15a254cfcc44a26)
Branch: v4.0
https://github.com/mongodb/mongo/commit/de3c8512ca97df929af52e2183ec1d43357a9712

Comment by Githook User [ 07/Dec/18 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-38110 SERVER-38113: Generate resmoke config and evg config for a sub-suite
Branch: master
https://github.com/mongodb/mongo/commit/baf4fa098e091da7107b33dce15a254cfcc44a26

Comment by Githook User [ 06/Dec/18 ]

Author:

{'name': 'jannaerin', 'email': 'golden.janna@gmail.com', 'username': 'jannaerin'}

Message: Revert "SERVER-38110: Generate resmoke config YAML for a sub-suite"

This reverts commit e64df72bb1cbc4b9296577d9a5ac6864ac41a292.
Branch: master
https://github.com/mongodb/mongo/commit/c0bb303126ee299af536d00fb43b3f3b6f91c3e1

Comment by Githook User [ 06/Dec/18 ]

Author:

{'name': 'jannaerin', 'email': 'golden.janna@gmail.com', 'username': 'jannaerin'}

Message: Revert "SERVER-38110: fixing lint issues"

This reverts commit f411776d5c4793334818877f84ffb8f03879dfdb.
Branch: master
https://github.com/mongodb/mongo/commit/983cb0e2686b7f8333ba3d7fc257d276985ca6de

Comment by Githook User [ 06/Dec/18 ]

Author:

{'name': 'jannaerin', 'email': 'golden.janna@gmail.com', 'username': 'jannaerin'}

Message: Revert "SERVER-38110 pydoc, dir shadow and lint issues"

This reverts commit a9735cdeec0b372d9ff5d1abfe4d0007632a2efa.
Branch: master
https://github.com/mongodb/mongo/commit/3b2bd1e5b2b5c303e3f851ce090e6257ec6f3285

Comment by Githook User [ 06/Dec/18 ]

Author:

{'name': 'Jim OLeary', 'email': 'jim.oleary@gmail.com', 'username': 'jimoleary'}

Message: SERVER-38110 pydoc, dir shadow and lint issues
Branch: master
https://github.com/mongodb/mongo/commit/a9735cdeec0b372d9ff5d1abfe4d0007632a2efa

Comment by Githook User [ 06/Dec/18 ]

Author:

{'name': 'Jim OLeary', 'email': 'jim.oleary@gmail.com', 'username': 'jimoleary'}

Message: SERVER-38110: fixing lint issues
Branch: master
https://github.com/mongodb/mongo/commit/f411776d5c4793334818877f84ffb8f03879dfdb

Comment by Githook User [ 06/Dec/18 ]

Author:

{'name': 'Jim OLeary', 'email': 'jim.oleary@gmail.com', 'username': 'jimoleary'}

Message: SERVER-38110: Generate resmoke config YAML for a sub-suite
Branch: master
https://github.com/mongodb/mongo/commit/e64df72bb1cbc4b9296577d9a5ac6864ac41a292

Comment by David Bradford (Inactive) [ 03/Dec/18 ]

A few notes about 'exclude_files' section in the yaml configuration.

  • For the '_misc' generated configuration, the value of the original configurations 'exclude_files' should be copied over. Also, any file included in a sub-suite, should be added to the exclude_files list.
  • For other generated configuration files, we will not need to include the 'exclude_files' section, if we ensure that all files added to the suite would not be filtered out by the exclude_files list. This might be easier to implement as a filter that gets run on the test_list before organizing it into suites.
Comment by David Bradford (Inactive) [ 20/Nov/18 ]

The suite config file that will be read in are found here.

Looking at a suite that ends in an underscore number (e.g. '_3') will provide an example of what the generated file will looks like.

The current code generates suite config file based on templates. This ticket should replace that code and generate config files based on the existing config file for the suite being split apart.

See the Creating Resmoke Suites section of the design for more details.

Generated at Thu Feb 08 04:47:59 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.