[SERVER-32223] Add burn-in tests for configurations in other variants in addition to other suites Created: 08/Dec/17  Updated: 30/Oct/23  Resolved: 06/Jul/18

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.1.1

Type: Improvement Priority: Major - P3
Reporter: Judah Schvimer Assignee: Jonathan Abrahams
Resolution: Fixed Votes: 3
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Related
related to SERVER-33962 Create a required build variant for r... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v4.0
Sprint: TIG 2018-07-16
Participants:
Story Points: 2

 Description   

Many tests accidentally forget to mark "requires_persistence" or other things that are only tested on non-required builders. Similarly, mmap is now run on its own builder. Incorporating some of these "variant" flags into burn-in tests on the required builders could avoid easy test failures.



 Comments   
Comment by Githook User [ 06/Jul/18 ]

Author:

{'username': 'hptabster', 'name': 'Jonathan Abrahams', 'email': 'jonathan@mongodb.com'}

Message: SERVER-32223 Add enterprise-rhel-62-64-bit-required-inmem build variant in evergreen.yml to run burn_in_tests
Branch: master
https://github.com/mongodb/mongo/commit/fa908b824495cc3c963387899091be2b5b38c2c5

Comment by Max Hirschhorn [ 04/Jun/18 ]

I think we could add a separate "inMemory" build variant to the required list in a similar fashion to what we did with the "mobile" build variant. It does mean there'll be an extra compile but the SCons cache should make it relatively cheap. I'd rather avoid add more complexity to the etc/evergreen.yml project configuration file or defining which build variants are related to which other build variants.

Comment by Max Hirschhorn [ 18/Mar/18 ]

Mobile is another excellent example.

The build variants for the mobile storage engine no longer fit well into this proposal due to how the changes from 8e5c10e as part of SERVER-33109 made it so the mongod binary compiled by the Enterprise RHEL 6.2 build variant no longer supports --storageEngine=mobile. I've created SERVER-33962 to separately address the issue described in this ticket of forgetting to tag JavaScript tests correctly.

Comment by Kyle Suarez [ 02/Feb/18 ]

Mobile is another excellent example.

Generated at Thu Feb 08 04:29:36 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.