[SERVER-68500] multiversion tag files are not correctly excluding tests in CI Created: 02/Aug/22  Updated: 29/Oct/23  Resolved: 12/Dec/22

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 6.0.4, 6.2.0-rc4, 6.3.0-rc0

Type: Bug Priority: Critical - P2
Reporter: Robert Guo (Inactive) Assignee: Tausif Rahman (Inactive)
Resolution: Fixed Votes: 0
Labels: bkp
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
Related
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v6.2, v6.1, v6.0
Participants:
Linked BF Score: 150

 Description   

Excluded tests seem to not be picked up in Evergreen. Although the behavior appears to be correct locally when running the identical set of steps.



 Comments   
Comment by Mickey Winters [ 12/Dec/22 ]

tausif.rahman@mongodb.com ah I see what my confusion was: the backport to 6.0 was commited but the backport ticket itself was still marked in review so I thought It wasn't merged and I was still blocked on this. At no point did I intend to leave you with the impression that BF-24909 was caused by this bug or that any action was needed from you outside of BACKPORT-14253, so I apologize for any confusion.

Comment by Tausif Rahman (Inactive) [ 12/Dec/22 ]

aaron.morand@mongodb.com yeah, I needed to look at the linked BFs to be sure that they were linked properly. I believe this ticket is in the correct state now. Closing this out now.

Comment by Tausif Rahman (Inactive) [ 12/Dec/22 ]

BF-26891 stems from a different issue as well & is not related to this ticket. I'm going to unlink that ticket as well. If it is determined an SDP fix is needed, feel free to reach out to SDP and create a new ticket.

Comment by Tausif Rahman (Inactive) [ 12/Dec/22 ]

mickey.winters@mongodb.com The linked patch in the comment shows a failure for sharding_last_lts_mongos_and_mixed_shards which has been resolved via the commits on this ticket. After a thorough pass, it does not look like the linked failed tests & tasks for BF-24909 are related to "multiversion tag files are not correctly excluding tests in CI". From what I see, applying the changes to get sharding_last_lts_mongos_and_mixed_shards passing will not work for failed tests/tasks in BF-24909. I'm going to unlink BF-24909 from this ticket. If it does turn out to be a different multiversion infrastructure issue, feel free to create another ticket & reach out.

Comment by Mickey Winters [ 09/Dec/22 ]

tausif.rahman@mongodb.com BF-24909 was not caused by this Bug, but I was running into this issue while trying to backport a fix for BF-24909 so that's why I marked it as dependent because I can't fix BF-24909 until the backport of this bugfix is applied to 6.0. here is the patch in 6.0 where I ran into this bug while backporting a fix for BF-24909

Comment by Aaron Morand (Inactive) [ 09/Dec/22 ]

tausif.rahman@mongodb.com It looks like the 6.2 backport for this was already merged.  Are you waiting on confirmation about the BFs before resolving the tickets?

Comment by Tausif Rahman (Inactive) [ 08/Dec/22 ]

Can someone give me an example of where a failure in BF-24909 was due to the multiversion tag file not being respected? I could not find a recently failed test in BF-24909 that came from the backports_required_for_multiversion_tests.yml file. I believe that BF-24909 is a separate issue & would like to unlink it from this ticket. Let me know if there are any concerns.

cc: mickey.winters@mongodb.com

Comment by Githook User [ 06/Dec/22 ]

Author:

{'name': 'Tausif Rahman', 'email': 'tausif.rahman@mongodb.com', 'username': 'trahman1318'}

Message: SERVER-68500 multiversion tag files are not correctly excluding tests in CI

(cherry picked from commit f4dae678391520510db9cbc44e4d3c4d7b8edc84)
Branch: v6.2
https://github.com/mongodb/mongo/commit/6f196e05ce9f063ca6e45a883483ddd22eb4baab

Comment by Githook User [ 06/Dec/22 ]

Author:

{'name': 'Tausif Rahman', 'email': 'tausif.rahman@mongodb.com', 'username': 'trahman1318'}

Message: Revert "SERVER-68500 multiversion tag files are not correctly excluding tests in CI"

This reverts commit ba23c188418b38b0c10beda1fcc530df452b05a8.
Branch: v6.2
https://github.com/mongodb/mongo/commit/f2a5b9e9bf80da0cc90b1c8c1cf8513593b28192

Comment by Githook User [ 06/Dec/22 ]

Author:

{'name': 'Tausif Rahman', 'email': 'tausif.rahman@mongodb.com', 'username': 'trahman1318'}

Message: SERVER-68500 multiversion tag files are not correctly excluding tests in CI

(cherry picked from commit f4dae678391520510db9cbc44e4d3c4d7b8edc84)
Branch: v6.0
https://github.com/mongodb/mongo/commit/3a55839246c3667ad7ebb2726f56d2098ac88971

Comment by Githook User [ 05/Dec/22 ]

Author:

{'name': 'Tausif Rahman', 'email': 'tausif.rahman@mongodb.com', 'username': 'trahman1318'}

Message: SERVER-68500 multiversion tag files are not correctly excluding tests in CI
Branch: master
https://github.com/mongodb/mongo/commit/f4dae678391520510db9cbc44e4d3c4d7b8edc84

Comment by Githook User [ 03/Dec/22 ]

Author:

{'name': 'Tausif Rahman', 'email': 'tausif.rahman@mongodb.com', 'username': 'trahman1318'}

Message: Revert "SERVER-68500 multiversion tag files are not correctly excluding tests in CI"

This reverts commit 7a6f90b2bb38765ea11110624080a61916adde97.
Branch: master
https://github.com/mongodb/mongo/commit/e717ef6798aad3e6ec65bee84921fc3961db4426

Comment by Githook User [ 03/Dec/22 ]

Author:

{'name': 'Tausif Rahman', 'email': 'tausif.rahman@mongodb.com', 'username': 'trahman1318'}

Message: SERVER-68500 multiversion tag files are not correctly excluding tests in CI

(cherry picked from commit 7a6f90b2bb38765ea11110624080a61916adde97)
Branch: v6.2
https://github.com/mongodb/mongo/commit/ba23c188418b38b0c10beda1fcc530df452b05a8

Comment by Githook User [ 03/Dec/22 ]

Author:

{'name': 'Tausif Rahman', 'email': 'tausif.rahman@mongodb.com', 'username': 'trahman1318'}

Message: SERVER-68500 multiversion tag files are not correctly excluding tests in CI
Branch: master
https://github.com/mongodb/mongo/commit/7a6f90b2bb38765ea11110624080a61916adde97

Comment by Max Hirschhorn [ 16/Nov/22 ]

I'm bumping up the priority because this is causing friction in the ability of Server engineers to commit changes. The sharding_last_lts_mongos_and_mixed_shards task task isn't respecting the backports_required_for_multiversion_tests.yml file.

Comment by Mickey Winters [ 11/Nov/22 ]

thanks! I also tried a 6.0 patch https://spruce.mongodb.com/version/636d76303e8e860dbe9b5b1d/tasks. strangely sharding_multiversion didn't try to run the test I blocked but the mixed version on did

Generated at Thu Feb 08 06:10:58 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.