[SERVER-56168] Understand and Reduce gap in test coverage w.r.t. feature flagging Created: 19/Apr/21 Updated: 27/Oct/23 Resolved: 27/Oct/23 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Testing Infrastructure |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Robert Guo (Inactive) | Assignee: | [DO NOT ASSIGN] Backlog - Server Development Platform Team (SDP) (Inactive) |
| Resolution: | Won't Do | Votes: | 0 |
| Labels: | dp-qp-stakeholder-request-2021-04, dp-qp-stakeholder-request-2021-07, tig-hanganalyzer | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||
| Assigned Teams: |
Server Development Platform
|
||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||
| Sprint: | STM 2021-07-26, STM 2021-08-09, STM 2021-08-23, STM 2021-09-06, STM 2021-09-20, STM 2021-10-04, STM 2021-10-18, STM 2021-11-15, STM 2022-01-10, STM 2022-01-24, Dev Platform 2022-05-30, Dev Platform 2022-06-13, Dev Platform 2022-06-27, Dev Platform 2022-07-11, Dev Platform 2022-07-25 | ||||||||||||||||
| Participants: | |||||||||||||||||
| Story Points: | 2 | ||||||||||||||||
| Description |
|
During the MongoDB 5.0 release cycle, code under active development has been tested less often (in terms of compute hours) than the code which isn't. Notably, the InMemory and the large transactions format variants do not have 'all feature flags' equivalents. I really want to emphasize that continuous integration means switching the feature from off-by-default to on-by-default is a non-event because the feature has been slowly expanding its testing coverage over time until the flip. |
| Comments |
| Comment by Robert Guo (Inactive) [ 20/May/22 ] |
|
Going to pick this back up and revisit the approach here in light of learnings from the 6.0 release. |
| Comment by Robert Guo (Inactive) [ 23/Nov/21 ] |
|
Going to have to bump this out further unfortunately. The code is fully complete but the recent evergreen config size limit is preventing new variants to be added. We will revisit in a month. |
| Comment by Robert Guo (Inactive) [ 21/Sep/21 ] |
|
Code review: |
| Comment by Robert Guo (Inactive) [ 17/Sep/21 ] |
|
Moving it back to in prog. |