[SERVER-69386] Improve build variants usage on performance projects Created: 01/Sep/22  Updated: 29/Jan/24  Resolved: 29/Jan/24

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: Sviatlana Zuiko Assignee: Backlog - Performance Team
Resolution: Gone away Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
Assigned Teams:
Product Performance
Participants:

 Description   

A data analysis of true_positive change points over the last year revealed that

  1. there are builders where Perf BF appeared uniquely on them:

     [
          { _id: 'atlas-like-M60' },
          { _id: 'linux-1-node-15gbwtcache' },
          { _id: 'linux-1-node-replSet' },
          { _id: 'linux-1-node-replSet-fle' },
          { _id: 'linux-3-node-replSet' },
          { _id: 'linux-3-node-replSet-disabled-feature-flags' },
          { _id: 'linux-3-node-replSet-initialsync' },
          { _id: 'linux-3-node-replSet-last-continuous-fcv' },
          { _id: 'linux-3-node-replSet-last-lts-fcv' },
          { _id: 'linux-3-node-replSet-noflowcontrol' },
          { _id: 'linux-3-shard' },
          { _id: 'linux-replSet-initialsync-logkeeper' },
          { _id: 'linux-shard-lite' },
          { _id: 'linux-shard-lite-all-feature-flags' },
          { _id: 'linux-shard-single' },
          { _id: 'linux-standalone' },
          { _id: 'linux-standalone-all-feature-flags' },
          { _id: 'linux-wt-standalone' },
          { _id: 'linux-wt-standalone-all-feature-flags' }
        ]
    

  2. here are all the builders where Perf BF appeared:

    [
          { _id: 'atlas-like-M60' },
          { _id: 'linux-1-node-15gbwtcache' },
          { _id: 'linux-1-node-replSet' },
          { _id: 'linux-1-node-replSet-audit' },
          { _id: 'linux-1-node-replSet-cwrwc' },
          { _id: 'linux-1-node-replSet-ese-cbc' },
          { _id: 'linux-1-node-replSet-ese-gcm' },
          { _id: 'linux-1-node-replSet-fle' },
          { _id: 'linux-3-node-1dayhistory-15gbwtcache' },
          { _id: 'linux-3-node-replSet' },
          { _id: 'linux-3-node-replSet-disabled-feature-flags' },
          { _id: 'linux-3-node-replSet-initialsync' },
          { _id: 'linux-3-node-replSet-last-continuous-fcv' },
          { _id: 'linux-3-node-replSet-last-lts-fcv' },
          { _id: 'linux-3-node-replSet-maintenance-events' },
          { _id: 'linux-3-node-replSet-noflowcontrol' },
          { _id: 'linux-3-node-replSet-ssl' },
          { _id: 'linux-3-shard' },
          { _id: 'linux-replSet-audit' },
          { _id: 'linux-replSet-auth-delay' },
          { _id: 'linux-replSet-initialsync-logkeeper' },
          { _id: 'linux-shard-lite' },
          { _id: 'linux-shard-lite-all-feature-flags' },
          { _id: 'linux-shard-lite-cwrwc' },
          { _id: 'linux-shard-lite-read-concern-available' },
          { _id: 'linux-shard-single' },
          { _id: 'linux-standalone' },
          { _id: 'linux-standalone-all-feature-flags' },
          { _id: 'linux-standalone-audit' },
          { _id: 'linux-wt-repl' },
          { _id: 'linux-wt-repl-all-feature-flags' },
          { _id: 'linux-wt-standalone' },
          { _id: 'linux-wt-standalone-all-feature-flags' }
        ]
    

  3. by subtracting from the set (2) the set (1), we will get the following builders which were accompanied by another builders (so that they seem to be redundant):

    linux-1-node-replSet-audit, 
    linux-1-node-replSet-cwrwc, 
    linux-1-node-replSet-ese-cbc, 
    linux-1-node-replSet-ese-gcm, 
    linux-3-node-1dayhistory-15gbwtcache, 
    linux-3-node-replSet-maintenance-events, 
    linux-3-node-replSet-ssl, 
    linux-replSet-audit, 
    linux-replSet-auth-delay, 
    linux-shard-lite-cwrwc, 
    linux-shard-lite-read-concern-available, 
    linux-standalone-audit, 
    linux-wt-repl, 
    linux-wt-repl-all-feature-flags.
    

To consider either combining them or removing. This will be cost effective and will generate less change points to triage for Perf Build Baron.

CC david.daly@mongodb.com


Generated at Thu Feb 08 06:13:20 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.