A data analysis of true_positive change points over the last year revealed that

1. there are builders where Perf BF appeared uniquely on them:

    [
         { _id: 'atlas-like-M60' },
         { _id: 'linux-1-node-15gbwtcache' },
         { _id: 'linux-1-node-replSet' },
         { _id: 'linux-1-node-replSet-fle' },
         { _id: 'linux-3-node-replSet' },
         { _id: 'linux-3-node-replSet-disabled-feature-flags' },
         { _id: 'linux-3-node-replSet-initialsync' },
         { _id: 'linux-3-node-replSet-last-continuous-fcv' },
         { _id: 'linux-3-node-replSet-last-lts-fcv' },
         { _id: 'linux-3-node-replSet-noflowcontrol' },
         { _id: 'linux-3-shard' },
         { _id: 'linux-replSet-initialsync-logkeeper' },
         { _id: 'linux-shard-lite' },
         { _id: 'linux-shard-lite-all-feature-flags' },
         { _id: 'linux-shard-single' },
         { _id: 'linux-standalone' },
         { _id: 'linux-standalone-all-feature-flags' },
         { _id: 'linux-wt-standalone' },
         { _id: 'linux-wt-standalone-all-feature-flags' }
       ]
   

2. here are all the builders where Perf BF appeared:

   [
         { _id: 'atlas-like-M60' },
         { _id: 'linux-1-node-15gbwtcache' },
         { _id: 'linux-1-node-replSet' },
         { _id: 'linux-1-node-replSet-audit' },
         { _id: 'linux-1-node-replSet-cwrwc' },
         { _id: 'linux-1-node-replSet-ese-cbc' },
         { _id: 'linux-1-node-replSet-ese-gcm' },
         { _id: 'linux-1-node-replSet-fle' },
         { _id: 'linux-3-node-1dayhistory-15gbwtcache' },
         { _id: 'linux-3-node-replSet' },
         { _id: 'linux-3-node-replSet-disabled-feature-flags' },
         { _id: 'linux-3-node-replSet-initialsync' },
         { _id: 'linux-3-node-replSet-last-continuous-fcv' },
         { _id: 'linux-3-node-replSet-last-lts-fcv' },
         { _id: 'linux-3-node-replSet-maintenance-events' },
         { _id: 'linux-3-node-replSet-noflowcontrol' },
         { _id: 'linux-3-node-replSet-ssl' },
         { _id: 'linux-3-shard' },
         { _id: 'linux-replSet-audit' },
         { _id: 'linux-replSet-auth-delay' },
         { _id: 'linux-replSet-initialsync-logkeeper' },
         { _id: 'linux-shard-lite' },
         { _id: 'linux-shard-lite-all-feature-flags' },
         { _id: 'linux-shard-lite-cwrwc' },
         { _id: 'linux-shard-lite-read-concern-available' },
         { _id: 'linux-shard-single' },
         { _id: 'linux-standalone' },
         { _id: 'linux-standalone-all-feature-flags' },
         { _id: 'linux-standalone-audit' },
         { _id: 'linux-wt-repl' },
         { _id: 'linux-wt-repl-all-feature-flags' },
         { _id: 'linux-wt-standalone' },
         { _id: 'linux-wt-standalone-all-feature-flags' }
       ]
   

3. by subtracting from the set (2) the set (1), we will get the following builders which were accompanied by another builders (so that they seem to be redundant):

   linux-1-node-replSet-audit, 
   linux-1-node-replSet-cwrwc, 
   linux-1-node-replSet-ese-cbc, 
   linux-1-node-replSet-ese-gcm, 
   linux-3-node-1dayhistory-15gbwtcache, 
   linux-3-node-replSet-maintenance-events, 
   linux-3-node-replSet-ssl, 
   linux-replSet-audit, 
   linux-replSet-auth-delay, 
   linux-shard-lite-cwrwc, 
   linux-shard-lite-read-concern-available, 
   linux-standalone-audit, 
   linux-wt-repl, 
   linux-wt-repl-all-feature-flags.
   

To consider either combining them or removing. This will be cost effective and will generate less change points to triage for Perf Build Baron.

CC david.daly@mongodb.com