Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-50277

Performance Yaml Cleanups pt 1

    • Type: Icon: Task Task
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 4.7.0
    • Affects Version/s: Backlog
    • Component/s: Testing Infrastructure
    • Labels:
      None
    • Fully Compatible
    • v4.4
    • STM 2020-08-24
    • 0
    • 5

      A handful of things that will make iteration a bit easier. This is all really hard to do in separate tickets or in a staged way. Smaller PRs first wherever possible, but minimize times we backport. Best to just rip off the bandaid.

      Changes to sys-perf yamls (master and 4.4):

      1. Single f_run_dsi_workload Evergreen function
        1. Mostly the same logic that's currently in the handful of existing functions, but in a single function.
        2. Update the param names to match the files e.g. cluster to infrastructure_provisioning
        3. Use conventional module locations where possible
        4. Use conventional report output locations where possible
        5. Remove cruft like dsienv.sh; run-dsi invocations are single-line scripts
      2. Change the order of tasks/functions to keep compile and dsi stuff more separated.
      3. Add a genny task that is not a generated task.

      Changes to microbenchmarks yamls (master and 4.4):

      1. Single f_run_microbenchmarks_workload evergreen function for non-genny workloads
      2. Single f_run_genny_workload evergreen function for genny workloads
      3. Both functions to use conventional module locations where possible
      4. Remove extraneous genny invocation--I think just need the call to lamp without venv nonsense
      5. Tidy the weird pkill logic
      6. Conventional locations for genny, DSI, and signal-processing modules
      7. Change the order of tasks/functions to keep compile, dsi, and non-dsi-based-workloads more separated.

      Changes to DSI:

      1. Update for conventional paths above
      2. Make evergreen-dsitest.yml a representative snapshot of what's in system_perf.yml and, if possible, something similar for perf.yml
      3. Change documentation for how to patch-build without compile

      Changes to Genny:

      1. Kill "legacy" task-gen logic

            Assignee:
            ryan.timmons@mongodb.com Ryan Timmons
            Reporter:
            ryan.timmons@mongodb.com Ryan Timmons
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: