Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-21763

Track "compare" task for performance results as regular regression tasks.

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.1, 3.3.0
    • Component/s: Performance
    • Labels:
    • Backwards Compatibility:
      Fully Compatible
    • Sprint:
      Performance D (12/14/15)

      Description

      We currently make pass/fail decisions in the compare.py script when trying to compare to performance results. As it turned out, this is an inflexible solution considering the threshold needed for different tests varies.

      The solution is to not make that decision in compare.py script, but run the regression analysis script after the ratios are calculated by compare.py.

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: