Uploaded image for project: 'Evergreen'
  1. Evergreen
  2. EVG-6464

Calculate the limited (20 days) reliability score for a single task name and a significance parameter.

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v2019.08.01
    • Component/s: app
    • Labels:

      Description

      As the commitQ,
      When the task_reliability endpoint is accessed,
      And no task name is provided ,
      Then a status 400 "Missing Tasks values" error should be returned.

      As the commitQ,
      When the task_reliability endpoint is accessed,
      And 51 task names are provided ,
      Then a status 400 "Too Many Tasks values" error should be returned.

      As the commitQ,
      When the task_reliability endpoint is accessed,
      And a task name is set to "aggregation_expression_multiversion_fuzzer",
      Then an array of up to 50 Task Reliability Score Record should be returned using the defaults parameters.

      As the commitQ,
      When the task_reliability endpoint is accessed,
      And a task name is set to "aggregation_expression_multiversion_fuzzer",
      And a limit of 1 is provided,
      Then an array of 1 Task Reliability Score Record should be returned using the defaults parameters.

      As the commitQ,
      When the task_reliability endpoint is accessed,
      And a task name is set to "no_such_task",
      Then an empty array should be returned.

      As the commitQ,
      When the task_reliability endpoint is accessed,
      And a task name is set to "aggregation_expression_multiversion_fuzzer",
      And a significance value is provided,
      Then an array of up to 50 Task Reliability Score Record should be returned with the correct reliability.

      As the commitQ,
      When the task_reliability endpoint is accessed,
      And a task name is set to "aggregation_expression_multiversion_fuzzer",
      And a significance value is provided,
      And a limit of 2 is provided,
      Then an array of 2 Task Reliability Score Records should be returned.


      AC:

      • Basic task name validation is implemented.
      • The significance parameter is validated and handled correctly. Invalid, default(.05) and specified.
      • The limit parameter is validated and handled correctly. Invalid, default(1) and specified.

        Attachments

          Activity

            People

            Assignee:
            jim.oleary James O'Leary
            Reporter:
            jim.oleary James O'Leary
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: