Add automated evaluation tests for prompts

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Done
    • Priority: Major - P3
    • 1.46.9
    • Affects Version/s: None
    • Component/s: None
    • None
    • Not Needed
    • Developer Tools

      Will require additional investigation to figure out the scope of work.

      Use the defined eval cases to create automated tests to ensure

      1. Assistant can handle different kinds of prompts.
      2. Our hardcoded prompts for UI entry points provide meaningful explanations.

       

        1. video1994186268.mp4
          56.98 MB

            Assignee:
            Le Roux Bodenstein
            Reporter:
            Gagik Amaryan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: