Add evals for schema optimization

XMLWordPrintableJSON

    • Type: Story
    • Resolution: Done
    • Priority: Major - P3
    • No Version
    • Affects Version/s: None
    • Component/s: None
    • None
    • Not Needed
    • Developer Tools

      Related to MCP-457, let's add eval cases for optimization / troubleshooting of an existing schema. These evals will need some initial setups that are to be evaluated (only evaluated and improvements proposed, making actual changes is out of scope). Similarly to MCP-457, let's use the results of user research to guide these examples.

      Subsequently, let's evaluate the performance of the current skill with these evals. Those that are already passing can be commited, the rest we can use to evaluate the upcoming work.

            Assignee:
            Unassigned
            Reporter:
            Paula Stachova
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: