Uploaded image for project: 'Compass '
  1. Compass
  2. COMPASS-8027

Update mms evergreen config to cron run the AI accuracy tests

    • Type: Icon: Task Task
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • No version
    • Affects Version/s: None
    • Component/s: GAI
    • None
    • 3
    • Iteration Earth (Jun 17-Jul 1), Iteration Fortitudo, Iteration Hippocamp
    • Not Needed
    • Developer Tools

      In CLOUDP-256916 we move the generative AI accuracy tests to from Compass mms. These will be run manually for now. This ticket involves updating the existing evergreen project for running the ai tests:
      https://spruce.mongodb.com/commits/compass-generative-ai-accuracy 
      Or creating a new evergreen project to run these tests daily. Let's keep up the same configurations that the existing test runner does: posting to slack and mongodb.

       

      Once this is done and works, remove the existing ai test code from Compass and update any parts of Compass that were exported for it to not export anymore.

            Assignee:
            Unassigned Unassigned
            Reporter:
            rhys.howell@mongodb.com Rhys Howell
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: