[ai-ml-testing-pipeline] Landscaping

ExportXMLWordPrintableJSON

    • Type: Epic
    • Resolution: Unresolved
    • Priority: Critical - P2
    • None
    • Affects Version/s: None
    • Component/s: ABX
    • AI/ML Testing Pipeline Landscaping
    • Python Drivers
    • Not Needed
    • In Progress
    • 0
    • 0
    • 0
    • 100
    • None
    • None
    • None
    • 1
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Context

      The Integrations CI has been allowed to fail for a while and needs to be tended to.

      Definition of done

      ALL GREEN

      Pitfalls

      Flaky tests.

      Categories

      Failing because of Voyage API key

      1. LangChainJS: "failed:d" / "Provided API key isinvalid"
      2. PyMongo-VoyageAI Tester valid.

      MongoDB Community

      1. LangChainPy
      2. LangGraph-store
      3. pymongo-search-utils{
        # Self Test Ubuntu

      Consistently failing

      1. LangChainGo: Error connecting to Search Index Management service. (Key issue?)
      2. Haystack (both variants): ModuleNotFoundError: No module named 'certifi'. Weird — didthis ever pass?

      Failing on remote only

      1. LangChainPython — need a repro

      Semantic Kernel — passing in Python, failing in C#

      1. Config failure.

            Assignee:
            Casey Clements
            Reporter:
            Casey Clements
            None
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              None
              None
              None