[ai-ml-testing-pipeline] Landscaping Part 2

ExportXMLWordPrintableJSON

    • Type: Epic
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: ABX
    • AI/ML Testing Pipeline Landscaping Part 2
    • Python Drivers
    • None
    • Hide
      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?
      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • To Do
    • 0
    • 0
    • 0
    • 100
    • None
    • None
    • None
    • 1
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Context

      The Integrations CI has been allowed to fail for a while and needs to be tended to.

      Definition of done

      ALL GREEN

      Pitfalls

      Flaky tests.

      Categories

      Failing because of Voyage API key

      1. LangChainJS: "failed:d" / "Provided API key isinvalid"
      2. PyMongo-VoyageAI Tester valid.

      MongoDB Community

      1. LangChainPy
      2. LangGraph-store
      3. pymongo-search-utils{
        # Self Test Ubuntu

      Consistently failing

      1. LangChainGo: Error connecting to Search Index Management service. (Key issue?)
      2. Haystack (both variants): ModuleNotFoundError: No module named 'certifi'. Weird — didthis ever pass?

      Failing on remote only

      1. LangChainPython — need a repro

      Semantic Kernel — passing in Python, failing in C#

      1. Config failure.

            Assignee:
            Casey Clements
            Reporter:
            Casey Clements
            None
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              1 week, 1 day
              None
              None
              None