[ai-ml-testing-pipeline] Landscaping

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Unknown
    • None
    • Affects Version/s: None
    • Component/s: ABX
    • None
    • None
    • Python Drivers
    • None
    • None
    • None
    • None
    • None
    • None

      Context

      The Integrations CI has been allowed to fail for a while and needs to be tended to.

      Definition of done

      *ALL GREEN*
      h3. Pitfalls

      Flaky tests.

       

      Categories

      Failing because of Voyage API key

      1. LangChainJS: "failed: port is already allocated "Provided API key is invalid"
      2. PyMongo-VoyageAI Tests: The API key is no longer valid.

      3. Consistently failing

      4. Community Tests. They appear in LangChainPy, LangGraph-store, and pymongo-search-utils, and Self Test Ubuntu
      5. LangChainGo: Error connecting to Search Index Management service. (Key issue?)
      6. Haystack (Both variants) (ModuleNotFoundError: No module named 'certifi') weird. did this ever pass?

      Failing on remote only

      1. LangChainPython - need a repro

      Semantic Kernel - passing in Python. Failing in C#

      1. Config failure.

       

            Assignee:
            Unassigned
            Reporter:
            Casey Clements
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: