[ai-ml-testing-pipeline] Landscaping

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Duplicate
    • Priority: Unknown
    • None
    • Affects Version/s: None
    • Component/s: ABX
    • None
    • None
    • Python Drivers
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      Context

      The Integrations CI has been allowed to fail for a while and needs to be tended to.

      Definition of done

      *ALL GREEN*
      h3. Pitfalls

      Flaky tests.

       

      Categories

      Failing because of Voyage API key

      1. LangChainJS: "failed: port is already allocated "Provided API key is invalid"
      2. PyMongo-VoyageAI Tests: The API key is no longer valid.

      MongoDB Community

      1. LangChainPy
      2. LangGraph-store
      3. pymongo-search-utils
      4. Self Test Ubuntu

      Consistently failing

      1. LangChainGo: Error connecting to Search Index Management service. (Key issue?)
      2. Haystack (Both variants) (ModuleNotFoundError: No module named 'certifi') weird. did this ever pass?

      Failing on remote only

      1. LangChainPython - need a repro

      Semantic Kernel - passing in Python. Failing in C#

      1. Config failure.

       

            Assignee:
            Casey Clements
            Reporter:
            Casey Clements
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: