Unskip Atlas-Local rerank capability

ExportXMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Minor - P4
    • None
    • Affects Version/s: None
    • Component/s: ABX, ai-ml-testing, AI/ML
    • None
    • Python Drivers
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      Context

      Affected frameworks (scoped to the ai-ml-pipeline-testing pipeline only)

      Of the 17 integrations exercised by ai-ml-pipeline-testing, only the following have $rerank tests that are skipped on local / atlas-local:

      Pipeline task Upstream repo Test file Skip condition
      langchain-python langchain-ai/langchain-mongodb libs/langchain-mongodb/tests/integration_tests/test_rerank.py pytest.mark.skipif when MONGODB_URI contains localhost / 127.0.0.1
      langgraph-store-python langchain-ai/langchain-mongodb libs/langgraph-store-mongodb/tests/integration_tests/test_store_rerank.py pytest.mark.skipif(_is_local), same host check; carries a TODO to remove once $rerank is GA
      langchain-js langchain-ai/langchainjs libs/providers/langchain-mongodb/src/tests/vectorstores_rerank.int.test.ts describe.skipIf(isUsingLocalAtlas()), true when URI is not mongodb+srv://

      No $rerank tests exist in the other pipeline integrations (langgraph-python, llama-index, haystack-embeddings, haystack-fulltext, semantic-kernel-python, semantic-kernel-csharp, docarray, crewai-tools, mem0-python, pymongo-search-utils, pymongo-voyageai, langchaingo-golang, n8n-js, chatgpt-retrieval-plugin), so nothing to unskip there. Note: the langchain-js skip also gates the auto-embed rerank suite on a Voyage AI API key being present.

      Definition of done

      Unskip all those tests

      Pitfalls

      Is there an upstream ticket?

            Assignee:
            Unassigned
            Reporter:
            Casey Clements
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: