[LangChain] Flaky integration tests in GraphRag

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Duplicate
    • Priority: Unknown
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Python Drivers
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      FAILED tests/integration_tests/test_graphrag.py::test_extract_entity_names - AssertionError: assert set() ==

      {'Jane Smith', 'John Doe'}

      FAILED tests/integration_tests/test_graphrag.py::test_similarity_search - assert 0 >= 4

      Both tests are using the default "flaky" decorator, which allows for one failure, we may need to update to allow passing 3 out of 5 times, e.g. flaky(max_runs=5, min_passes=3).

      https://spruce.mongodb.com/task/ai_ml_pipeline_testing_test_langchain_python_rhel_test_langchain_python_local_683ce5ff942b9f00079b317f_25_06_01_23_45_03/logs?execution=0

            Assignee:
            Casey Clements
            Reporter:
            Steve Silvester
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: