Uploaded image for project: 'Python Integrations'
  1. Python Integrations
  2. INTPYTHON-450

[Build Failure] test-llama-index-local

    • Type: Icon: Build Failure Build Failure
    • Resolution: Done
    • Priority: Icon: Unknown Unknown
    • None
    • Affects Version/s: None
    • Component/s: ai-ml-testing, llama-index
    • None
    • None
    • Python Drivers
    • Not Needed
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      https://spruce.mongodb.com/task/ai_ml_pipeline_testing_test_llama_index_vectorstore_rhel_test_llama_index_local_675a23fd12070100073db443_24_12_11_23_45_01/logs?execution=1

      We seeing consistent failures with test-llama-index-local.

      [2024/12/12 08:35:43.348] =================================== FAILURES ===================================
      [2024/12/12 08:35:43.348] ________________________________ test_documents ________________________________
      [2024/12/12 08:35:43.348] documents = [Document(id_='413a76b9-56c7-445e-bd1b-0dbe64f40958', embedding=None, metadata={'text': ''}, excluded_embed_metadata_k...n', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), ...]
      [2024/12/12 08:35:43.348]     def test_documents(documents: List[Document]) -> None:
      [2024/12/12 08:35:43.348]         """Sanity check essay was found and documents loaded."""
      [2024/12/12 08:35:43.348] >       assert len(documents) == 23
      [2024/12/12 08:35:43.348] E       AssertionError: assert 25 == 23
      [2024/12/12 08:35:43.348] E        +  where 25 = len([Document(id_='413a76b9-56c7-445e-bd1b-0dbe64f40958', embedding=None, metadata={'text': ''}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='873295be-22fa-4a5a-bb21-d153637f81da', embedding=None, metadata={'text': 'Context'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='Context', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='38407a9e-f821-40dd-979d-b6f8a8bf05b0', embedding=None, metadata={'text': 'LLMs are a phenomenal piece of technology for knowledge generation and reasoning.'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='LLMs are a phenomenal piece of technology for knowledge generation and reasoning.', mimetype='text/plain'...mounts of publicly available data.', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='b9a482ac-5891-4faa-84fe-e8733ac67fc4', embedding=None, metadata={'text': 'How do we best augment LLMs with our own private data?'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='How do we best augment LLMs with our own private data?', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='1395d2e0-0fc5-424e-8c00-b8dfcabd667c', embedding=None, metadata={'text': 'We need a comprehensive toolkit to help perform this data augmentation for LLMs.'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='We need a comprehensive toolkit to help perform this data augmentation for LLMs.', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), ...])
      [2024/12/12 08:35:43.348] tests/test_vectorstore.py:23: AssertionError
      

            Assignee:
            steve.silvester@mongodb.com Steve Silvester
            Reporter:
            steve.silvester@mongodb.com Steve Silvester
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved:
              None
              None
              None
              None