-
Type:
Build Failure
-
Resolution: Done
-
Priority:
Unknown
-
None
-
Affects Version/s: None
-
Component/s: ai-ml-testing, llama-index
-
None
-
None
-
Python Drivers
-
Not Needed
-
-
None
-
None
-
None
-
None
-
None
-
None
We seeing consistent failures with test-llama-index-local.
[2024/12/12 08:35:43.348] =================================== FAILURES =================================== [2024/12/12 08:35:43.348] ________________________________ test_documents ________________________________ [2024/12/12 08:35:43.348] documents = [Document(id_='413a76b9-56c7-445e-bd1b-0dbe64f40958', embedding=None, metadata={'text': ''}, excluded_embed_metadata_k...n', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), ...] [2024/12/12 08:35:43.348] def test_documents(documents: List[Document]) -> None: [2024/12/12 08:35:43.348] """Sanity check essay was found and documents loaded.""" [2024/12/12 08:35:43.348] > assert len(documents) == 23 [2024/12/12 08:35:43.348] E AssertionError: assert 25 == 23 [2024/12/12 08:35:43.348] E + where 25 = len([Document(id_='413a76b9-56c7-445e-bd1b-0dbe64f40958', embedding=None, metadata={'text': ''}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='873295be-22fa-4a5a-bb21-d153637f81da', embedding=None, metadata={'text': 'Context'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='Context', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='38407a9e-f821-40dd-979d-b6f8a8bf05b0', embedding=None, metadata={'text': 'LLMs are a phenomenal piece of technology for knowledge generation and reasoning.'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='LLMs are a phenomenal piece of technology for knowledge generation and reasoning.', mimetype='text/plain'...mounts of publicly available data.', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='b9a482ac-5891-4faa-84fe-e8733ac67fc4', embedding=None, metadata={'text': 'How do we best augment LLMs with our own private data?'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='How do we best augment LLMs with our own private data?', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), Document(id_='1395d2e0-0fc5-424e-8c00-b8dfcabd667c', embedding=None, metadata={'text': 'We need a comprehensive toolkit to help perform this data augmentation for LLMs.'}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, metadata_template='{key}: {value}', metadata_separator='\n', text='We need a comprehensive toolkit to help perform this data augmentation for LLMs.', mimetype='text/plain', start_char_idx=None, end_char_idx=None, metadata_seperator='\n', text_template='{metadata_str}\n\n{content}'), ...]) [2024/12/12 08:35:43.348] tests/test_vectorstore.py:23: AssertionError