Langchain PY: Improve the insert performance through batching and async

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Unknown
    • None
    • Affects Version/s: None
    • Component/s: AI/ML, LangChain
    • None
    • None
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

       

      We are currently doing single inserts into mongoDB using pymongo, doing those inserts in batch (or doing async with the other driver we have) will significantly improve performance

      A similar exercise was covered by Pinecone in their blog (https://www.pinecone.io/blog/langchain-pinecone-upsert-faster)

       

       

            Assignee:
            Jib Adegunloye
            Reporter:
            Prakul Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: