Uploaded image for project: 'Python Integrations'
  1. Python Integrations
  2. INTPYTHON-372

Langchain PY: Improve the insert performance through batching and async

XMLWordPrintableJSON

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Unknown Unknown
    • None
    • Affects Version/s: None
    • Component/s: AI/ML, LangChain
    • None
    • None
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

       

      We are currently doing single inserts into mongoDB using pymongo, doing those inserts in batch (or doing async with the other driver we have) will significantly improve performance

      A similar exercise was covered by Pinecone in their blog (https://www.pinecone.io/blog/langchain-pinecone-upsert-faster)

       

       

            Assignee:
            jib.adegunloye@mongodb.com Jib Adegunloye
            Reporter:
            prakul.agarwal@mongodb.com Prakul Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              None
              None
              None
              None