Make pyarrow errors more obvious

XMLWordPrintableJSON

    • None
    • Python Drivers
    • Not Needed
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      Via https://www.mongodb.com/community/forums/t/pymongoarrow-data-loss/298793/5?u=alex_clark

       
       
      Steve_Silvester[MongoDB Employee|https://www.mongodb.com/community/forums/g/Employees]
      2d
       
      Hi @Leonid_Posadskov, that error most likely means that you have run out of memory in the memory pool that PyArrow uses to store the data. We are going to make the error more obvious in the next release. For now, I would suggest adding filters to limit the number of matching documents and break up your queries.
       

              Assignee:
              Steve Silvester
              Reporter:
              Alex Clark
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: