Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-2992

Speed up importing csv files with mongoimport

    XMLWordPrintable

Details

    • Investigation
    • Status: Accepted
    • Major - P3
    • Resolution: Unresolved
    • None
    • None
    • mongoimport
    • None

    Description

      Importing a CSV file with mongoimport is very slow, processing at around 4 MB/sec.
      The database is capable of more than 400 MB/sec. Parsing CSV files should be possible even faster than that. Using multiple threads is not really a solution as it is often desirable to maintain insert order, and it also should be independent of making the single-threaded case perform reasonably well.

      Attachments

        Activity

          People

            backlog-enterprise-tools Backlog - Enterprise Tools
            geert.bosch@mongodb.com Geert Bosch
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: