Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-71

Refactor mongoimport to read in batches

    XMLWordPrintableJSON

Details

    • Icon: Task Task
    • Resolution: Done
    • Icon: Trivial - P5 Trivial - P5
    • 2.8.0-rc0
    • None
    • mongoimport
    • None

    Description

      mongoimport currently reads json, csv, and tsv files line-by-line. This leads to many small reads and thus poor performance when importing large amounts of data. The tool should be refactored to read large chunks of input and then process these large chunks line-by-line.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ian@mongodb.com Ian Whalen (Inactive)
            Votes:
            2 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: