Refactor mongoimport to read in batches

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Done
    • Priority: Trivial - P5
    • 2.8.0-rc0
    • Affects Version/s: None
    • Component/s: mongoimport
    • None

      mongoimport currently reads json, csv, and tsv files line-by-line. This leads to many small reads and thus poor performance when importing large amounts of data. The tool should be refactored to read large chunks of input and then process these large chunks line-by-line.

            Assignee:
            Unassigned
            Reporter:
            Ian Whalen (Inactive)
            Votes:
            2 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: