Uploaded image for project: 'MongoDB ETL Tools'
  1. MongoDB ETL Tools
  2. TOOLS-61

mongoimport tab-delimited files retains quotes and ignores escaped tabs

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Works as Designed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: mongoimport
    • Labels:
      None
    • Environment:
      CentOS 5.5

      Description

      It seems to me that tab-delimited fields should operate the same as comma-delimited fields, where begin and end quotes are ignored, and escaped tabs or tabs embedded within double quotes are retained correctly.

      $ cat blah.tsv
      1<tab>"This sentence is quoted"
      2<tab>This sentence\<tab>has a tab in it
      3<tab>"So does this<tab>sentence"

      $ mongoimport --db blah -c blah --file blah.tsv --fields a,b --type tsv --drop -vvv
      Mon Feb 21 22:47:05 creating new connection to:127.0.0.1
      connected to: 127.0.0.1
      Mon Feb 21 22:47:05 ns: blah.blah
      dropping: blah.blah
      Mon Feb 21 22:47:05 filesize: 87
      Mon Feb 21 22:47:05 got line:1 "This sentence is quoted"
      Mon Feb 21 22:47:05 got line:2 This sentence\ has a tab in it
      Mon Feb 21 22:47:05 got line:3 "So does this sentence"
      Mon Feb 21 22:47:05 got line:
      imported 3 objects

      $ mongo blah
      MongoDB shell version: 1.6.5
      connecting to: blah
      > db.blah.find()

      { "_id" : ObjectId("4d62eb6b76a8a7bc009e7846"), "a" : 1, "b" : "\"This sentence is quoted\"" } { "_id" : ObjectId("4d62eb6b76a8a7bc009e7847"), "a" : 2, "b" : "This sentence\\", "field2" : "has a tab in it" } { "_id" : ObjectId("4d62eb6b76a8a7bc009e7848"), "a" : 3, "b" : "\"So does this", "field2" : "sentence\"" }

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                backlog-server-platform Backlog - Platform Team
                Reporter:
                ian.whalen Ian Whalen
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: