Uploaded image for project: 'MongoDB ETL Tools'
  1. MongoDB ETL Tools
  2. TOOLS-1047

mongoimport progress not accurate

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor - P4
    • Resolution: Fixed
    • Affects Version/s: 3.2.0-rc5
    • Fix Version/s: 3.2.7, 3.3.11
    • Component/s: None
    • Environment:
      4.3.3-2-ARCH #1 SMP PREEMPT Wed Dec 23 20:09:18 CET 2015 x86_64 GNU/Linux
    • Backport Requested:
      v3.2

      Description

      When importing a tsv file using this command:

      mongoimport --db gnis --collection GNIS --type tsv --headerline --verbose --file NationalFile.tab

      This is the output:

      2016-01-21T10:18:22.795-0600	filesize: 309415377 bytes
      2016-01-21T10:18:22.797-0600	using fields: ´╗┐FEATURE_ID,FEATURE_NAME,FEATURE_CLASS,STATE_ALPHA,STATE_NUMERIC,COUNTY_NAME,COUNTY_NUMERIC,PRIMARY_LAT_DMS,PRIM_LONG_DMS,PRIM_LAT_DEC,PRIM_LONG_DEC,SOURCE_LAT_DMS,SOURCE_LONG_DMS,SOURCE_LAT_DEC,SOURCE_LONG_DEC,ELEV_IN_M,ELEV_IN_FT,MAP_NAME,DATE_CREATED,DATE_EDITED
      2016-01-21T10:18:22.838-0600	connected to: localhost
      2016-01-21T10:18:22.838-0600	ns: gnis.GNIS
      2016-01-21T10:18:22.838-0600	connected to node type: standalone
      2016-01-21T10:18:22.841-0600	using write concern: w='1', j=false, fsync=false, wtimeout=0
      2016-01-21T10:18:22.848-0600	using write concern: w='1', j=false, fsync=false, wtimeout=0
      2016-01-21T10:18:25.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:28.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:31.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:34.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:37.799-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:40.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:43.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:46.801-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:49.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:52.800-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:55.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:18:58.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:01.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:04.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:07.799-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:10.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:13.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:16.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:19.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:22.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:25.803-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:28.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:31.800-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:34.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:37.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:40.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:43.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:46.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:49.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:52.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:55.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:19:58.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:01.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:04.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:07.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:10.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:13.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:16.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:19.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:22.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:25.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:28.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:31.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:34.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:37.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:40.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:43.808-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:46.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:49.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:52.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:55.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:20:58.800-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:21:01.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:21:04.798-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:21:05.354-0600	[........................] gnis.GNIS	0.0 B/295.1 MB (0.0%)
      2016-01-21T10:21:05.354-0600	imported 0 documents
      

      The file is imported fine, the DB is created and the imported collection contains the 2267902 rows from the import tsv file

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zach.snow Zach Snow
                Reporter:
                nik.martin Nik Martin
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: