[COMPASS-3015] Compass CSV import is inserting empty documents Created: 25/Jul/18  Updated: 16/Aug/19  Resolved: 16/Aug/19

Status: Closed
Project: Compass
Component/s: Import/Export
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Jessica Sigafoos Assignee: Unassigned
Resolution: Won't Fix Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File DOB_Permit_Issuance-000.csv    
Issue Links:
Duplicate
Tested
tested by COMPASS-3824 Test behavior of new feature in relat... Closed

 Description   

Compass version 1.13.1

Customer reported that when importing a CSV file containing 200,000 records using Compass, the resulting collection contained 200,007 documents. Local testing has confirmed that while mongoimport consistently imports exactly 200,000 documents, Compass will insert a handful of additional documents. These documents are all empty, with empty string or null values on their attributes.

To reproduce:
See the attached CSV file for testing.

1. Open Compass and connect to an Atlas instance.
2. Create a new database and collection (I used "DOB" and "permit_issuance" for this, based on the CSV used).
3. Open the collection and click Collection->Import Data.
4. Choose CSV option and browse to the CSV file.
5. Initiate import.

Once the import is complete there should be more than 200,000 documents. The empty ones can be confirmed by filtering on

{ BOROUGH: "" }

This appears to be a bug in Compass, where it is creating additional documents for some reason.

Please let me know if you need anything else to reproduce this behavior.



 Comments   
Comment by Massimiliano Marcon [ 16/Aug/19 ]

We are reimplementing the import/export feature so we won't fix existing bugs. However, we will use existing bugs as a guideline for testing the new implementation.

Generated at Wed Feb 07 22:31:51 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.