[SERVER-1220] mongoimport support for quietly ignoring duplicates Created: 11/Jun/10  Updated: 04/Jul/10  Resolved: 11/Jun/10

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Minor - P4
Reporter: Tomasz Wegrzanowski Assignee: Eliot Horowitz (Inactive)
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Participants:

 Description   

If mongoinsert is used to bulk import large number of records, with intention that those with _id already present should be ignored, it works except that server logs are flooded with a large number of "E11000 duplicate key error index" messages. My mongo.log is currently 15GB, mostly of those.

It would be nice to be able to tell mongoimport that it doesn't need to be concerned about duplicates.



 Comments   
Comment by Eliot Horowitz (Inactive) [ 11/Jun/10 ]

yes.

if you want an ignore option we would have to add one to the server.
if you require that - you should open a case to add that feature to the server

Comment by Tomasz Wegrzanowski [ 11/Jun/10 ]

Wouldn't that be insert-or-update instead of insert-or-ignore?

Comment by Eliot Horowitz (Inactive) [ 11/Jun/10 ]

in 1.5.x you can --upsert

Generated at Thu Feb 08 02:56:25 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.