[SERVER-42132] Mongodump for oplog backup runs long Created: 10/Jul/19  Updated: 16/Nov/21  Resolved: 16/Jul/19

Status: Closed
Project: Core Server
Component/s: Admin
Affects Version/s: 4.0.8
Fix Version/s: None

Type: Question Priority: Major - P3
Reporter: Tanveer Madan Marate Assignee: Eric Sedor
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Participants:

 Description   

Hi,

For PITR we are taking oplog backup every one hour
The oplog is around 200GB and the backups run for almost 1.5hours
Is there a way we can speed the mongodump

{
        "ns" : "local.oplog.rs",
        "size" : 213203044962,
        "count" : 1265327007,
        "avgObjSize" : 168,
        "storageSize" : 37790625792,
        "capped" : true,

Thanks,
Tanveer



 Comments   
Comment by Eric Sedor [ 16/Jul/19 ]

My pleasure tanveermadan; Be well!

Comment by Tanveer Madan Marate [ 11/Jul/19 ]

Thanks Joseph !!!

 

Comment by Eric Sedor [ 11/Jul/19 ]

tanveermadan,

An option like numParallelCollections may or may not help. Mongodump is also not necessarily the best backup method for large quantities of data, and hardware will play a role as well.

That said, the SERVER project is for bugs and feature suggestions for the MongoDB server. For assistance troubleshooting this matter, I encourage you to ask our community by posting on the mongodb-user group or on Stack Overflow with the mongodb tag. In the event you have reason to suspect a bug, we would examine this issue here.

Does this make sense?

Generated at Thu Feb 08 04:59:40 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.