-
Type: Task
-
Resolution: Duplicate
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: mongodump, mongorestore
-
Needed
-
Notes would need to be added to reflect this new functionality
I would like to request the addition of wire protocol compression for mongodump and mongorestore.
As these tools generally dump/import massive amounts of data (usually the whole server dataset) there is a lot to be gained by implementing this compression.
A real world example: when using mongodump on a very large dataset my host seems to be bottlenecked by the network throughput required to move the uncompressed messages. Both the server and client running mongodump could move more data if it wasn't for the network congestion. The data set in question should compress to about 25% of the current throughput or less with snappy, which would mitigate this problem massively.
- depends on
-
TOOLS-1833 Migrate tools (excluding mongoreplay) to new Go Driver
- Development Complete
- is duplicated by
-
TOOLS-1870 Network compression snappy, zlib - also for dump/restore and import/export tools
- Closed