Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-1668

Support wire protocol compression in mongodump and mongorestore

    XMLWordPrintableJSON

Details

    • Needed
    • Notes would need to be added to reflect this new functionality

    Description

      I would like to request the addition of wire protocol compression for mongodump and mongorestore.

      As these tools generally dump/import massive amounts of data (usually the whole server dataset) there is a lot to be gained by implementing this compression.

      A real world example: when using mongodump on a very large dataset my host seems to be bottlenecked by the network throughput required to move the uncompressed messages. Both the server and client running mongodump could move more data if it wasn't for the network congestion. The data set in question should compress to about 25% of the current throughput or less with snappy, which would mitigate this problem massively.

      Attachments

        Issue Links

          Activity

            People

              david.golden@mongodb.com David Golden
              tvaillancourt Tim Vaillancourt
              Votes:
              8 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: