Uploaded image for project: 'MongoDB ETL Tools'
  1. MongoDB ETL Tools
  2. TOOLS-1668

Support wire protocol compression in mongodump and mongorestore

    XMLWordPrintable

    Details

    • Documentation Changes:
      Needed

      Description

      I would like to request the addition of wire protocol compression for mongodump and mongorestore.

      As these tools generally dump/import massive amounts of data (usually the whole server dataset) there is a lot to be gained by implementing this compression.

      A real world example: when using mongodump on a very large dataset my host seems to be bottlenecked by the network throughput required to move the uncompressed messages. Both the server and client running mongodump could move more data if it wasn't for the network congestion. The data set in question should compress to about 25% of the current throughput or less with snappy, which would mitigate this problem massively.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                david.golden David Golden
                Reporter:
                tvaillancourt Tim Vaillancourt
              • Votes:
                8 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: