[SERVER-31555] support zstd for network compression Created: 13/Oct/17  Updated: 30/Oct/23  Resolved: 16/Jan/19

Status: Closed
Project: Core Server
Component/s: Networking
Affects Version/s: None
Fix Version/s: 4.1.7

Type: New Feature Priority: Major - P3
Reporter: Mark Callaghan Assignee: Henrik Edin
Resolution: Fixed Votes: 2
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by DRIVERS-600 Add support for Zstandard compression Closed
Documented
is documented by DOCS-12373 Docs for SERVER-31555: support zstd f... Closed
Related
is related to SERVER-32595 LZ4 compression in MongoDB Closed
is related to SERVER-36352 enable zstd compression support in Mo... Closed
is related to SERVER-38168 Vendor Zstandard library Closed
is related to SERVER-56858 Change default order of network compr... Backlog
Backwards Compatibility: Fully Compatible
Sprint: Dev Tools 2018-12-31, Dev Tools 2019-01-14, Dev Tools 2019-02-11
Participants:
Case:

 Description   

from this I learn that zlib has been added as an option for --networkMessageCompressors. zstd uses much less CPU while matching zlib in compression rates. I hope you add it. Not only does this reduce server CPU but it also reduces latency in query responses. Using a DBMS not named MongoDB, switching from zlib to zstd for network compression was a huge win.

https://docs.mongodb.com/master/release-notes/3.6/
https://github.com/facebook/zstd



 Comments   
Comment by Henrik Edin [ 16/Jan/19 ]

SERVER-38168 Vendored in Zstandard and added a new message compressor using it. It is behind snappy but before zlib in preference. The driver work is tracked in DRIVERS-600 but zstd is available to use as the compression algorithm intra cluster. Closing this ticket as Fixed.

Generated at Thu Feb 08 04:27:26 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.