[SERVER-56508] Ability to customize Zstandard compression level Created: 30/Apr/21  Updated: 29/Oct/23  Resolved: 18/Jun/21

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 5.0.0-rc3, 5.1.0-rc0

Type: Task Priority: Major - P3
Reporter: Vamsi Boyapati Assignee: Monica Ng
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
Documented
is documented by DOCS-14580 Investigate changes in SERVER-56508: ... Closed
Duplicate
duplicates SERVER-45690 Ability to customize collection compr... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v5.0
Sprint: Storage - Ra 2021-05-17, Storage - Ra 2021-06-28
Participants:
Story Points: 5

 Description   

At the moment, the compression level for zstd is hardcoded to 6.

This work is to allow customers to tune the compression level for zstd through configuration. 

Configuring the compression level for zstd is independent of whether zstd is configured as default log compressor or default block compressor. 

 



 Comments   
Comment by Vivian Ge (Inactive) [ 06/Oct/21 ]

Updating the fixversion since branching activities occurred yesterday. This ticket will be in rc0 when it’s been triggered. For more active release information, please keep an eye on #server-release. Thank you!

Comment by Githook User [ 18/Jun/21 ]

Author:

{'name': 'Monica Ng', 'email': 'monica.ng@mongodb.com', 'username': 'mm-ng'}

Message: SERVER-56508 Update Compressor Levels

(cherry picked from commit 6128447d75f9623d122f87137646788241c63a3b)
Branch: v5.0
https://github.com/mongodb/mongo/commit/41cf21296e9800cbaaedb566d16476821e663467

Comment by Louis Williams [ 17/Jun/21 ]

I see, thanks for the explanation, brian.lane!

Comment by Brian Lane [ 16/Jun/21 ]

Hey louis.williams, we haven't exposed --fast or checked to see if have a negative level had any impact/improvement.  So I thought it was better to limit it from the option with perhaps in the future expanding on it with 5.1 as opposed to the opposite of trying to limit it after the fact.  

Comment by Louis Williams [ 16/Jun/21 ]

vamsi.krishna and brian.lane, why are we prohibiting the use of negative compression levels for zstd? From https://facebook.github.io/zstd/

The negative compression levels, specified with --fast=#, offer faster compression and decompression speed in exchange for some loss in compression ratio compared to level 1, as seen in the table above.

Comment by Githook User [ 16/Jun/21 ]

Author:

{'name': 'Monica Ng', 'email': 'monica.ng@mongodb.com', 'username': 'mm-ng'}

Message: SERVER-56508 Update Compressor Levels
Branch: SERVER-34632
https://github.com/mongodb/mongo/commit/6128447d75f9623d122f87137646788241c63a3b

Comment by Githook User [ 16/Jun/21 ]

Author:

{'name': 'Monica Ng', 'email': 'monica.ng@mongodb.com', 'username': 'mm-ng'}

Message: SERVER-56508 Update Compressor Levels
Branch: master
https://github.com/mongodb/mongo/commit/6128447d75f9623d122f87137646788241c63a3b

Comment by Githook User [ 14/May/21 ]

Author:

{'name': 'Monica Ng', 'email': 'monica.ng@mongodb.com', 'username': 'mm-ng'}

Message: SERVER-56508 Ability to customise Zstandard compression level

SERVER-56508 Ability to customise Zstandard compression level
Branch: master
https://github.com/mongodb/mongo/commit/310b02cfa32df40d2c31d9f8c5852ae2e66b7d1e

Generated at Thu Feb 08 05:39:27 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.