[SERVER-58578] Implement bucket compression as rewrite when bucket is closed Created: 15/Jul/21  Updated: 29/Oct/23  Resolved: 16/Sep/21

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 5.1.0-rc0

Type: Task Priority: Major - P3
Reporter: Henrik Edin Assignee: Henrik Edin
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Documented
is documented by DOCS-14799 [SERVER] Investigate changes in SERVE... Closed
Backwards Compatibility: Fully Compatible
Sprint: Execution Team 2021-09-06, Execution Team 2021-09-20
Participants:

 Description   

Update the BucketCatalog to return the ObjectId of a closed bucket.

In a separate storage transaction read in the full uncompressed bucket, sort all the measurements on time and write back the bucket as the compressed v2 format.



 Comments   
Comment by Vivian Ge (Inactive) [ 06/Oct/21 ]

Updating the fixversion since branching activities occurred yesterday. This ticket will be in rc0 when it’s been triggered. For more active release information, please keep an eye on #server-release. Thank you!

Comment by Githook User [ 21/Sep/21 ]

Author:

{'name': 'Henrik Edin', 'email': 'henrik.edin@mongodb.com', 'username': 'henrikedin'}

Message: SERVER-58578 Timeseries bucket compression

Add case for new transform update type in query analysis
Branch: SERVER-58852
https://github.com/10gen/mongo-enterprise-modules/commit/a51c6d05389f1bbd35195a8a7ed47f2bfd92800a

Comment by Githook User [ 16/Sep/21 ]

Author:

{'name': 'Henrik Edin', 'email': 'henrik.edin@mongodb.com', 'username': 'henrikedin'}

Message: SERVER-58578 Timeseries bucket compression

All fields under data will be compressed using BSON Binary Subtype 7.
Measurements are sorted by time field.

Buckets are compressed in a separate update operation when the
BucketCatalog is closing the bucket and no further writes to it will be
performed.

Compression operation are transparant for the user, if it fails for any
reason the bucket will be left uncompressed.
Branch: master
https://github.com/mongodb/mongo/commit/a7001db2c3a43c6632904a7a4c34f4d99a61d295

Comment by Githook User [ 16/Sep/21 ]

Author:

{'name': 'Henrik Edin', 'email': 'henrik.edin@mongodb.com', 'username': 'henrikedin'}

Message: SERVER-58578 Timeseries bucket compression

Add case for new transform update type in query analysis
Branch: master
https://github.com/10gen/mongo-enterprise-modules/commit/a51c6d05389f1bbd35195a8a7ed47f2bfd92800a

Comment by Henrik Edin [ 02/Aug/21 ]

It may make sense to split this up in two tickets. It also need to be guarded with the feature flag.

Generated at Thu Feb 08 05:44:54 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.