[SERVER-58578] Implement bucket compression as rewrite when bucket is closed Created: 15/Jul/21 Updated: 29/Oct/23 Resolved: 16/Sep/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | 5.1.0-rc0 |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Henrik Edin | Assignee: | Henrik Edin |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||
| Sprint: | Execution Team 2021-09-06, Execution Team 2021-09-20 | ||||||||||||
| Participants: | |||||||||||||
| Description |
|
Update the BucketCatalog to return the ObjectId of a closed bucket. In a separate storage transaction read in the full uncompressed bucket, sort all the measurements on time and write back the bucket as the compressed v2 format. |
| Comments |
| Comment by Vivian Ge (Inactive) [ 06/Oct/21 ] |
|
Updating the fixversion since branching activities occurred yesterday. This ticket will be in rc0 when it’s been triggered. For more active release information, please keep an eye on #server-release. Thank you! |
| Comment by Githook User [ 21/Sep/21 ] |
|
Author: {'name': 'Henrik Edin', 'email': 'henrik.edin@mongodb.com', 'username': 'henrikedin'}Message: Add case for new transform update type in query analysis |
| Comment by Githook User [ 16/Sep/21 ] |
|
Author: {'name': 'Henrik Edin', 'email': 'henrik.edin@mongodb.com', 'username': 'henrikedin'}Message: All fields under data will be compressed using BSON Binary Subtype 7. Buckets are compressed in a separate update operation when the Compression operation are transparant for the user, if it fails for any |
| Comment by Githook User [ 16/Sep/21 ] |
|
Author: {'name': 'Henrik Edin', 'email': 'henrik.edin@mongodb.com', 'username': 'henrikedin'}Message: Add case for new transform update type in query analysis |
| Comment by Henrik Edin [ 02/Aug/21 ] |
|
It may make sense to split this up in two tickets. It also need to be guarded with the feature flag. |