[SERVER-79415] Migrate time-series operations to use the compression state Created: 27/Jul/23  Updated: 09/Jan/24

Status: Open
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Gregory Wlodarek Assignee: Backlog - Storage Execution Team
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Assigned Teams:
Storage Execution
Participants:

 Description   

This work will start removing some of the unoptimized POC work.

If the work to support multiple open buckets per metadata is not yet complete, we'll need to close buckets prematurely when an incoming eligible measurements time is less than the bucket's last measurements time. This is to maintain the sorted order by the time column, as we can only append to the compression state.

Buckets will get closed today when they encounter a write conflict, or any write error. So we don't need to build anything to get back to the original compressor state if the write rolls back.



 Comments   
Comment by Gregory Wlodarek [ 13/Dec/23 ]

The work here will continue to use transform-style updates on the primary. This will change in SERVER-79416 to also apply the DocDiff on the primary, not just the secondaries.

Generated at Thu Feb 08 06:40:55 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.