[SERVER-79415] Migrate time-series operations to use the compression state Created: 27/Jul/23 Updated: 09/Jan/24 |
|
| Status: | Open |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Gregory Wlodarek | Assignee: | Backlog - Storage Execution Team |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Assigned Teams: |
Storage Execution
|
| Participants: |
| Description |
|
This work will start removing some of the unoptimized POC work. If the work to support multiple open buckets per metadata is not yet complete, we'll need to close buckets prematurely when an incoming eligible measurements time is less than the bucket's last measurements time. This is to maintain the sorted order by the time column, as we can only append to the compression state. Buckets will get closed today when they encounter a write conflict, or any write error. So we don't need to build anything to get back to the original compressor state if the write rolls back. |
| Comments |
| Comment by Gregory Wlodarek [ 13/Dec/23 ] |
|
The work here will continue to use transform-style updates on the primary. This will change in SERVER-79416 to also apply the DocDiff on the primary, not just the secondaries. |