-
Type: New Feature
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: Filesystem API
-
Storage Engines
-
5
-
StorEng - 2024-12-10, StorEng - 2024-12-24
The Live WT restore functionality depends on having a background thread/s that migrates data across in the background.
At this stage the planned algorithm is:
- For every file in WiredTiger.backup that is not metadata.
- Find the extent lists for the file. (How?)
- For every hole in the extents for that file, read from source and write to destination
There are a few problems that haven't been solved yet:
- Given WiredTiger owns the file handle how do we access it's extents?
- How do we deal with concurrent schema operations?
- Concurrent access to the extent list needs locking.
- How to scale threads reasonably?
Given that the problem space is still largely unexplored the scope of this ticket will be to:
- On intialization of the Union FS create a WT thread group
- In the thread run body find a method to access the file handles that are open in WT.
- is depended on by
-
WT-13825 Implement concurrency control for live restore
- In Progress