We currently have fault injection testing that isn't currently running in our CI tool, and a filesystem implementation aimed for testing.

Neither of those are giving us good coverage of system behavior when write operations fail. It would be interesting to see if we can implement a more targeted version of the fault injection tests - that just simulates occasional write failures.