We should create test infrastructure to check file format compatibility between versions.

Berkeley DB did it by saving every a copy of every file created by the test suite for each release, and then reading those files as part of the release cycle.