A number of our types derive Serialize and Deserialize for testing purposes. We should consider moving these behind #[cfg(test)] to improve compile times for users and remove test-only serde logic from the public API. Switching to manual serde implementations may also improve compile times overall.

This will technically be a breaking change because we'll be removing public trait implementations. We should do this as part of 3.0.