The test/format randomly picks configuration combinations for each testing instance and dumps out the detailed configuration picked upon hitting a test failure. The dumped configuration detail is not very human-readable and requires some manual effort to pick out those useful properties (e.g. data source, cache size) in order to categorize the failures.

This ticket is created as part of the Skunkworks project and is aimed to assist the test/format failure analysis/triaging with a “classifier” to generate a human-readable output for critical configuration properties, so the test triage baron (or any engineer checking into the failure) could easily map it to a given failure category (linking to an existing ticket or creating new ticket).