We've found that it's hard to find all the possible combinations that a query can be written so we had the idea of specifying a specific query (maybe a prompt, a sample query, or both of them) and running a weekly (whatever) test suite that checks the accuracy of our parser over made up combinations using chatgpt / other models.

This might be useful because we can assume that developers will use chatgpt to generate samples queries.