Make it easier to update expected results in query correctness tests

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Query Optimization
    • None
    • 3
    • TBD
    • None
    • None
    • None
    • None
    • None
    • None

      Recently for SERVER-104636 and SERVER-104645, I needed to update the query shape hashes for many many of the queries in the query-correctness-test repos. This was rather arduous because the repos are so large they take a long time to clone locally, and the tests take a long time to run.

      Since in my case I had run these tests in evergreen, there were diffs in the log files there that contained the new hashes. What if we were to:

      • add a git-formatted diff file to the artifacts produced by the evergreen task. This diff could then just be applied to a local repository to get the changes for updating the hashes.
      • Even more useful would be to automate things further and create a branch in the relevant query-correctness-tests repository on GitHub with a diff link to easily create a PR that updates the new expected outputs.

            Assignee:
            Unassigned
            Reporter:
            Chris Wolff
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: