Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-66926

Introduce end-to-end functional query correctness testing based on golden test framework

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Minor - P4 Minor - P4
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Query Optimization
    • QE 2022-06-13, QE 2022-06-27

      Add a new suite called something like query_integration_tests_standalone. This would work much like the pre-existing integration_tests_standalone, but it would be focused on testing the correctness of query results or potentially even testing plans using explain. Critically, the idea is to use golden file based testing – the tests would run some queries or explain operations, dump their results, and then compare the results to the golden files. Having an integration test suite like this is an important part of our testing strategy for the Common Query Framework. It could also strengthen our query correctness testing in general – the current testing is either based on the generational fuzzer which may not generate realistic queries, or based on making specific assertions about the nature of the query results which are weaker tests.

            Assignee:
            backlog-query-optimization [DO NOT USE] Backlog - Query Optimization
            Reporter:
            david.storch@mongodb.com David Storch
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated: