Fail jstests if they modify server's config

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • DevProd Correctness
    • 0
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Evergreen tasks run the following high level steps:
      1. Setup fixture
      1. Randomise tests to run and run them sequentially.
      1. If a test fails then abort and setup fixture again

      BF-39865 is caused because a test (notablescan_sbe_consistency) is changing the server's config (query engine from sbe to classic) and therefore is affecting all tests running afterwards such as the failing one (sbe_ixscan_explain) but also affected distinct_sbe_compatibility. This one didn't failed because it is prefixed with
      ```
      if (!checkSbeRestrictedOrFullyEnabled(db))

      { quit(); }

      ```
      which results in silently losing coverage.

      This early quitting should be avoided, we have the tags for that matter. Also we should modify the running logic to compare server's config pre and post each test and fail if it was modified.

            Assignee:
            Unassigned
            Reporter:
            Carlos Alonso Pérez
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated: