Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-83372

Antithesis sanity check should shuffle the test order and be more comprehensive

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • None
    • None
    • Testing Infrastructure
    • None
    • Correctness
    • 60

    Description

      The evergreen/antithesis_image_build_and_push.sh script runs a sanity check to verify a test run by resmoke against a Docker Compose spawned MongoDB cluster will succeed. The current approach runs the same test file each time the Evergreen task executes which happens to correspond to the test with the smallest name lexicographically.

      The antithesis_config_fuzzer_stress_concurrency_sharded_replication switching from running the agg_base.js FSM workload to the add_remove_shards_killop.js FSM workload (SERVER-81974) led to the discovery of a latent limitation for the test infrastructure which the Docker Compose setup relies on (SERVER-83368). Shuffling the test order would be one way to build up confidence over time that tests are capable of running without error under a Docker Compose setup similar to the one Antithesis uses. Other approaches increase the validate the test setup should also be considered by the team.

      Attachments

        Activity

          People

            devprod-correctness-team@mongodb.com [DO NOT ASSIGN] Backlog - DevProd Correctness
            max.hirschhorn@mongodb.com Max Hirschhorn
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: