Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-3150

Reconsider default tasks for Evergreen

    • Type: Icon: Investigation Investigation
    • Resolution: Fixed
    • Priority: Icon: Minor - P4 Minor - P4
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      Right now our defaults do not include any server versions newer than 4.4, and all the tasks are on older OS versions such as RHEL 6.2 or Ubuntu 16.04.

      For the purposes of defining the defaults, we will consider all of the following tasks to be "integration-ish" tests:

      • integration, which has variants like -cluster and -auth.
      • qa-tests
      • aws-auth
      • native-cert-ssl-*
      • qa-dump-restore-*
        • As an aside, these are only run against 4.4 right now. Should we include more versions or at least move this to 6.0?

      We should come up with a new mix of default tasks that has the following properties:

      • Runs all static analysis tasks.
      • Runs unit tests on all supported platforms.
      • Runs all integration-ish tests, including variations, against all supported server versions on at least one platform. This should be a platform with a wide range of supported server versions.
      • Runs at least one of each integration-ish test (integration, qa-tests, aws-auth) on every supported platform.
      • Runs at least one of each integration-ish test (integration, qa-tests, aws-auth) against every supported server version.
      • Runs the sign and push tasks on every supported platform. This uploads the binaries we build to s3, which is useful for doing manual testing.
      • Runs all of the race detector tests.
        • Note that right now these only test server versions 3.6-4.4 Should this be expanded to cover all server versions?

      I think we might be able to write some code that (re)generates this list based on the desired properties. This might be a good idea so we can update the defaults as we add/remove server versions and platforms.

            Assignee:
            dave.rolsky@mongodb.com Dave Rolsky
            Reporter:
            dave.rolsky@mongodb.com Dave Rolsky
            Evgeni Dobranov, Tim Fogarty
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: