[SERVER-30770] system_perf.yml: Use new DSI interface and cleanup Created: 22/Aug/17  Updated: 30/Oct/23  Resolved: 27/Nov/17

Status: Closed
Project: Core Server
Component/s: Performance
Affects Version/s: None
Fix Version/s: 3.2.19, 3.4.11, 3.6.1

Type: Bug Priority: Major - P3
Reporter: Henrik Ingo (Inactive) Assignee: Vick Mena (Inactive)
Resolution: Fixed Votes: 0
Labels: neweng
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Duplicate
Gantt Dependency
has to be done after SERVER-29524 sys-perf: Call infrastructure_provisi... Closed
Related
related to SERVER-32087 Run test stage of sys-perf and mongo-... Closed
Backwards Compatibility: Major Change
Operating System: ALL
Backport Requested:
v3.6, v3.4, v3.2
Sprint: Performance 2017-11-13, Performance 2017-11-27
Participants:

 Description   

Following recent changes on DSI side, we should clean up system_perf.yml AND longevity.yml to use the new executable names and options.

In the "prepare environment" part:

  • move mongodb_binary_archive from runtime.yml to bootstrap.yml
  • remove --production cli option from bootstrap.py
  • continue to call setup-dsi-env.sh as now

In the later sections, we should now be able to significantly shorten the whole file. It should end up roughly like this:

  "deploy cluster":
    - command: shell.exec
      params:
        working_dir: work
        script: |
          set -e
          set -v
          source ./dsienv.sh
          source ./venv/bin/activate
          # This will either create a cluster, or update tags on existing instances.
          infrastructure_provisioning.py
          mongodb_setup.py
 
 
  "run test":
    - command: shell.exec
      type : test
      params:
        working_dir: work
        script: |
          set -e
          set -v
          source ./dsienv.sh
          source ./venv/bin/activate
          test_control.py

Note that this should probably move to the post: section

    - command: "json.send"
      params:
         name: "perf"
         file: "work/perf.json"

The analysis section is unaffected for now.

Finally, change "initialSync" to "initialsync" everywhere.



 Comments   
Comment by Githook User [ 08/Dec/17 ]

Author:

{'name': 'Vick Mena', 'email': 'vickmena@gmail.com', 'username': 'vmenajr'}

Message: SERVER-30770: system_perf.yml: Use new DSI interface and cleanup
Branch: v3.6
https://github.com/mongodb/mongo/commit/61e747b976ecbf509fc3f8db2c5a3c169c93c454

Comment by Githook User [ 29/Nov/17 ]

Author:

{'name': 'Vick Mena', 'username': 'vmenajr', 'email': 'vickmena@gmail.com'}

Message: SERVER-30770: system_perf.yml: Use new DSI interface and cleanup
Branch: v3.2
https://github.com/mongodb/mongo/commit/e8d4c699706448df0137def23532b5bc015f772d

Comment by Githook User [ 29/Nov/17 ]

Author:

{'name': 'Vick Mena', 'username': 'vmenajr', 'email': 'vickmena@gmail.com'}

Message: SERVER-30770: system_perf.yml: Use new DSI interface and cleanup
Branch: v3.4
https://github.com/mongodb/mongo/commit/0fe9a94b1aa1cdab0c3f4c1476fef155c628a14f

Comment by Githook User [ 22/Nov/17 ]

Author:

{'name': 'Vick Mena', 'username': 'vmenajr', 'email': 'vickmena@gmail.com'}

Message: SERVER-30770: system_perf.yml: Use new DSI interface and cleanup
Branch: master
https://github.com/mongodb/mongo/commit/2b9095818a4b6fc0a797ff1dd25fdfe0792b99c1

Comment by Githook User [ 17/Nov/17 ]

Author:

{'name': 'Vick Mena', 'username': 'vmenajr', 'email': 'vickmena@gmail.com'}

Message: PERF-1156: SERVER-30770 Cleanup changes in DSI
Branch: master
https://github.com/10gen/dsi/commit/0d33f7972e3fc1427372b5501e82320bde9eff75

Comment by David Daly [ 26/Oct/17 ]

LGTM henrik.ingo

Comment by Henrik Ingo (Inactive) [ 26/Oct/17 ]

david.daly I fixed description to have the test run as type test. Please review.

Generated at Thu Feb 08 04:24:57 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.