Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-8408

Allow the "wiredtiger-perf-long-btree" tests to run in parallel.

    • Type: Icon: Task Task
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT11.0.0, 5.3.0, 5.2.0-rc2
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None
    • 3
    • Storage - Ra 2021-11-29, Storage - Ra 2021-12-13, Storage - Ra 2022-01-10

      The long tests take almost 9 hours to run.

      The following tests are required to run on the directory (WT_TEST) generated by the execution of the 500m-btree-populate test.

      • 500m-btree-50r50u
      • 500m-btree-50r50u-backup
      • 500m-btree-80r20u
      • 500m-btree-rdonly

      At this stage, we are simply running all these tests under a single task sequentially and uploading the result generated from each task to evergreen and Atlas.

      - func: "run-perf-test" 
        vars: 
          perf-test-name: 500m-btree-populate 
          maxruns: 1 
          wtarg: -args ['"-C create,statistics=(fast),statistics_log=(json,wait=1,sources=[file:])"'] -ops ['"load", "warnings", "max_latency_insert"']
      
      - func: "upload-perf-test-stats" 
        vars: 
          perf-test-name: 500m-btree-populate 
      
      - func: "run-perf-test" 
        vars: 
          perf-test-name: 500m-btree-50r50u 
          maxruns: 1 
          wtarg: -args ['"-C create,statistics=(fast),statistics_log=(json,wait=1,sources=[file:])"'] -ops ['"read", "update", "warnings", "max_latency_read_update"'] 
      
      - func: "upload-perf-test-stats" 
        vars: 
          perf-test-name: 500m-btree-50r50u
      ...  

      However, running the tests in parallel should save time. 

      Scope:

      • Upload the directory generated from the 500m-btree-populate test to an s3 bucket.
      • Run the tests mentioned above in separate tasks. Each task will
        • Fetch the directory from the S3 bucket
        • Run the test on the directory. 

       

            Assignee:
            siddhartha.mahajan@mongodb.com Sid Mahajan
            Reporter:
            siddhartha.mahajan@mongodb.com Sid Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: