Uploaded image for project: 'Python Driver'
  1. Python Driver
  2. PYTHON-4863

Workflow validator in Astrolabe is not working for pymongo

    • Type: Icon: Build Failure Build Failure
    • Resolution: Done
    • Priority: Icon: Unknown Unknown
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Python Drivers
    • Not Needed
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?

      Name of Failure:

      validate-workload-executor

      Link to task:

      https://spruce.mongodb.com/version/66cfddcd82b41900075e57e1/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC&variant=tests-python__driver~pymongo-master_platform~ubuntu-22.04_runtime~python39

      Context of when and why the failure occurred:

      Seems to have started on 28 Aug with no changes to drivers-atlas-testing.

      Stack trace:

      [2024/08/28 21:41:02.834] ======================================================================
      [2024/08/28 21:41:02.834] FAIL: test_num_failures (astrolabe.validator.ValidateWorkloadExecutor)
      [2024/08/28 21:41:02.834] ----------------------------------------------------------------------
      [2024/08/28 21:41:02.834] Traceback (most recent call last):
      [2024/08/28 21:41:02.834]   File "/data/mci/acfce75bf03ffac0adda3e9f01e06a2b/astrolabe-src/astrolabe/validator.py", line 452, in test_num_failures
      [2024/08/28 21:41:02.834]     self.fail_stats(
      [2024/08/28 21:41:02.834]   File "/data/mci/acfce75bf03ffac0adda3e9f01e06a2b/astrolabe-src/astrolabe/validator.py", line 272, in fail_stats
      [2024/08/28 21:41:02.834]     self.fail(
      [2024/08/28 21:41:02.834] AssertionError: The workload executor reported inconsistent execution statistics. Expected approximately 117/2 failed operations to be reported in numFailures, but got 0 instead.
      [2024/08/28 21:41:02.834] ======================================================================
      [2024/08/28 21:41:02.834] FAIL: test_num_failures_as_errors (astrolabe.validator.ValidateWorkloadExecutor)
      [2024/08/28 21:41:02.834] ----------------------------------------------------------------------
      [2024/08/28 21:41:02.834] Traceback (most recent call last):
      [2024/08/28 21:41:02.834]   File "/data/mci/acfce75bf03ffac0adda3e9f01e06a2b/astrolabe-src/astrolabe/validator.py", line 519, in test_num_failures_as_errors
      [2024/08/28 21:41:02.834]     self.fail(
      [2024/08/28 21:41:02.834] AssertionError: Expected approximately 117/2 failed operations to be reported in numErrors, but got 0 instead.
      [2024/08/28 21:41:02.834] ======================================================================
      [2024/08/28 21:41:02.834] FAIL: test_num_failures_not_captured (astrolabe.validator.ValidateWorkloadExecutor)
      [2024/08/28 21:41:02.834] ----------------------------------------------------------------------
      [2024/08/28 21:41:02.834] Traceback (most recent call last):
      [2024/08/28 21:41:02.834]   File "/data/mci/acfce75bf03ffac0adda3e9f01e06a2b/astrolabe-src/astrolabe/validator.py", line 487, in test_num_failures_not_captured
      [2024/08/28 21:41:02.834]     self.fail_stats(
      [2024/08/28 21:41:02.834]   File "/data/mci/acfce75bf03ffac0adda3e9f01e06a2b/astrolabe-src/astrolabe/validator.py", line 272, in fail_stats
      [2024/08/28 21:41:02.834]     self.fail(
      [2024/08/28 21:41:02.834] AssertionError: The workload executor reported inconsistent execution statistics. Expected either numErrors:0 and numFailures:1 or numErrors:1 and numFailures:0, but got numErrors:0 and numFailures:0 instead.
      [2024/08/28 21:41:02.834] ----------------------------------------------------------------------
      [2024/08/28 21:41:02.834] Ran 7 tests in 62.765s
      [2024/08/28 21:41:02.834] FAILED (failures=3)
      [2024/08/28 21:41:03.274] Command 'subprocess.exec'
      

            Assignee:
            steve.silvester@mongodb.com Steve Silvester
            Reporter:
            steve.silvester@mongodb.com Steve Silvester
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: