Uploaded image for project: 'Python Driver'
  1. Python Driver
  2. PYTHON-4769

Investigate pref regression in TestFindManyAndEmptyCursor benchmark

    • Type: Icon: Task Task
    • Resolution: Fixed
    • Priority: Icon: Unknown Unknown
    • 4.10
    • Affects Version/s: None
    • Component/s: None
    • None
    • Python Drivers
    • Not Needed
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?

      Investigate pref regression in TestFindManyAndEmptyCursor benchmark. FindManyAndEmptyCursor dropped ~35% back in late July:
      https://spruce.mongodb.com/task/mongo_python_driver_perf_tests_perf_6.0_standalone_63d957c2137cec66821d4d1669ff7a24f4c4f6f0_24_09_11_15_22_22/trend-charts?execution=0&sortBy=STATUS&sortDir=ASC

      This regression is present in both the ssl and non-ssl benchmark so it seems real. Unrelated to this ticket itself but we should also investigate why we never got an alert for this.

      So far I can't reproduce the regression locally on macOS. I scheduled a few benchmark runs on the commits in between https://github.com/mongodb/mongo-python-driver/commit/0f5349e2e02716611a2fe4beb0605f74fcf63fe3 (PYTHON-4572) and https://github.com/mongodb/mongo-python-driver/commit/105393109e891b35f64eec3df11955f2cdc2e81d (PYTHON-4533) to narrow down the search.

            Assignee:
            shane.harvey@mongodb.com Shane Harvey
            Reporter:
            shane.harvey@mongodb.com Shane Harvey
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: