[DRIVERS-1576] Testing the efficacy of Astrolabe Created: 22/Feb/21  Updated: 14/Oct/21  Resolved: 15/Jul/21

Status: Closed
Project: Drivers
Component/s: Atlas Testing
Fix Version/s: None

Type: Epic Priority: Major - P3
Reporter: Bernie Hackett Assignee: Unassigned
Resolution: Duplicate Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates DRIVERS-1811 Astrolabe Testing Improvements Closed
Driver Changes: Not Needed
Quarter: FY22Q3

 Description   

The astrolabe project currently tests various Atlas planned maintenance scenarios in an attempt to find problematic scenarios indicating either driver bugs or bugs in the planned maintenance scenarios themselves. So far the project has not found bugs in either (aside from timeout issues in cloud-dev).

We need to test Astrolabe itself to see if it actually achieves its goals. One way to do this would be to test a driver version that is known to have bugs related to planned maintenance, along with the workload that was used to reproduce the bug, and see if those bugs are reproduced by Astrolabe. We would want to continually test Astrolabe this way to ensure future changes to it don't obscure known driver bugs. As new driver bugs are found the pre-bugfix version of the driver, and the workload that reproduces the bug, should be added to a corpus of such tests.



 Comments   
Comment by Alexander Golin (Inactive) [ 15/Jul/21 ]

Combining this ticket and DRIVERS-1745 under DRIVERS-1811, closing this as a duplicate.

Generated at Thu Feb 08 08:23:38 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.