[SERVER-56882] unable to complete full validation on collection after failed hashed index insert Created: 12/May/21 Updated: 29/Oct/23 Resolved: 28/Sep/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | 5.1.0-rc0 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Benety Goh | Assignee: | Benety Goh |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
||||||||||||||||||||
| Issue Links: |
|
||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||
| Operating System: | ALL | ||||||||||||||||||||
| Sprint: | Execution Team 2021-10-04, Storage - Ra 2021-09-06 | ||||||||||||||||||||
| Participants: | |||||||||||||||||||||
| Linked BF Score: | 18 | ||||||||||||||||||||
| Story Points: | 0 | ||||||||||||||||||||
| Description |
|
Add regression tests for The validation warnings reported previously in this ticket have been resolved in the storage engine in this commit containing OLD DESCRIPTION A failed insert into a collection with a hashed index cause the server to end up in a state where validate({full: true}) fails to complete and returns "Could not complete validation of table:index-NNN. This is a transient issue as the collection was actively in use by other operations." warnings. This state seems to persist for an extended period in spite of checkpointing activity observed in the server logs. It would be useful to understand if this is an issue in the storage engine or at the integration layer above it. |
| Comments |
| Comment by Vivian Ge (Inactive) [ 06/Oct/21 ] | ||||||||||||||
|
Updating the fixversion since branching activities occurred yesterday. This ticket will be in rc0 when it’s been triggered. For more active release information, please keep an eye on #server-release. Thank you! | ||||||||||||||
| Comment by Githook User [ 28/Sep/21 ] | ||||||||||||||
|
Author: {'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}Message: | ||||||||||||||
| Comment by Githook User [ 27/Sep/21 ] | ||||||||||||||
|
Author: {'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}Message: | ||||||||||||||
| Comment by Benety Goh [ 22/Sep/21 ] | ||||||||||||||
|
etienne.petrel, thanks for chasing this one down. I've verified that the JS tests attached to this ticket are now passing and hope to include these two tests in our CI system soon. | ||||||||||||||
| Comment by Etienne Petrel [ 21/Sep/21 ] | ||||||||||||||
|
benety.goh, | ||||||||||||||
| Comment by Benety Goh [ 21/Sep/21 ] | ||||||||||||||
|
etienne.petrel, thank you for the update! | ||||||||||||||
| Comment by Etienne Petrel [ 21/Sep/21 ] | ||||||||||||||
|
benety.goh, I have set this ticket to depend on | ||||||||||||||
| Comment by Etienne Petrel [ 09/Sep/21 ] | ||||||||||||||
|
I will be posting updates about the investigation in the WT ticket from now on, I hope it is ok. | ||||||||||||||
| Comment by Benety Goh [ 08/Sep/21 ] | ||||||||||||||
|
etienne.petrel, thank you for looking into this. Let us know if you need any assistance on the reproducers. | ||||||||||||||
| Comment by Etienne Petrel [ 06/Sep/21 ] | ||||||||||||||
|
I realized there is an existing WT ticket that describes the same issue, I am linking the two. Assigning this one back to you benety.goh. | ||||||||||||||
| Comment by Etienne Petrel [ 03/Sep/21 ] | ||||||||||||||
|
We end up in the session_verify where we call wt_schema_worker. The first two URIs passed on to the function are:
Until here everything works fine, wt_schema_worker does not return any error. But then we call wt_schema_worker again with the following URIs:
The URI that starts with file calls wt_exclusive_handle_operation which calls wt_conn_dhandle_close_all and itself calls conn_dhandle_close_one:
This call returns EBUSY. I could eventually find the piece of code that returns EBUSY:
I will need to investigate more why this happens on the index and not on the collection. | ||||||||||||||
| Comment by Etienne Petrel [ 03/Sep/21 ] | ||||||||||||||
|
Thank you benety.goh for your reproducers. I will be having a look today and get back to you. |