[SERVER-72376] Use appropriate cast for call to EVP_DigestVerifyFinal on RHEL 7 Created: 22/Dec/22 Updated: 29/Oct/23 Resolved: 28/Dec/22 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | 6.3.0-rc0 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Varun Ravichandran | Assignee: | Varun Ravichandran |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||
| Backwards Compatibility: | Fully Compatible | ||||
| Operating System: | ALL | ||||
| Sprint: | Security 2022-12-26, Security 2023-01-09 | ||||
| Participants: | |||||
| Linked BF Score: | 151 | ||||
| Description |
|
On RHEL 7 (OpenSSL 1.0.x), EVP_DigestVerifyFinal expects its second argument to be of type unsigned char*. On RHEL 8 (OpenSSL 1.1.x), EVPDigestVerifyFinal expects its second argument to be of type const unsigned char*. Today, we are casting the signature to const unsigned char* before passing it to the function here, triggering a compiler error on platforms with older versions of OpenSSL. We should update the cast so it succeeds on older versions of OpenSSL as well. |
| Comments |
| Comment by Githook User [ 29/Dec/22 ] |
|
Author: {'name': 'Varun Ravichandran', 'email': 'varun.ravichandran@mongodb.com', 'username': 'varunravi98'}Message: |
| Comment by Githook User [ 28/Dec/22 ] |
|
Author: {'name': 'Varun Ravichandran', 'email': 'varun.ravichandran@mongodb.com', 'username': 'varunravi98'}Message: |