[SERVER-79975] [Classic] Optimize large group keys Created: 14/Aug/23 Updated: 08/Dec/23 Resolved: 31/Oct/23 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | 7.2.0-rc0, 5.0.22, 6.0.12, 7.0.4 |
| Type: | Improvement | Priority: | Critical - P2 |
| Reporter: | Mickey Winters | Assignee: | Mickey Winters |
| Resolution: | Fixed | Votes: | 1 |
| Labels: | auto-reverted | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||
| Backport Requested: |
v7.1, v7.0, v6.0, v5.0
|
||||||||||||||||||||
| Sprint: | QE 2023-08-21, QE 2023-09-04, QE 2023-09-18, QE 2023-10-02, QE 2023-10-16, QE 2023-10-30, QE 2023-11-13 | ||||||||||||||||||||
| Participants: | |||||||||||||||||||||
| Linked BF Score: | 159 | ||||||||||||||||||||
| Description |
|
After 4.4 we switched mongo::Document to use lazy shredding instead of eager shredding. If a customer has a large group key over large documents with potentially missing fields this can result in lots of linear look ups for each field resulting in O(n^2) type behavior. where N is the number of fields in a document. The goal is to fix this issue for 5.0 since SERVER-79548 should fix this for SBE |
| Comments |
| Comment by Githook User [ 02/Nov/23 ] |
|
Author: {'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}Message: |
| Comment by Githook User [ 20/Oct/23 ] |
|
Author: {'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}Message: |
| Comment by Githook User [ 05/Oct/23 ] |
|
Author: {'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}Message: |
| Comment by xgen-buildbaron-user [ 28/Sep/23 ] |
|
Ticket re-opened due to revert. cqf_experimental_aggregation_passthrough began a consistent failure of jstests/aggregation/sources/shred_documents.js |
| Comment by Githook User [ 28/Sep/23 ] |
|
Author: {'name': 'auto-revert-processor', 'email': 'dev-prod-dag@mongodb.com', 'username': ''}Message: Revert " This reverts commit 1a474953f59a356c1a8da08f2463be30af4610ae. |
| Comment by Githook User [ 27/Sep/23 ] |
|
Author: {'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}Message: |
| Comment by Githook User [ 26/Sep/23 ] |
|
Author: {'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}Message: |