[SERVER-79975] [Classic] Optimize large group keys Created: 14/Aug/23  Updated: 08/Dec/23  Resolved: 31/Oct/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.2.0-rc0, 5.0.22, 6.0.12, 7.0.4

Type: Improvement Priority: Critical - P2
Reporter: Mickey Winters Assignee: Mickey Winters
Resolution: Fixed Votes: 1
Labels: auto-reverted
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Problem/Incident
Related
related to SERVER-79548 [SBE] optimize pulling multiple field... Open
is related to SERVER-79548 [SBE] optimize pulling multiple field... Open
Backwards Compatibility: Fully Compatible
Backport Requested:
v7.1, v7.0, v6.0, v5.0
Sprint: QE 2023-08-21, QE 2023-09-04, QE 2023-09-18, QE 2023-10-02, QE 2023-10-16, QE 2023-10-30, QE 2023-11-13
Participants:
Linked BF Score: 159

 Description   

After 4.4 we switched mongo::Document to use lazy shredding instead of eager shredding. If a customer has a large group key over large documents with potentially missing fields this can result in lots of linear look ups for each field resulting in O(n^2) type behavior. where N is the number of fields in a document. The goal is to fix this issue for 5.0 since SERVER-79548 should fix this for SBE



 Comments   
Comment by Githook User [ 02/Nov/23 ]

Author:

{'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}

Message: SERVER-79975 add document shredder stage
Branch: v6.0
https://github.com/mongodb/mongo/commit/a0b6e66c6dab285228504997bbc998c9d5942ba2

Comment by Githook User [ 20/Oct/23 ]

Author:

{'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}

Message: SERVER-79975 add document shredder stage
Branch: v7.0
https://github.com/mongodb/mongo/commit/ea2457a45e990a9ab9c664f0f16c2ae02f9c33c9

Comment by Githook User [ 05/Oct/23 ]

Author:

{'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}

Message: SERVER-79975 add document shredder stage
Branch: master
https://github.com/mongodb/mongo/commit/779c37d5e96f264d5ebd5d901668ff26448eb932

Comment by xgen-buildbaron-user [ 28/Sep/23 ]

Ticket re-opened due to revert. cqf_experimental_aggregation_passthrough began a consistent failure of jstests/aggregation/sources/shred_documents.js

Comment by Githook User [ 28/Sep/23 ]

Author:

{'name': 'auto-revert-processor', 'email': 'dev-prod-dag@mongodb.com', 'username': ''}

Message: Revert "SERVER-79975 add document shredder stage"

This reverts commit 1a474953f59a356c1a8da08f2463be30af4610ae.
Branch: master
https://github.com/mongodb/mongo/commit/2a4b25b7854a2361bbd3c79ba37acecfe1dacddf

Comment by Githook User [ 27/Sep/23 ]

Author:

{'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}

Message: SERVER-79975 add document shredder stage
Branch: master
https://github.com/mongodb/mongo/commit/1a474953f59a356c1a8da08f2463be30af4610ae

Comment by Githook User [ 26/Sep/23 ]

Author:

{'name': 'Mickey. J Winters', 'email': 'mickey.winters@mongodb.com', 'username': 'mjrb'}

Message: SERVER-79975 add document shredder stage
Branch: v5.0
https://github.com/mongodb/mongo/commit/0258e64a280960dc0bd0273cb27ca46d8697fc1d

Generated at Thu Feb 08 06:42:23 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.