[SERVER-57668] Cache chunk bounds as an array in resharding collection cloning pipeline Created: 12/Jun/21  Updated: 29/Oct/23  Resolved: 16/Jun/21

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: 5.0.0-rc2, 5.1.0-rc0

Type: Improvement Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Max Hirschhorn
Resolution: Fixed Votes: 0
Labels: PM-234-M3, PM-234-T-data-clone, post-rc0
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Related
related to SERVER-57705 DocumentSourceSequentialCache can win... Backlog
related to SERVER-57483 Results from $lookup stage are not ca... Closed
is related to SERVER-57579 DocumentSourceSequentialCache doesn't... Closed
is related to SERVER-57667 Improve processing speed for reshardi... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v5.0
Sprint: Sharding 2021-06-28
Participants:
Story Points: 1

 Description   

DocumentSourceSequentialDocumentCache::doOptimizeAt() caches on a per-stage basis of the $lookup pipeline. Restructuring the aggregation pipeline so the $objectToArray values are done as a separate stage from the $match that references the $$sk variable would mean their results can be cached too.

The changes made in this ticket will be obsoleted by SERVER-57667 but will reduce the per-document processing overhead by a constant factor.



 Comments   
Comment by Vivian Ge (Inactive) [ 06/Oct/21 ]

Updating the fixversion since branching activities occurred yesterday. This ticket will be in rc0 when it’s been triggered. For more active release information, please keep an eye on #server-release. Thank you!

Comment by Githook User [ 16/Jun/21 ]

Author:

{'name': 'Max Hirschhorn', 'email': 'max.hirschhorn@mongodb.com', 'username': 'visemet'}

Message: SERVER-57668 Cache post-transformed chunk bounds for resharding cloning.
Branch: SERVER-34632
https://github.com/mongodb/mongo/commit/6659e192ee5feceda14bebe1cb22f219d5d765fd

Comment by Githook User [ 16/Jun/21 ]

Author:

{'name': 'Max Hirschhorn', 'email': 'max.hirschhorn@mongodb.com', 'username': 'visemet'}

Message: SERVER-57668 Cache post-transformed chunk bounds for resharding cloning.

(cherry picked from commit 6659e192ee5feceda14bebe1cb22f219d5d765fd)
Branch: v5.0
https://github.com/mongodb/mongo/commit/ee1cea12a8108f35f24069bde1f8a8be350c16fb

Comment by Githook User [ 15/Jun/21 ]

Author:

{'name': 'Max Hirschhorn', 'email': 'max.hirschhorn@mongodb.com', 'username': 'visemet'}

Message: SERVER-57668 Cache post-transformed chunk bounds for resharding cloning.
Branch: master
https://github.com/mongodb/mongo/commit/6659e192ee5feceda14bebe1cb22f219d5d765fd

Generated at Thu Feb 08 05:42:28 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.