[SERVER-78504] [CQF] Populate optimizer metadata with sharding and orphan information Created: 28/Jun/23  Updated: 29/Oct/23  Resolved: 02/Aug/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.1.0-rc0

Type: Task Priority: Major - P3
Reporter: Ben Shteinfeld Assignee: Ben Shteinfeld
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Assigned Teams:
Query Optimization
Backwards Compatibility: Fully Compatible
Sprint: QO 2023-07-24, QO 2023-08-07
Participants:

 Description   

Once the optimizer can use the metadata to generate plans with shard filtering, we need to populate metadata accordingly. This will allow us to generate correct plans e2e with shard filtering and allow us to turn on sharded test suites.



 Comments   
Comment by Githook User [ 02/Aug/23 ]

Author:

{'name': 'Ben Shteinfeld', 'email': 'ben.shteinfeld@mongodb.com', 'username': 'bshteinfeld'}

Message: SERVER-78504 Remove cqf_incompatiable tag from shard filtering tests

Now that Bonsai produces physical plans that perform sharding filtering
and we lower them to corresponding SBE plans, we can run these tests.
Branch: minh.luu-no_compile_sys-perf
https://github.com/mongodb/mongo/commit/74b01156c24dc3d8021c393c99d688232832a774

Comment by Githook User [ 02/Aug/23 ]

Author:

{'name': 'Ben Shteinfeld', 'email': 'ben.shteinfeld@mongodb.com', 'username': 'bshteinfeld'}

Message: SERVER-78504 Populate sharding metadata in Bonsai
Branch: minh.luu-no_compile_sys-perf
https://github.com/mongodb/mongo/commit/771548efb37cda09c8fb100614639a864e133952

Comment by Githook User [ 02/Aug/23 ]

Author:

{'name': 'Ben Shteinfeld', 'email': 'ben.shteinfeld@mongodb.com', 'username': 'bshteinfeld'}

Message: SERVER-78504 Allow expressions to be children of shardFilter function call

When we initially implemented lowering for `FunctionCall['shardFilter]`,
we made an incorrect assumption that all children of that ABT will
always be of type Variable. While physical rewrites might currently only
produce such plans, path fusion rewrites can inline the definition of
variables with expressions. As such, we need to support lowering such
plans.

We do this by invoking `SBEExpressionLowering` on any child of the
shardFilter function call.
Branch: minh.luu-no_compile_sys-perf
https://github.com/mongodb/mongo/commit/99a4079e0fb7d242285c662182d87d44e199900a

Comment by Githook User [ 01/Aug/23 ]

Author:

{'name': 'Ben Shteinfeld', 'email': 'ben.shteinfeld@mongodb.com', 'username': 'bshteinfeld'}

Message: SERVER-78504 Remove cqf_incompatiable tag from shard filtering tests

Now that Bonsai produces physical plans that perform sharding filtering
and we lower them to corresponding SBE plans, we can run these tests.
Branch: master
https://github.com/mongodb/mongo/commit/74b01156c24dc3d8021c393c99d688232832a774

Comment by Githook User [ 01/Aug/23 ]

Author:

{'name': 'Ben Shteinfeld', 'email': 'ben.shteinfeld@mongodb.com', 'username': 'bshteinfeld'}

Message: SERVER-78504 Populate sharding metadata in Bonsai
Branch: master
https://github.com/mongodb/mongo/commit/771548efb37cda09c8fb100614639a864e133952

Comment by Githook User [ 01/Aug/23 ]

Author:

{'name': 'Ben Shteinfeld', 'email': 'ben.shteinfeld@mongodb.com', 'username': 'bshteinfeld'}

Message: SERVER-78504 Allow expressions to be children of shardFilter function call

When we initially implemented lowering for `FunctionCall['shardFilter]`,
we made an incorrect assumption that all children of that ABT will
always be of type Variable. While physical rewrites might currently only
produce such plans, path fusion rewrites can inline the definition of
variables with expressions. As such, we need to support lowering such
plans.

We do this by invoking `SBEExpressionLowering` on any child of the
shardFilter function call.
Branch: master
https://github.com/mongodb/mongo/commit/99a4079e0fb7d242285c662182d87d44e199900a

Generated at Thu Feb 08 06:38:31 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.