[SERVER-75191] Investigate performance of $percentile in window functions Created: 23/Mar/23  Updated: 29/Oct/23  Resolved: 13/Apr/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.0.0-rc0, 7.1.0-rc0

Type: Task Priority: Major - P3
Reporter: Gil Alon Assignee: Gil Alon
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
depends on SERVER-74559 Support $percentile and $median in wi... Closed
Assigned Teams:
Query Integration
Backwards Compatibility: Fully Compatible
Backport Requested:
v7.0
Sprint: QI 2023-04-03, QI 2023-04-17
Participants:

 Description   

Need to run performance tests on $percentile in window functions with large windows. 

Some considerations for improvements could be 

  1. Computing all requested percentiles at once.
  2. Iterating in reverse for p > 0.5.
  3. Change how we store _values (potentially use absl::btree_multiset and not std::multiset). This could decrease memory usage.

 

Run $percentile on window functions on queries and measure the latency.



 Comments   
Comment by Githook User [ 13/Apr/23 ]

Author:

{'name': 'Gil Alon', 'email': 'gil.alon@mongodb.com', 'username': 'galon1'}

Message: SERVER-75191 Improve $percentile bounded window function performance and add benchmarks
Branch: v7.0
https://github.com/mongodb/mongo/commit/e2c9d45b53a56ea48ff02bd9438b60edb6e5fdf4

Comment by Githook User [ 12/Apr/23 ]

Author:

{'name': 'Gil Alon', 'email': 'gil.alon@mongodb.com', 'username': 'galon1'}

Message: SERVER-75191 Improve $percentile bounded window function performance and add benchmarks
Branch: master
https://github.com/mongodb/mongo/commit/ca85829478462c865010a390793ed8481b5d293a

Generated at Thu Feb 08 06:29:33 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.