[SERVER-68490] Integrate histogram estimation with the statistics module and the optimizer Created: 02/Aug/22  Updated: 29/Oct/23  Resolved: 26/Oct/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 6.2.0-rc0

Type: Task Priority: Major - P3
Reporter: Timour Katchaounov Assignee: Alya Berciu
Resolution: Fixed Votes: 0
Labels: M6
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-70241 [CQF] Implement "auto mode" for cardi... Backlog
Duplicate
is duplicated by SERVER-68748 Move analyze testing out of core and ... Closed
Backwards Compatibility: Fully Compatible
Sprint: QO 2022-10-31
Participants:

 Description   

The statistics module should provide the following functionality:

  • ability to build histograms and statistics against mongodb collections,
  • an "analyze" command that triggers the statistics collection process,
  • a way to access a cache object that knows how to retrieve statistics from disk, and provides access to collection histograms keyed by paths.

Based on this functionality this task:

  • CE should be extended to request histograms for certain collections and paths, and use them when available.
  • Implement basic integration (JS) tests that test CE accuracy against data stored in a collection.
    • Statistics is built via an "analyze" command.
    • The JS tests use the golden-test framework implemented by SERVER-67415.


 Comments   
Comment by Githook User [ 03/Nov/22 ]

Author:

{'name': 'Alya Berciu', 'email': 'alya.berciu@mongodb.com', 'username': 'alyacb'}

Message: SERVER-68490 Robustify ce_histogram.js
Branch: master
https://github.com/mongodb/mongo/commit/fd269ec2272cddb55405efc17828fb88abd2d1f9

Comment by Githook User [ 02/Nov/22 ]

Author:

{'name': 'Alya Berciu', 'email': 'alya.berciu@mongodb.com', 'username': 'alyacb'}

Message: SERVER-68490 Remove ce_histogram.js log
Branch: master
https://github.com/mongodb/mongo/commit/ca80f7fd6d45668710fa836c8d35d7da43f0cab6

Comment by Githook User [ 26/Oct/22 ]

Author:

{'name': 'Alya Berciu', 'email': 'alya.berciu@mongodb.com', 'username': 'alyacb'}

Message: SERVER-68490 Complete integration of histogram CE
Branch: master
https://github.com/mongodb/mongo/commit/ccbc2b483f7ef25df8c9f35e58ce235909179f12

Generated at Thu Feb 08 06:10:57 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.