[SERVER-73152] Literal and field name redaction for aggregate command Created: 20/Jan/23  Updated: 07/Feb/24  Resolved: 23/May/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.1.0-rc0

Type: Task Priority: Major - P3
Reporter: Joshua Lapacik (Inactive) Assignee: Will Buerger
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on SERVER-75139 Add shapification for DocumentSources... Closed
depends on SERVER-76367 Introduce interface to abstract out q... Closed
is depended on by SERVER-75512 Store a hashed telemetry key rather t... Closed
is depended on by SERVER-75596 Stress $queryStats read path for aggr... Closed
is depended on by SERVER-77325 Aggregate shapification on mongos Closed
is depended on by SERVER-85075 Tracking: Milestone 2 Closed
is depended on by SERVER-76145 Refactor telemetry key Closed
Assigned Teams:
Query Optimization
Backwards Compatibility: Fully Compatible
Sprint: QO 2023-05-15, QO 2023-05-29
Participants:

 Description   

 

db.runCommand(
   {
     aggregate: "<collection>" || 1,
     pipeline: [ <stage>, <...> ],
     explain: <boolean>,
     allowDiskUse: <boolean>,
     cursor: <document>,
     maxTimeMS: <int>,
     bypassDocumentValidation: <boolean>,
     readConcern: <document>,
     collation: <document>,
     hint: <string or document>,
     comment: <any>,
     writeConcern: <document>,
     let: <document> // Added in MongoDB 5.0
   }
) 

The fields aggregate, pipeline, explain, allowDiskUse, collation, hint, and let are part of the query shape and will be abstracted as such. The remaining field values should have literals abstracted.

 



 Comments   
Comment by Githook User [ 07/Feb/24 ]

Author:

{'name': 'Erin Zhu', 'email': 'erin.zhu@mongodb.com', 'username': 'erinzhu001'}

Message: SERVER-86298 QueryStats Backport to 7.0 Batch #3

Includes backports of the following
SERVER-76866 change TODO ticket number
SERVER-76557: Keep RequestShapifiers in telemetry store
SERVER-76143 Add missing find command fields to queryStats key
SERVER-75512 key telemetry store on hash rather than BSONObj
SERVER-76947 remove unimplemented tassert for $cursor shapification
SERVER-76427 Rename $telemetry to $queryStats
SERVER-76042 Avoid re-parsing for the purpose of telemetry
SERVER-73152: Aggregation shapification for query stats
SERVER-75597 Include 'crs' in geo serialization with queryStats options
SERVER-76919 add gen command fields to queryStats key
SERVER-77350: Update query stats sampling rate parameter name
SERVER-76555 Stress-test $queryStats in core passthrough
SERVER-77407 uassert on BSONObj or string for $hint field in queryShape
SERVER-77430 Allow coordinates" to be optional"
SERVER-77485 Avoid unnecessary ExpressionContext re-construction
SERVER-77190 Include the whole client metadata in telemetry key, not just appName
SERVER-77626 Exclude test checking opcounters from queryStats suite
SERVER-77179: Update $queryStats parameters
and enterprise commits for
SERVER-76947 shapify $search and $backupCursorExtend
SERVER-76427: Rename $telemetry to $queryStats
SERVER-76531: Test that mongos does not collect telemetry for queryable encryption collections
SERVER-73152: Aggregation shapification for query stats
SERVER-77350: Update query stats sampling rate parameter name
SERVER-77190 Include the whole client metadata in telemetry key, not just appName
GitOrigin-RevId: 23ee70f6e72c9cf2fa79558fde10f6ecb42d9cf3
Branch: v7.0
https://github.com/mongodb/mongo/commit/30a74813261ead3652652c7afa50b0b6f243e15c

Comment by Githook User [ 22/May/23 ]

Author:

{'name': 'Will Buerger', 'email': 'will.buerger@mongodb.com', 'username': 'wbuerger46'}

Message: SERVER-73152: Aggregation shapification for query stats
Branch: master
https://github.com/mongodb/mongo/commit/54c12f066744ac759edafd52794ad5731f5bb72d

Generated at Thu Feb 08 06:23:49 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.