[COMPASS-7423] Investigate changes in PM-3268: Add data-bearing node metrics to query shape stats Created: 07/Nov/23  Updated: 06/Feb/24  Resolved: 19/Jan/24

Status: Closed
Project: Compass
Component/s: None
Affects Version/s: None
Fix Version/s: No version

Type: Investigation Priority: Major - P3
Reporter: Backlog - Core Eng Program Management Team Assignee: Unassigned
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Epic Link: COMPASS-7048
Documentation Changes: Not Needed

 Description   
Original Downstream Change Summary

The $queryStats aggregation stage will expose new metrics for keysExamined and others. No changes will be made to existing metrics returned.

Description of Linked Ticket

Epic Summary

Summary

Add support for telemetry metrics like 'keysExamined' which must be collected on nodes that execute queries against the storage layer.

Motivation

Query execution metrics like number of index keys scanned are important for understanding query performance and index quality for a given workload. These metrics can only be measured on the data-bearing nodes where a query is executed against the storage layer.

In replica sets and single-shard deployments, these metrics could be collected identically to the router metrics that were added in PM-2885. In more complex multi-shard topologies, however, there needs to be a way to correlate router-collected metrics with data node-collected metrics for a given user query that is resilient to node restarts.

Documentation

Product Description
Scope
Technical Design
Docs Update



 Comments   
Comment by PM Bot [ 06/Feb/24 ]

Fix Version updated for upstream PM-3268:
8.0 Targeted

Comment by PM Bot [ 02/Feb/24 ]

Fix Version updated for upstream PM-3268:
8.1 Targeted

Comment by Anna Henningsen [ 19/Jan/24 ]

No impact

Comment by PM Bot [ 14/Nov/23 ]

Fix Version updated for upstream PM-3268:
8.0 Targeted

Generated at Wed Feb 07 22:46:30 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.