[SERVER-65239] Add diagnosability to operation metrics Created: 04/Apr/22  Updated: 29/Oct/23  Resolved: 24/May/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 6.1.0-rc0

Type: Improvement Priority: Major - P3
Reporter: Eric Milkie Assignee: Josef Ahmad
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
Backwards Compatibility: Fully Compatible
Sprint: Execution Team 2022-05-02, Execution Team 2022-05-16, Execution Team 2022-05-30
Participants:

 Description   

A number of times now we have needed to diagnose the source of certain operation metrics based on database. Our existing tools to discern where metrics are being incremented are not sufficient to adequately diagnose Serverless issues from the field.

One enhancement we can consider is using eBPF to trace operation metric calls. However, eBPF support needs fleshing out first.

For now, I think it would be useful to have specific debug log lines near the calls to operation metric increments that could give information about the provenance of the call (thread id and some other local info that might be helpful). These log lines could be turned on and off at runtime for brief periods to help diagnose issues in the field.



 Comments   
Comment by Githook User [ 24/May/22 ]

Author:

{'name': 'Josef Ahmad', 'email': 'josef.ahmad@mongodb.com', 'username': 'josefahmad'}

Message: SERVER-65239 Add debug log observability of ResourceConsumption metrics
Branch: master
https://github.com/mongodb/mongo/commit/c1e0aec197cc6ba353328f944793a671f3856278

Comment by Eric Milkie [ 04/May/22 ]

I was hoping we would backport this to 6.0 since it is only debug log statements. I can assist with the coding work if that will help expedite this.

Comment by Siyuan Zhou [ 04/May/22 ]

milkie@mongodb.com, even if we go ahead with this ticket, that will still be delivered in 6.1. I'd hope USDT to be delivered in 6.1. On the serverless grooming meeting this Monday, chris.shum@mongodb.com  and kevin.jernigan@mongodb.com agreed to bring the eBPF proposal and its server dependency to Service Arch's product managers. I'll follow up with them next week.

Generated at Thu Feb 08 06:02:12 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.