[SERVER-65239] Add diagnosability to operation metrics Created: 04/Apr/22 Updated: 29/Oct/23 Resolved: 24/May/22 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | 6.1.0-rc0 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Eric Milkie | Assignee: | Josef Ahmad |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||
| Backwards Compatibility: | Fully Compatible | ||||
| Sprint: | Execution Team 2022-05-02, Execution Team 2022-05-16, Execution Team 2022-05-30 | ||||
| Participants: | |||||
| Description |
|
A number of times now we have needed to diagnose the source of certain operation metrics based on database. Our existing tools to discern where metrics are being incremented are not sufficient to adequately diagnose Serverless issues from the field. One enhancement we can consider is using eBPF to trace operation metric calls. However, eBPF support needs fleshing out first. For now, I think it would be useful to have specific debug log lines near the calls to operation metric increments that could give information about the provenance of the call (thread id and some other local info that might be helpful). These log lines could be turned on and off at runtime for brief periods to help diagnose issues in the field. |
| Comments |
| Comment by Githook User [ 24/May/22 ] |
|
Author: {'name': 'Josef Ahmad', 'email': 'josef.ahmad@mongodb.com', 'username': 'josefahmad'}Message: |
| Comment by Eric Milkie [ 04/May/22 ] |
|
I was hoping we would backport this to 6.0 since it is only debug log statements. I can assist with the coding work if that will help expedite this. |
| Comment by Siyuan Zhou [ 04/May/22 ] |
|
milkie@mongodb.com, even if we go ahead with this ticket, that will still be delivered in 6.1. I'd hope USDT to be delivered in 6.1. On the serverless grooming meeting this Monday, chris.shum@mongodb.com and kevin.jernigan@mongodb.com agreed to bring the eBPF proposal and its server dependency to Service Arch's product managers. I'll follow up with them next week. |