Add Metric for Number of Queued Index Builds

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Storage Execution
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description:

      Enhance monitoring by adding a metric to track the number of queued index builds. This will provide better observability into server behavior when many createIndex requests are queued, helping diagnose issues related to excessive resource consumption and potential memory overhead.

      Context:

      Currently, concurrent createIndex requests are queued if there are more than maxNumActiveUserIndexBuilds running. These queued requests:

      • Consume significant memory resources.
      • Count as active connections, even if clients disconnect.

      This can lead to:

      • Out of Memory (OOM) conditions due to memory usage by queued requests.
      • Denial of Service (DOS) scenarios as maxConns may be exhausted because queued requests occupy active connection slots.

      Proposed Solution:

      Add a new metric to track the number of queued index builds. This metric would help:

      • Detect spamming scenarios by monitoring growth trends in queued createIndex requests.
      • Diagnose issues related to high memory consumption or connection exhaustion.
      • Improve overall visibility into internal behavior when index builds are queued.

            Assignee:
            Unassigned
            Reporter:
            Ernesto Rodriguez Reina
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: