[Django] Verify Splunk alerting is properly surfaced to Slack

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Works as Designed
    • Priority: Minor - P4
    • None
    • Affects Version/s: None
    • Component/s: django
    • None
    • None
    • Python Drivers
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      Context

      INTPYTHON-530 set-up the django-mongodb-backend repo with performance monitoring. A Splunk alert was configured here based on the PyMongo alert here.

      SPS only surfaces data pertaining to mainline commits to Splunk (implementation) and change points are only created when a "meaningful difference" is detected. Change points are also sensitive to the number of commits made and may occur retroactively.

      A performance degradation was manually introduced (and later reverted) in PR #536 but did not surface any change points at the time. You can verify if a change point was made in the django-mongodb-backend project with the following Splunk query:

       

      index="server-tig-prod"
      (message="New change point detected." OR message="Change point h_score moved from -1 to a positive value.")
      | spath output=project path="change_point.time_series_info.project"
      | spath output=h_score path="change_point.h_score"
      | search project="django-mongodb-backend"

       

      Definition of done

      Confirm surfacing of a Django Splunk alert in #dbx-python-perf-notifications

      Pitfalls

      N/A

            Assignee:
            Sophia Yang
            Reporter:
            Sophia Yang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: