Alerting

Use Gantry alerts to notify you when your model’s data or performance has shifted.

Alerts provide a way to automatically get notified when your model exhibits undesirable behavior, however you choose to define that.

In this section we show how to define an alert on the data that the previous two sections showed how to gather and analyze.

Create an Alert

Start creating an alert from the application detail page by clicking on Create Alert + from the Alerts page. Find the alerts page from the sidebar.

28782878

Alerts have a Metric, Name, Evaluation Window, Delay Time, and Range. They are configured in the alert panel:

12041204

Metric is what you’re alerting on, Evaluation Window determines the timerange, and Range sets the values used to determine whether the alert should trigger. For example, the following alert, “Max loans”, will alert if the maximum inputs.loan_amount is outside of the range 0 - 18,000 for longer than 5 minutes:

11961196

Evaluation Delay refers to when an alert will evaluate. Do not adjust if you intend to be creating real-time alerts. Use it if you intend to evaluate past or batch data.

Understanding When Alerts Evaluate

Since Gantry allows you to ingest historical data, there are two parameters to configure for alerts: Evaluation window and Evaluation delay. Evaluation window determines the time window of data to compute the alert metric on. Evaluation delay can be optionally configured to determine how long the system will wait for data to come in before evaluating a window.

For example, if the Evaluation window is 15 minutes and the Evaluation delay is 30 minutes, then at 12 pm, the alert will evaluate data between 11:15am and 11:30am.

10231023

Alert notifications

Gantry will send daily alerts to a slack channel of your choosing. This is currently the best way to receive alerts for your application.

To send notifications, set up a notification channel from the alerts panel. This panel can be found by creating a new alert or editing an existing one.

13361336

Each notification has a daily notification time and webhook. For example, the following notification will use the alerts-max-loan-channel webhook and send a daily notification at 5:00 PM UTC:

11981198

📘

Slack webhooks

To receive Slack messages, you'll need to configure a Slack webhook. Slack gives instructions on how to do that here.

Viewing and editing alerts

Alerts and their statuses can be viewed from the alert page:

28682868

If you'd like to edit an alert or its notifications, click the horizontal ellipsis at the end of the row:

27442744

If you'd like to delete an alert, click the horizontal ellipsis at the end of the row and confirm your choice:

10901090