Performance

The Performance dashboard allows you to do an in-depth analysis of changes in model performance over time. If you prefer a video walkthrough, here is our guide explaining how to use the performance dashboard page:

Here, you can find detailed descriptions of various elements on the performance page:

Performance dashboard.

There are three main components to the Performance dashboard:

1. Filters:

1.1 Segments

Segmentation allows you to split your data into groups and analyze them separately.

For a given model, each of the columns that are selected for segmentation during configuration or in the model settings appears under the segmentation filter. Segments are then created for each of the distinct values within that column.

In the filter section, you can select the segments you want to see visualized. You can also select All data to visualize results for the entire dataset.

Select segments of interest

1.2 Metrics

You can select which metrics you want to display. Metrics that are not calculated/estimated are not visible under the filter. Selecting metrics to calculate/estimate can be done under model settings.

Performance metrics filter.

1.3 Performance type

You can select which performance type you want to be displayed. The options include estimated performance, realized performance, and the comparison plot of realized vs estimated performance.

Keep in mind that realized performance depends on the availability of targets in production, so it cannot always be calculated.

Performance type filter.

1.4 Alert status

Choose which metrics to display based on whether there are no alerts, alerts in any or only the last chunk, alerts in performance metric with the main tag, or include all charts regardless of when and if any alerts occurred.

Alert status filter.

1.5 Tags

Filter visualizations by the previously specified tags.

Tags filter.

2. Visualizations

2.1 Sort by

You can change the order of charts based on the metric name, number, or recency of the alerts.

Sort by window.

2.2 Ascending/descending order

For all sorting methods, the icons shown below toggle between ascending and descending order. The icon displayed depends on the selected sorting method.

• Metric Name: The icon toggles between alphabetical order and reverse alphabetical order. The default mode is alphabetical order.

• Nr of Alerts: The icon toggles between ascending and descending order based on the number of alerts. The default mode displays plots with the most alerts first.

• Recency of Alerts: The icon toggles between showing newer alerts first and older alerts first. The default mode shows the most recent alerts first.

Toggle for 'Nr of alerts'

Toggle for other sorting methods

2.3 Date range

You can select a specific period of interest which applies to all charts.

Date range selection.

2.4 Date reset

To reset a previously set date period, whether using the date range or slider, simply press the "Reset" button.

Date range reset.

2.5 Date slider

Similar to selecting a date range, you can choose a specific period of interest by simply moving the date slider.

Date slider.

2.6 Charts

The charts are interactive, allowing you to hover over them for more details. Red dotted lines indicate the thresholds, while the blue line shows the metric during the reference period. The light blue represents the metric during the analysis period. The lightly shaded area around the estimated results is the metric's confidence band.

You can also zoom in on any part of a chart. Simply press and hold your mouse button, then draw a square over your area of interest. To reset the zoom, just double-click on the chart.

Chart zoom.

3. Plot config

3.1 Plot format

There are two types of plot formats: line and step. A line plot smoothly connects points with straight lines to show trends, while a step plot uses sharp vertical and horizontal lines to show exact changes between points clearly.

3.2 Datasets

Select datasets to zoom in on reference, analysis, or create a separate subplot for both.

Datasets plots.

3.3 Plot elements

Toggle on or off some components on the charts, like alerts, confidence bands, thresholds, and legends.

Plot elements.