# Version 0.23.0

## Release Notes

We're proud to bring our latest 0.23.0 release!

We've worked hard on a new product feature that is unlocking huge potential within NannyML Cloud: custom metrics!

### Custom metrics support

NannyML Cloud includes a suite of performance metrics, but sometimes your use case requires a very specific one. The newly added support for custom metrics allows you to provide us with an implementation of your very own metric, so we can plug it into our algorithms for performance calculation and estimation. We support custom metrics for binary classification, multiclass classification and regression models.

If you are already monitoring models using NannyML Cloud, you can easily add new custom metrics to the monitoring workflow! \
\
In the custom metrics overview, you can create a new custom metric.

<figure><img src="https://content.gitbook.com/content/KQb5UiQca9y5CPVJ4aR8/blobs/EvSorvBbQl1mRhGO2JWX/image.png" alt=""><figcaption><p>Custom metrics overview</p></figcaption></figure>

For custom classification metrics, you'll have to provide one function to calculate the realized performance based on your model predictions, targets or any column available in NannyML Cloud. You can optionally provide an estimation function as well, which will then be plugged into our estimation algorithms.

<figure><img src="https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FwGuco8g4RjyWR8L8lmN8%2Fuploads%2FZ8iL8OVW2dnSF6LvoBNt%2F20240826-3.png?alt=media&#x26;token=c514bb6e-b228-4f0b-8cb1-3e1888beb132" alt=""><figcaption><p>Creating a new custom F2 metric for binary classification</p></figcaption></figure>

Once the custom metric has been created we'll assign it to our model.

<figure><img src="https://content.gitbook.com/content/KQb5UiQca9y5CPVJ4aR8/blobs/PDIre2cwnEKyB14ThRMK/image.png" alt=""><figcaption><p>Assigning a custom metric to our model</p></figcaption></figure>

The next time we calculate the model metrics, the custom metric will be included. You'll be able to see the results in the performance pane of the web application. You can also add it to your model dashboard or use it as a key performance metric!

<figure><img src="https://content.gitbook.com/content/KQb5UiQca9y5CPVJ4aR8/blobs/5Kl5782pISX0lOwJgqfR/image.png" alt=""><figcaption><p>Enjoy your custom metrics in the performance pane!</p></figcaption></figure>

We've written a lot of documentation to get you started with custom metrics easily!&#x20;

Check out the [creating-custom-metrics](https://docs.nannyml.com/cloud/v0.24.2/model-monitoring/custom-metrics/creating-custom-metrics "mention") guide to help you set up custom metrics for binary classification, multiclass classification or regression models. For a more advanced, real life example you can read the  [advanced-tutorial-creating-a-mtbf-custom-metric](https://docs.nannyml.com/cloud/v0.24.2/model-monitoring/custom-metrics/creating-custom-metrics/advanced-tutorial-creating-a-mtbf-custom-metric "mention").
