# Version 0.23.0

## Release Notes

We're proud to bring our latest 0.23.0 release!

We've worked hard on a new product feature that is unlocking huge potential within NannyML Cloud: custom metrics!

### Custom metrics support

NannyML Cloud includes a suite of performance metrics, but sometimes your use case requires a very specific one. The newly added support for custom metrics allows you to provide us with an implementation of your very own metric, so we can plug it into our algorithms for performance calculation and estimation. We support custom metrics for binary classification, multiclass classification and regression models.

If you are already monitoring models using NannyML Cloud, you can easily add new custom metrics to the monitoring workflow! \
\
In the custom metrics overview, you can create a new custom metric.

<figure><img src="/files/BdwxDqgj1d1OYc3jh6QN" alt=""><figcaption><p>Custom metrics overview</p></figcaption></figure>

For custom classification metrics, you'll have to provide one function to calculate the realized performance based on your model predictions, targets or any column available in NannyML Cloud. You can optionally provide an estimation function as well, which will then be plugged into our estimation algorithms.

<figure><img src="https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FwGuco8g4RjyWR8L8lmN8%2Fuploads%2FZ8iL8OVW2dnSF6LvoBNt%2F20240826-3.png?alt=media&#x26;token=c514bb6e-b228-4f0b-8cb1-3e1888beb132" alt=""><figcaption><p>Creating a new custom F2 metric for binary classification</p></figcaption></figure>

Once the custom metric has been created we'll assign it to our model.

<figure><img src="/files/7pwD4P6rl7K583kCXduF" alt=""><figcaption><p>Assigning a custom metric to our model</p></figcaption></figure>

The next time we calculate the model metrics, the custom metric will be included. You'll be able to see the results in the performance pane of the web application. You can also add it to your model dashboard or use it as a key performance metric!

<figure><img src="/files/qOdkCrdoUX3XZal02TZv" alt=""><figcaption><p>Enjoy your custom metrics in the performance pane!</p></figcaption></figure>

We've written a lot of documentation to get you started with custom metrics easily!&#x20;

Check out the [Creating Custom Metrics](/cloud/v0.24.1/model-monitoring/custom-metrics/creating-custom-metrics.md) guide to help you set up custom metrics for binary classification, multiclass classification or regression models. For a more advanced, real life example you can read the  [Advanced Tutorial: Creating a MTBF Custom Metric](/cloud/v0.24.1/model-monitoring/custom-metrics/creating-custom-metrics/advanced-tutorial-creating-a-mtbf-custom-metric.md).


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.nannyml.com/cloud/v0.24.1/miscellaneous/versions/version-0.23.0.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.