> For the complete documentation index, see [llms.txt](https://docs.nannyml.com/cloud/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.nannyml.com/cloud/v0.20.2/product-tour/model-side-panel/model-settings.md).

# Model settings

Under model settings, you can find all the monitoring parameters of a selected model. These settings are specific to a single model and are not confused with the general NannyML settings in the navbar.

On the left side, you can navigate through the different configuration groupings. There is also a "Run now" button to trigger a new NannyML run. This might be useful after some of the parameters are updated.

<figure><img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2Fxt3TiK6PNXfuLn9J6Cdr%2Fmodel_setting_page.png?alt=media&amp;token=b389db20-3841-4c3f-81bb-ba5cf84f815b" alt=""><figcaption><p>Model settings page.</p></figcaption></figure>

<details>

<summary>General details</summary>

Here, you can change the name of your model.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FLUvCh3Zs987jShXeVH1o%2Fgeneral_details.png?alt=media&amp;token=7d2b608e-71fa-4243-8534-04e3c3e6aa4a" alt="" data-size="original">

</details>

<details>

<summary>Datasets</summary>

Under datasets, you can manually add more analysis and target data.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FGJa3foL1YsgjQ45jovoa%2Fdatasets.png?alt=media&amp;token=7e55a95b-ab60-47d7-806f-526277083d7f" alt="" data-size="original">

</details>

<details>

<summary>Schedule</summary>

Under schedule, you can define when to run the drift and metric calculators.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2F9R4CD2qWfQ9eV8PT0XeP%2Fschedule.png?alt=media&amp;token=3ff8501f-0fcc-4802-8a89-4349aac1a68e" alt="" data-size="original">&#x20;

</details>

<details>

<summary>Chunking</summary>

Here, you can choose how to group the results by time interval or size. For example, choosing "monthly" groups all predictions made in the same month and calculates the results. <br>

:bulb: We currently only support **time-based** and **size-based** chunking; if you need support for  number-based chunking, [contact us](https://www.nannyml.com/contact-us).

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FLySqdxoeGp9ZYTj1RAGp%2FScreenshot_20240304_145808.png?alt=media&amp;token=edc5dfa2-a2aa-45f5-b79d-25a4384ffa41" alt="" data-size="original">

</details>

<details>

<summary>Performance</summary>

Here, you can select the metrics you want to monitor. There is also the option to configure them further. The metrics will either be calculated and/or estimated depending on the selected performance types. Calculating metrics and thus measuring realized performance is only possible if targets are supplied.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FxK7dQHWnSIwEInIz1feB%2Fperformance.png?alt=media&amp;token=8bbf7973-822e-4ec8-9d3a-4f8f0da9c5b8" alt="" data-size="original">

Under every metric configuration, it is possible to specify further if this metric has to be calculated and/or estimated. NannyML automatically extracts thresholds based on the supplied reference data, but it is possible to configure a custom threshold here. All metrics follow this type of configuration except business value.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2Fec2pwLmM7bG3XR7YOHLh%2Fperformance_config.png?alt=media&amp;token=92b03a92-0228-4d87-b827-0223c119c736" alt="" data-size="original">

There are two types of threshold constants and standard deviation-based thresholds:&#x20;

![](https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FJU6AAUXmhiBvgP1qdihN%2Fthresholds.png?alt=media\&token=46417a52-a4b8-483a-80d4-0c468da8bac1)

For business value estimation or calculation, a cost/benefit matrix has to be supplied. This matrix contains the value a single observation in each of the cells of the respective confusion matrix cells brings in or costs. For example, a true positive prediction brings in X amount, and a false positive prediction will cost us Y.

![](https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FYbX8dOJu3jgVJGdqfpXw%2Fbusiness_value.png?alt=media\&token=43715b90-f8f5-4b3e-95c4-530ce019476c)

</details>

<details>

<summary>Concept shift</summary>

Here, you can specify which concept shift results to run and configure the threshold values.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2Fr5uvftdepwr79ZBqI3gc%2Fconcept_shift_settings.png?alt=media&amp;token=f9985c73-ecb2-4bea-8bba-ea2424e482ee" alt="" data-size="original">

</details>

<details>

<summary>Covariate shift</summary>

In covariate shift settings, you can specify which drift methods to run and also configure the threshold values.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FNLUy3knKkYVcWWYvXVll%2Fcovariate_shift_settings.png?alt=media&amp;token=9afd3da1-9a0a-4abf-98d9-1d33018f3e93" alt="" data-size="original">

Some methods work for categorical and continuous columns; in that case, it can be selected which of those they must run. Also, the threshold can be manually configured.&#x20;

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FcQcRVPBrpOSUpamU3zDA%2Fjs_config.png?alt=media&amp;token=77a8b158-ed32-4726-a95e-c078e78e84e0" alt="" data-size="original">

</details>

<details>

<summary>Data quality</summary>

Here, you can select the type of data quality checks and their threshold values.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FtV0KCwR2wjktTJCdKQzE%2Fdata_quality_settings.png?alt=media&amp;token=08310c99-aad8-45c6-87a7-747c316cd9a6" alt="" data-size="original">

Both missing values and unseen values can be normalized along with default thresholds.

<img src="https://2363051145-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWcs3xQupCdtvmF6k2Sun%2Fuploads%2FSzPCk1dhZxPYFQDm4qJ9%2Funseen_values_settings.png?alt=media&amp;token=8d1c7b1f-ca9b-4b49-863e-342ed29bfa7c" alt="" data-size="original">

</details>
