Run an Automated Evaluation in Azure AI Studio

Post Content

​ Automated measurement is useful for measuring at scale with increased coverage to provide comprehensive results. It’s also helpful for ongoing measurement to monitor for any regression as the system, usage, and mitigations evolve.

In this demo, we’ll demonstrate how to create, configure, and run an automated evaluation in Azure AI Studio.

Disclosure: This demo contains an AI-generated voice.

Chapters:
00:00 – Introduction
00:59 – Create a new evaluation
01:52 – Review evaluation results

Resources:
Azure AI Studio – https://www.ai.azure.com
Responsible AI Developer Resources – https://aka.ms/operationalize-rai
To learn more about Harm Categories and Severity Levels – https://www.aka.ms/rai-harm-categories   Read More Microsoft Developer