GenAI Operations (GenAIOps) Workload Labs

The following hands-on exercises provide practical experience with GenAI Operations patterns and practices. You’ll learn to deploy infrastructure, manage prompts, implement evaluation workflows, and monitor production GenAI applications using Microsoft Foundry and Azure services.

Note: To complete the exercises, you’ll need an Azure subscription with sufficient permissions and quota to provision Azure AI services and deploy Microsoft Foundry workspaces. If you don’t have an Azure subscription, you can sign up for an Azure account with free credits for new users.

Quickstart exercises

Infrastructure Setup

Deploy Microsoft Foundry resources and configure your development environment for building generative AI applications.

Develop prompt and agent versions

Create and deploy multiple versions of AI agents using prompt engineering and version management in Microsoft Foundry.

Manual evaluation workflows

Perform manual quality assessments of AI agents and compare different versions using structured evaluation criteria.

Automated Evaluation Pipelines

Set up automated evaluation using Microsoft Foundry SDK and configure GitHub Actions for continuous evaluation.

Safety Testing and Red Teaming

Implement automated safety monitoring systems, configure red teaming agents, and set up incident response procedures.

Production Deployment and Monitoring

Deploy agents to production environments, implement observability and alerting, and configure deployment strategies.

Note: While you can complete these exercises on their own, they’re designed to complement modules on Microsoft Learn; in which you’ll find a deeper dive into some of the underlying concepts on which these exercises are based.