Analyze real agent quality problems, compare fine-tuning methods, and match the right approach to each scenario.
Adventure Works operates a Trail Guide Agent for outdoor trip planning. The agent is experiencing three distinct quality problems. Each scenario presents real evaluation metrics, a quality challenge, and asks you to identify the best fine-tuning approach.
You can work through the scenarios in any order. Start with the one that matches a challenge you've encountered in your own work.
Gear specification responses vary unpredictably — sometimes vague, sometimes detailed. Customers asking similar questions get very different information quality.
Safety recommendations swing between alarmist and dismissive. Neither extreme supports Adventure Works' goal of encouraging safe outdoor activities.
Trip plans ignore how constraints interact — recommending wild camping for beginners, or exposed terrain in bad weather — rather than reasoning through trade-offs.