Trace Your AI Applications and Collect User Feedback
Learn to implement OpenTelemetry tracing for AI applications using Azure AI Foundry, including automatic instrumentation and user feedback collection.

Lab overview
OpenTelemetry tracing is an observability framework that captures telemetry data from AI applications by automatically recording API calls, timing, and custom events. Azure AI Foundry integrates with OpenTelemetry to monitor AI model calls and application behavior, helping organizations track performance and debug issues in production environments.
In this lab, you will implement OpenTelemetry tracing for AI applications using Azure AI Foundry and collect user feedback data. You'll learn how to set up automatic instrumentation for AI model calls, create custom spans and attributes for application context, and implement user feedback collection to track user satisfaction alongside technical metrics.
Objectives
By completing this intermediate level lab, you will be able to:
- Configure Azure AI Foundry environment with Application Insights for telemetry collection
- Deploy AI models and set up authentication for development environments
- Implement automatic OpenTelemetry instrumentation for OpenAI SDK to capture API calls and conversation content
- Create custom spans and attributes to add application context to traces
- View trace data in Azure AI Foundry portal including spans, attributes, and events
Who is this lab for?
- Software developers building AI-powered applications who need to implement production-ready observability
- DevOps engineers responsible for monitoring and maintaining AI applications in cloud environments
- AI/ML engineers who want to understand how their models perform in real-world user interactions
- Site reliability engineers focused on ensuring AI application performance and user experience
- Technical architects designing observability strategies for enterprise AI solutions
- Product managers who need to understand user satisfaction and AI application performance metrics
Verified against your live environment
An automated validation engine inspects your actual resources and configurations as you work. Completion means the task was performed, not multiple choice, real-world proficiency.
More labs like this
Explore Azure AI Speech Capabilities in Azure AI Foundry
Explore Azure AI Speech text-to-speech, speech-to-text, translation, and pronunciation assessment features using Azure AI Foundry portal interface.
Convert Text to Speech and Speech to Text with Azure AI Speech SDK in Python
Learn to implement text-to-speech synthesis and speech recognition using Azure AI Speech SDK in Python for voice-enabled applications.
Analyze Text Using Azure AI Language SDK in Python
Learn to extract key phrases, recognize entities, and detect PII in text using Azure AI Language SDK in Python for document analysis and privacy compliance.
Related reading
Environment
Every lab includes
- Real environment, pre-credentialed
- Automated checks on every step
- Isolated sandbox, auto cleanup
- AI-recommended next steps
Lab curriculum
- 01
Logging into Azure Account using Azure Portal
- 02
Enable Tracing in Your Project
1 automated check
- 03
Instrument the OpenAI SDK
1 automated check
- 04
Add Custom Spans and User Feedback
1 automated check
Skills validated
Not the lab you were looking for?
Browse 250+ hands-on labs across AWS, Azure, Kubernetes, Docker, and cloud security.