View in Microsoft Foundry, powered by Application Insights, that tracks token consumption, latency, successful runs and evaluation scores and can raise alerts. It gives visibility at runtime and is not a gate for releases.
Read more: Microsoft Learn
In the Ultra Transcenders books
Each book explains Agent Monitoring Dashboard in context, with comparison tables and the common traps.
Terms in this definition
- View
Shows a system through one chosen group of related concerns. No view is generic; each one is tied to whichever architecture it depicts.
- Microsoft Foundry
Formerly called Azure AI Foundry, the Azure platform where AI models and agents are built, evaluated and run within one resource, with evaluations, guardrails and AI red teaming.
- Application Insights
APM service within Azure Monitor providing application telemetry, availability tests, usage analytics and Application Map. Data from workspace-based instances lives in Log Analytics.
- Token
The unit of text an LLM works with, which may be a word, part of a word or punctuation. Billing, limits and context windows are all counted in these units.
- Consumption
Serverless, event-driven Azure Functions hosting plan charged per execution; runs are capped at 10 minutes and VNet integration isn't available.
- Agents (classic) API
First-generation Foundry Agent Service API, based on threads, messages and runs. It is deprecated, replaced by conversations and responses, and retires on 31 March 2027.