Microsoft Copilot Studio Unveils Agent Evaluation and Enhanced Analytics
Microsoft Copilot Studio introduces agent evaluation and enhanced analytics to support makers across the AI agent lifecycle, from testing to deployment.
Microsoft Copilot Studio has announced two major updates aimed at improving the AI agent lifecycle: agent evaluation and enhanced analytics. These features are designed to help makers build, test, and deploy AI agents more effectively.
Key Updates
1. Agent Evaluation (Private Preview)
- Provides structured, automated testing workflows.
- Allows makers to simulate real user interactions at scale.
- Includes tools for uploading, generating, or reusing question sets to test accuracy and relevance.
- Results are displayed with clear pass/fail indicators and filterable views to identify weak spots.
2. Enhanced Analytics
- Offers post-publish visibility into agent performance.
- Tracks outcomes, analyzes interactions by triggers, and monitors action usage.
- Introduces user feedback for agent responses, allowing users to like/dislike replies, which is aggregated in analytics dashboards.
- Adds billing analysis at the agent level to assess efficiency and cost breakdowns by event types.
Integration with Viva Insights
The updates also include integration with Viva Insights, enabling businesses to evaluate the ROI of their agents in the context of broader organizational goals.
Microsoft Build 2025
These features will be showcased at Microsoft Build 2025, with sessions covering:
Learn More
For more details, visit:
By Eyal Zach, Principal PM Lead, Microsoft Copilot Studio
Related News
Microsoft Releases Open-Source AI Agent Framework
Microsoft unveils its open-source Agent Framework to streamline AI agent development with enterprise-ready tools and simplified coding.
GoDaddy Launches Trusted Identity System for AI Agents
GoDaddy introduces a trusted identity naming system for AI agents to verify legitimacy and ensure secure interactions as the AI agent landscape grows.
About the Author
Dr. Lisa Kim
AI Ethics Researcher
Leading expert in AI ethics and responsible AI development with 13 years of research experience. Former member of Microsoft AI Ethics Committee, now provides consulting for multiple international AI governance organizations. Regularly contributes AI ethics articles to top-tier journals like Nature and Science.