Microsoft Copilot Studio – Automatic Evaluation from the Test Pane
We are announcing the ability to automatically evaluate each user query and agent response during testing using the General Quality Grader in Microsoft Copilot Studio. This feature will reach general availability on April 30, 2026. How does this affect me? Users will be able to enable an opt-in toggle in the Test Pane to automatically evaluate every interaction while testing their agent. Evaluations will run in the background and provide real-time quality feedback without requiring manual execution. This will allow users to identify and address response quality issues earlier in the build process before publishing. What action do I need to take? This message is for awareness, and no action is required. Message ID: MC1289783
The post Microsoft Copilot Studio – Automatic Evaluation from the Test Pane appeared first on M365 Admin.
Published on:
Learn more
Related posts
Microsoft Copilot Studio – Group and analyze the performance of user questions by themes
We are announcing the ability to group and analyze the performance of user questions by themes in Microsoft Copilot Studio. This feature will ...
Microsoft Copilot in Dynamics 365 Customer Engagement: Where Teams See the Most Value
Artificial intelligence, particularly Microsoft Copilot in Dynamics 365 Customer Engagement, is quickly becoming part of everyday work across ...
Microsoft Copilot (Microsoft 365): Additional meeting results in Copilot responses
Today, Copilot can show up to 25 meeting results, which can limit visibility in larger calendars. We’re expanding this limit so you can see mo...
Microsoft Copilot (Microsoft 365): Copilot improved long files navigation using document structure, enabling more accurate answers and clearer citations
We’ve improved how Copilot reads long and complex files by making it more aware of document structure. When you ask a question, Copilot can no...
New IT admin policy: Remove Microsoft Copilot app
Improve user experience with a single Microsoft Copilot app to use on any given device. The new RemoveMicrosoftCopilotApp polic...
Microsoft Copilot (Microsoft 365): Proactive push notifications for the Microsoft 365 Copilot mobile app
The Microsoft 365 Copilot mobile app will proactively send push notifications for common productivity workflows like ‘Your Day at a Glan...
Microsoft Copilot (Microsoft 365): Create a presentation with Copilot in PowerPoint directly from the PowerPoint Home
You can now create a presentation with Copilot in PowerPoint straight from the PowerPoint Home in file menu. Product PowerPoint Release phase ...
Microsoft Copilot (Microsoft 365): Create a presentation with Copilot in PowerPoint directly from the PowerPoint Web App
You can now create a presentation with Copilot in PowerPoint just as you open the PowerPoint web app. Product PowerPoint Release phase General...