AI Builder – Optimize AI-driven outcomes with prompt evaluations
We are announcing the ability to optimize AI-driven outcomes with prompt evaluations in AI Builder. This feature will reach general availability on September 15, 2025. How does this affect me? This feature enables you to build a test suite to check your prompt performance across different stages of prompt development. As you create or refine prompts, the feature analyzes the prompt structure, language, and relevance to the task. It assigns a confidence score to each test case prediction that shows the expected performance of the prompt. With this score, you receive actionable insights to improve prompt phrasing or reduce ambiguity. What action do I need to take? This message is for awareness and no action is required. If you would like more information on this feature, please visit the Optimize AI-driven outcomes with prompt evaluations learn article. Message ID: MC1136345
The post AI Builder – Optimize AI-driven outcomes with prompt evaluations appeared first on M365 Admin.
Published on:
Learn more
Related posts
How to Automate Image Descriptions with AI Builder in Power Automate
In today’s fast-paced digital world, automating repetitive tasks not only saves time but also significantly improves productivity. Microsoft n...
Upcoming AI Builder Licensing Changes
From November 1st, 2025, Microsoft will introduce significant changes for AI Builder credits, used by AI Builder for automated data intelligen...
Automate Multilingual Email Acknowledgments in Dynamics 365 with AI Builder Language Detection
Tired of manually responding to emails in different languages? If you’re using Dynamics 365 and your team receives customer emails in multiple...
How to Use Copilot Custom Prompts and AI Builder in Dynamics 365 Sales
This blog builds on our previous article, How to Configure and Use the Prompt Column in Dataverse, which you can read here. While that post fo...
AI Builder – Use your own generative AI model from Azure AI Foundry in Prompt builder in Copilot Studio
We are announcing the ability to use your own generative AI model from Azure AI Foundry in prompt builder. This feature has reached general av...
AI Builder – Enhance document processing efficiency with an agent
We are announcing the ability to enhance document processing efficiency with an agent in AI Builder. This feature will reach general availabil...
AI Builder – Review AI generated content with validation station
We are announcing the ability to review AI prompts, inputs, and responses with validation station in AI Builder. This feature will reach gener...
AI Builder – Enhance automated document processing with validation station
We are announcing the ability to review, verify, and correct data extracted from documents before final submission or integration using the va...
AI Builder – Process documents with Copilot prompts
We are announcing the ability to use prompts in Copilot agents to extract and augment information from documents in AI Builder. This feature w...