How vector search and semantic ranking improve your AI prompts
Improve the information retrieval process, so you have the most optimal set of grounding data needed to generate useful AI responses. See how Azure Cognitive Search combines different search strategies out of the box and at scale - so you don’t have to.
Keyword search—match the exact words to search your grounding data
Vector search—focuses on conceptual similarity, where the app is using part of the dialogue to retrieve grounding information
Hybrid approach—combines both keyword and vector searches
Semantic ranking—to boost precision, a re-ranking step can re-score the top results using a larger deep learning ranking model
Pablo Castro, Azure AI Distinguished Engineer, shows how to improve the quality of generative AI responses using Azure Cognitive Search.
► QUICK LINKS:
00:00 - How to generate high-quality AI responses
01:06 - Improve quality of generative AI outputs
02:56 - Why use vectors?
04:57 - Vector Database
06:56 - Apply to real data and text
08:00 - Vectors using images
09:40 - Keyword search
11:22 - Hybrid retrieval
12:18 - Re-ranking
14:18 - Wrap up
► Link References
Sample code available at https://aka.ms/MechanicsVectors
Complete Copilot sample app at https://aka.ms/EntGPTSearch
Evaluation details for relevance quality at https://aka.ms/ragrelevance
► Unfamiliar with Microsoft Mechanics?
As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.
• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries
• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog
• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast
► Keep getting this insider knowledge, join us on social:
• Follow us on Twitter: https://twitter.com/MSFTMechanics
• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/
• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/
• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics
Published on:
Learn more
Made for tech enthusiasts and IT professionals. Expanded coverage of your favorite technologies across Microsoft; including Office, Azure, Windows and Data Platforms. We'll even bring you broader topics such as device innovation with Surface, machine learning, and predictive analytics.
Related posts
Build your first Power App from data in seconds
Build a fully working model-driven app from your existing Dataverse, SharePoint, or SQL data in under a minute — screens, navigation, and form...
Microsoft Entra Suite hands-on tour of identity and network access protections
Unify identity and network access controls. Enforce least privilege access across every app and resource. Wire lifecycle workflows directly to...
New agentic platform in Dynamics 365 for Sales and Service
Qualify a lead, close a case, or walk into a renewal meeting fully briefed, all from the sales and service agents built into Dynamics 365. Ask...
Tokenomics | The new AI currency & your options explained
Control what you're billed on. Tokens are the currency of AI, and how you design your app determines how many you spend. Compress conversation...
Deploy Windows updates to counter AI-discovered threats
The speed that AI can now discover and exploit vulnerabilities means that our defenses also need to adjust. For the devices that you manage wh...
Zero Trust security for AI agents
Apply Zero Trust controls to every AI agent in your environment across identity, tool usage, and data access. Extend Conditional Access in Mic...
Secure containers from code to runtime | Microsoft Defender
Secure containerized apps end-to-end using Microsoft Defender for Cloud. Correlate cross-cloud attacks into a single incident, catch runtime t...
New Security Controls in Edge for Business
Enforce your existing Microsoft security policies directly in the browser, where your users actually work, using Microsoft Edge for Business. ...
Build Agent Architecture using AI Landing Zones
Build enterprise-ready AI agents that scale without sacrificing security or control using Microsoft Azure. Establish a shared Governance Hub t...
Find and fix app issues - Azure Copilot Observability Agent
Cut through alert noise and move from detection to root cause using the Azure Copilot Observability Agent. It autonomously investigates incide...