GPT-4 Turbo with Vision + Azure AI Vision
Build and deploy copilot style apps that leverage the power of both GPT-4 Turbo with Vision and Azure AI Vision and Search in Microsoft’s Azure AI Studio. Enable direct lookups from image inputs over your organizational data to ground generative AI responses. This marks a significant improvement in the accuracy of natural language processing and image recognition tasks to enable new generative AI scenarios. Video inputs are also uniquely supported when you combine GPT-4 Turbo with Vision and Azure AI Vision.
Seth Juarez, Principal Program Manager for Azure AI, shares how it’s easy to build and orchestrate powerful copilot style apps.
► QUICK LINKS:
00:00 - GPT-4 Turbo with Vision + Azure AI Vision
00:42 - Baseline capabilities of GPT-4 Turbo with Vision
02:43 - Direct lookups of image and video data
04:53 - See the two combined: Demo
05:52 - How to build it
07:17 - See the code behind your app
08:07 - Wrap up
► Link References
Start using Azure AI Studio today at https://ai.azure.com
Watch a detailed overview at https://aka.ms/AzureAIStudioMechanics
Check out our QuickStart guides at https://aka.ms/LearnAIStudio
► Unfamiliar with Microsoft Mechanics?
As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.
• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries
• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog
• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast
► Keep getting this insider knowledge, join us on social:
• Follow us on Twitter: https://twitter.com/MSFTMechanics
• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/
• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/
• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics
Published on:
Learn more
Made for tech enthusiasts and IT professionals. Expanded coverage of your favorite technologies across Microsoft; including Office, Azure, Windows and Data Platforms. We'll even bring you broader topics such as device innovation with Surface, machine learning, and predictive analytics.
Related posts
Build your first Power App from data in seconds
Build a fully working model-driven app from your existing Dataverse, SharePoint, or SQL data in under a minute — screens, navigation, and form...
Microsoft Entra Suite hands-on tour of identity and network access protections
Unify identity and network access controls. Enforce least privilege access across every app and resource. Wire lifecycle workflows directly to...
New agentic platform in Dynamics 365 for Sales and Service
Qualify a lead, close a case, or walk into a renewal meeting fully briefed, all from the sales and service agents built into Dynamics 365. Ask...
Tokenomics | The new AI currency & your options explained
Control what you're billed on. Tokens are the currency of AI, and how you design your app determines how many you spend. Compress conversation...
Deploy Windows updates to counter AI-discovered threats
The speed that AI can now discover and exploit vulnerabilities means that our defenses also need to adjust. For the devices that you manage wh...
Zero Trust security for AI agents
Apply Zero Trust controls to every AI agent in your environment across identity, tool usage, and data access. Extend Conditional Access in Mic...
Secure containers from code to runtime | Microsoft Defender
Secure containerized apps end-to-end using Microsoft Defender for Cloud. Correlate cross-cloud attacks into a single incident, catch runtime t...
New Security Controls in Edge for Business
Enforce your existing Microsoft security policies directly in the browser, where your users actually work, using Microsoft Edge for Business. ...
Build Agent Architecture using AI Landing Zones
Build enterprise-ready AI agents that scale without sacrificing security or control using Microsoft Azure. Establish a shared Governance Hub t...
Find and fix app issues - Azure Copilot Observability Agent
Cut through alert noise and move from detection to root cause using the Azure Copilot Observability Agent. It autonomously investigates incide...