Loading...

Episode 502 - Azure Open AI and Security

Episode 502 - Azure Open AI and Security

Azure Open AI is widely used in industry but there are number of security aspects that must be taken into account when using the technology. Luckily for us, Audrey Long, a Software Engineer at Microsoft, security expert and renowned conference speaker, gives us insights into securing LLMs and provides various tips, tricks and tools to help developers use these models safely in their applications.

 

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode502.mp3

YouTube: https://youtu.be/64Achcz97PI

Resources:

AI Tooling:

  1. Azure AI Tooling Announcing new tools in Azure AI to help you build more secure and trustworthy generative AI applications | Microsoft Azure Blog
    • Prompt Shields to detect and block prompt injection attacks, including a new model for identifying indirect prompt attacks before they impact your model, coming soon and now available in preview in Azure AI Content Safety. 
    • Groundedness detection to detect “hallucinations” in model outputs, coming soon. 
    • Safety system messagesto steer your model’s behavior toward safe, responsible outputs, coming soon.
    • Safety evaluations to assess an application’s vulnerability to jailbreak attacks and to generating content risks, now available in preview.  
    • Risk and safety monitoring to understand what model inputs, outputs, and end users are triggering content filters to inform mitigations, coming soon, and now available in preview in Azure OpenAI Service.
  2. AI Defender for Cloud
  3.  AI Red Teaming Tool

AI Development Considerations:

 

  1. AI Assessment from Microsoft
  2. Microsoft Responsible AI Processes
  3. Define Use Case and Model Architecture
  4. Content Filtering System
  5. Red Teaming the LLM
  6. Create a Threat Model with OWASP Top 10

 

Other updates:

Published on:

Learn more
The Azure Podcast
The Azure Podcast

Short podcasts on various topics related to the Microsoft Cloud platform.

Share post:

Related posts

Building Event-Driven Go applications with Azure Cosmos DB and Azure Functions

The Go programming languageĀ is a great fit for building serverless applications. Go applications can be easily compiled to a single, staticall...

3 days ago

July Patches for Azure DevOps Server

Today we are releasing patches that impact the latest version of our self-hosted product, Azure DevOps Server. We strongly encourage and recom...

5 days ago

Azure SDK Release (June 2025)

Azure SDK releases every month. In this post, you'll find this month's highlights and release notes. The post Azure SDK Release (June 2025) ap...

12 days ago

Exploring azd extensions: Enhance your Azure developer experience

A deep dive into the introduction of the Azure Developer CLI (azd) extensions and the azd extension framework to build extensions. The post Ex...

14 days ago
Stay up to date with latest Microsoft Dynamics 365 and Power Platform news!
* Yes, I agree to the privacy policy