Azure portal April 2023 updates
Analytics > Azure Stream Analytics
Analytics > Azure Stream Analytics
Intune
Let's look at each of these updates in greater detail.
Analytics > Azure Stream Analytics
Simulate a Stream Analytics job running topology before deployment
Before you start running your Stream Analytics job, it's crucial to check your query logic and find out the number of streaming units needed to handle the job's workload. This is where the Job Simulation feature comes in handy. It allows you to adjust the number of streaming units and simulate the job running topology, giving you an idea of how computing resources are allocated and utilized across the streaming nodes. The Job Simulation also provides suggestions for improving your query to make your job parallel. With this feature, you can ensure that your Stream Analytics job will use computing resources efficiently with the best performance.
To make the best use of this feature, it's recommended to use it through the Azure Stream Analytics extension on Visual Studio Code. Refer to this article for more information: Optimize query performance using job diagram simulator (preview) | Microsoft Learn
To use the job simulation feature, you can access it through the Azure Stream Analytics portal.
- Open your Stream Analytics job in the Azure portal.
- Click on 'Query' on the TOC, and select 'Job simulation' on the query editor. It will generate a visual representation of your job topology based on the query and predefined streaming units.
- Drag the 'Streaming Units' bar to see how streaming nodes are being allocated to your job. Then you can decide the number of SUs needed to handle your workload.
- Click on 'Expand All' to see how the data stream would be processed at processor level.
- If your job is not fully parallel, the 'Enhancements' tab will provide suggestions for improving your query.
- If you make any changes to the query, remember to select 'Refresh simulation' to update the simulation.
In conclusion, the Job Simulation feature in Azure Stream Analytics ensures that your job is executing in parallel and distributing the workload evenly across the streaming nodes. By leveraging its capabilities, you can achieve efficient and reliable data processing and ultimately unlocking the full potential of Azure Stream Analytics.
Analytics > Azure Stream Analytics
Optimize Stream Analytics job performance using the Job Diagram feature
When creating a Stream Analytics job, it's important to ensure that your job is parallel, and your query logic is optimized for performance and scalability. One tool that can help you achieve this is the Job Diagram feature in the Azure Stream Analytics portal.
The Job Diagram provides a visual representation of your entire job topology. It displays the data flow between the streaming nodes, which makes it easy to understand the job logic and parallelism. It also shows real-time metrics for each streaming node, such as the number of input events and watermark delay. By utilizing this feature, you can easily identify the bottlenecks and pinpoint the root cause of any performance issues.
To learn more about the Azure Stream Analytics' Job Diagram feature, check out this doc: Optimize job performance using the Job Diagram - Azure Stream Analytics | Microsoft Learn
To use the Job Diagram feature in the Azure portal:
- After you start running your Stream Analytics job in the Azure portal, click on 'Job Diagram' from the left side menu to see your job running topology.
- Edit the Heatmap settings' to highlight the metrics you are interested in. For example, if you want to highlight the streaming nodes with high watermark delay, enter a threshold in the Heatmap settings to update the Job Diagram.
- Click 'Add metric' to add another metric to the chart. Or you can 'Add chart' with the metrics you wanted to look at.
- Select one of the streaming nodes in the canvas to open its processor-level diagram. This will give you an idea of how the data is being processed at processor level.
In summary, the Job Diagram feature is a powerful tool for optimizing your Stream Analytics jobs. By leveraging its insights and making informed optimizations, you can unlock the full potential of your streaming analytics workloads, achieving better parallelism and delivering high-performance data processing.
The Microsoft Intune team has been hard at work on updates as well. You can find the full list of updates to Intune on the What's new in Microsoft Intune page, including changes that affect your experience using Intune.
Azure portal “how to” video series
Have you checked out our Azure portal “how to” video series yet? The videos highlight specific aspects of the portal so you can be more efficient and productive while deploying your cloud workloads from the portal. Check out our most recently published videos.
Next steps
The Azure portal has a large team of engineers that wants to hear from you, so please keep providing us your feedback in the comments section below or on Twitter @AzurePortal.
Sign in to the Azure portal now and see for yourself everything that’s new. Download the Azure mobile app to stay connected to your Azure resources anytime, anywhere. See you next month!
Published on:
Learn moreRelated posts
Azure Landing Zones - Policy Refresh Q1 FY25
ALZ - Policy Refresh Q1 FY25 is here! As you may be aware, the ALZ team release cadence is now on quarterly basis to help customers and partne...
Custom Policy- Reusable Logs Templates
Reusable Templates for Sending Logs to Log Analytics Workspace Challenge: When it comes to developing custom policies for sendin...
Enhancements to Azure Monitor Baseline Alerts for Azure Landing Zones
Introduction Welcome to our latest blog post where we dive into a number of exciting new key updates, highlight the new portal accelera...
Introducing the Azure Policy Community Repo
Introducing the Azure Policy Community Repo What is the Azure Policy Community Repo? The Azure Policy Community Repo is a collaborativ...
General Availability: Vaulted backups for Azure Blob Storage
We are excited to announce the general availability of vaulted backups for Azure Blob Storage. Vaulted backups can help you achieve complete p...
Azure Update Manager to support CIS hardened images among other images
What’s coming in by end of July 2024: Azure Update Manager will add support for 35 CIS hardened images. This is the first time that Update Man...
Mastering your cloud journey: Essentials to Innovating, Migrating and Modernizing, on Azure
We are living during a time of rapid growth in AI technologies and seeing cloud complexity increase as a result of those advanced workloads, w...
Public Preview Announcement: Azure Policy Built-in Versioning
Welcome to a new era of policy management, where policy definitions are more agile, adaptable, and accessible than ever before! We are thrille...
Announcing Azure Monitoring Agent support in Azure Landing Zones
Introduction Hello and welcome to another blog post about Azure Landing Zones, the best practice framework for accelerating your cloud...
Announcing the General Availability of Change Actor
Change Analysis Identifying who made a change to your Azure resources and how the change was made just became easier! With Change Analys...