Loading...

Azure portal April 2023 updates

Azure portal April 2023 updates

Analytics > Azure Stream Analytics

Analytics > Azure Stream Analytics

Intune

Let's look at each of these updates in greater detail.

 

Analytics > Azure Stream Analytics

Simulate a Stream Analytics job running topology before deployment

 

Before you start running your Stream Analytics job, it's crucial to check your query logic and find out the number of streaming units needed to handle the job's workload. This is where the Job Simulation feature comes in handy. It allows you to adjust the number of streaming units and simulate the job running topology, giving you an idea of how computing resources are allocated and utilized across the streaming nodes. The Job Simulation also provides suggestions for improving your query to make your job parallel. With this feature, you can ensure that your Stream Analytics job will use computing resources efficiently with the best performance. 

  

To make the best use of this feature, it's recommended to use it through the Azure Stream Analytics extension on Visual Studio Code. Refer to this article for more information: Optimize query performance using job diagram simulator (preview) | Microsoft Learn 

  

To use the job simulation feature, you can access it through the Azure Stream Analytics portal.

  • Open your Stream Analytics job in the Azure portal. 
  • Click on 'Query' on the TOC, and select 'Job simulation' on the query editor. It will generate a visual representation of your job topology based on the query and predefined streaming units.  

stream1.png

  • Drag the 'Streaming Units' bar to see how streaming nodes are being allocated to your job. Then you can decide the number of SUs needed to handle your workload.  

stream2.png

  • Click on 'Expand All' to see how the data stream would be processed at processor level. 

stream3.png

  • If your job is not fully parallel, the 'Enhancements' tab will provide suggestions for improving your query. 

stream4.png

  • If you make any changes to the query, remember to select 'Refresh simulation' to update the simulation.  

 

In conclusion, the Job Simulation feature in Azure Stream Analytics ensures that your job is executing in parallel and distributing the workload evenly across the streaming nodes. By leveraging its capabilities, you can achieve efficient and reliable data processing and ultimately unlocking the full potential of Azure Stream Analytics. 

 

Analytics > Azure Stream Analytics

Optimize Stream Analytics job performance using the Job Diagram feature

 

When creating a Stream Analytics job, it's important to ensure that your job is parallel, and your query logic is optimized for performance and scalability. One tool that can help you achieve this is the Job Diagram feature in the Azure Stream Analytics portal.

 

The Job Diagram provides a visual representation of your entire job topology. It displays the data flow between the streaming nodes, which makes it easy to understand the job logic and parallelism. It also shows real-time metrics for each streaming node, such as the number of input events and watermark delay. By utilizing this feature, you can easily identify the bottlenecks and pinpoint the root cause of any performance issues.

 

To learn more about the Azure Stream Analytics' Job Diagram feature, check out this doc: Optimize job performance using the Job Diagram - Azure Stream Analytics | Microsoft Learn

 

To use the Job Diagram feature in the Azure portal:

  • After you start running your Stream Analytics job in the Azure portal, click on 'Job Diagram' from the left side menu to see your job running topology.

op1.png

  • Edit the Heatmap settings' to highlight the metrics you are interested in. For example, if you want to highlight the streaming nodes with high watermark delay, enter a threshold in the Heatmap settings to update the Job Diagram.

op2.png

  • Click 'Add metric' to add another metric to the chart. Or you can 'Add chart' with the metrics you wanted to look at.

op3.png

  • Select one of the streaming nodes in the canvas to open its processor-level diagram. This will give you an idea of how the data is being processed at processor level.

op4.png

In summary, the Job Diagram feature is a powerful tool for optimizing your Stream Analytics jobs. By leveraging its insights and making informed optimizations, you can unlock the full potential of your streaming analytics workloads, achieving better parallelism and delivering high-performance data processing.

 

Updates to Microsoft Intune   

The Microsoft Intune team has been hard at work on updates as well. You can find the full list of updates to Intune on the What's new in Microsoft Intune page, including changes that affect your experience using Intune.  

   

Azure portal “how to” video series   

Have you checked out our Azure portal “how to” video series yet? The videos highlight specific aspects of the portal so you can be more efficient and productive while deploying your cloud workloads from the portal.  Check out our most recently published videos.   

 

Next steps   

The Azure portal has a large team of engineers that wants to hear from you, so please keep providing us your feedback in the comments section below or on Twitter @AzurePortal.   

    

Sign in to the Azure portal now and see for yourself everything that’s new. Download the Azure mobile app to stay connected to your Azure resources anytime, anywhere.  See you next month!   

Published on:

Learn more
Azure Governance and Management Blog articles
Azure Governance and Management Blog articles

Azure Governance and Management Blog articles

Share post:

Related posts

Azure Landing Zones - Policy Refresh Q1 FY25

ALZ - Policy Refresh Q1 FY25 is here! As you may be aware, the ALZ team release cadence is now on quarterly basis to help customers and partne...

1 year ago

Custom Policy- Reusable Logs Templates

Reusable Templates for Sending Logs to Log Analytics Workspace   Challenge:   When it comes to developing custom policies for sendin...

1 year ago

Enhancements to Azure Monitor Baseline Alerts for Azure Landing Zones

Introduction   Welcome to our latest blog post where we dive into a number of exciting new key updates, highlight the new portal accelera...

1 year ago

Introducing the Azure Policy Community Repo

Introducing the Azure Policy Community Repo   What is the Azure Policy Community Repo? The Azure Policy Community Repo is a collaborativ...

1 year ago

General Availability: Vaulted backups for Azure Blob Storage

We are excited to announce the general availability of vaulted backups for Azure Blob Storage. Vaulted backups can help you achieve complete p...

2 years ago

Azure Update Manager to support CIS hardened images among other images

What’s coming in by end of July 2024: Azure Update Manager will add support for 35 CIS hardened images. This is the first time that Update Man...

2 years ago

Mastering your cloud journey: Essentials to Innovating, Migrating and Modernizing, on Azure

We are living during a time of rapid growth in AI technologies and seeing cloud complexity increase as a result of those advanced workloads, w...

2 years ago

Public Preview Announcement: Azure Policy Built-in Versioning

Welcome to a new era of policy management, where policy definitions are more agile, adaptable, and accessible than ever before! We are thrille...

2 years ago

Announcing Azure Monitoring Agent support in Azure Landing Zones

Introduction   Hello and welcome to another blog post about Azure Landing Zones, the best practice framework for accelerating your cloud...

2 years ago

Announcing the General Availability of Change Actor

Change Analysis  Identifying who made a change to your Azure resources and how the change was made just became easier! With Change Analys...

2 years ago
Stay up to date with latest Microsoft Dynamics 365 and Power Platform news!
* Yes, I agree to the privacy policy