Loading...

Efficient Management of Append and Page Blobs Using Azure Storage Actions

Efficient Management of Append and Page Blobs Using Azure Storage Actions

 

Overview

In Azure Storage, Blob Lifecycle Management (BLM) allows you to automate the management of your data based on rules defined by the user. Lifecycle management policies are supported for block blobs and append blobs in general-purpose v2, premium block blob, and Blob Storage accounts. However, since lifecycle management (BLM) policies are not supported for page blobs, we can effectively manage the lifecycle of page blobs and append blobs through storage tasks and actions. There are solutions like Logic Apps and Azure Functions are available to automate lifecycle management and below are reference links:

Lifecycle Management, Page Blob, Azure Storage, Blob Storage (microsoft.com)

Delete all the Azure Storage Blob content before N days using Logic App - Microsoft Community Hub

 

The focus of this blog is on demonstrating how to achieve the same goal using built-in storage actions and tasks

 

NOTE: Azure Storage Actions is currently in PREVIEW and is available these regions. Please refer: About Azure Storage Actions Preview - Azure Storage Actions Preview | Microsoft Learn

 

By leveraging these storage actions, we can automate the retention, deletion, and archival of page blobs and append blobs based on custom-defined rules, ensuring efficient lifecycle management without relying on external services. This method provides a more direct, storage-centric approach to managing page blob lifecycles.

 

For example, we have both page blobs and append blobs within a container, and we would like to delete them using Azure storage actions and tasks.

Vishal_Kugaji_0-1730181178766.png

 

In this article, you'll learn how to create a storage task.

Create a task

In the Azure portal, search for Storage Tasks. Then, under Services, select Storage tasks - Azure Storage Actions.

Vishal_Kugaji_1-1730109852967.png

 

On the Azure Storage Actions | Storage Tasks page, select Create.

Vishal_Kugaji_2-1730109872329.png

 

Basics tab

On the Basics tab, provide the essential information for your storage task.

Vishal_Kugaji_1-1730177878538.png

 

 

Conditions tab

On the Conditions tab, define the conditions that must be met by each object (container or blob), and the operations to perform on the object.

You must define at least one condition and one operation. To add a clause to a condition, select Add new clause. To add operations, select Add new operation. In this scenario, we are selecting the blob types as Page Blobs and Append Blobs to perform the delete operation.

Vishal_Kugaji_2-1730177896353.png

 

Assignments tab

An assignment identifies a storage account and a subset of objects in that account that the task will target. An assignment also defines when the task runs and where execution reports are stored.

To add an assignment, select Add assignment. This step is optional. You don't have to add an assignment to create the task.

Vishal_Kugaji_3-1730177918741.png

 

Tags tab

On the Tags tab, you can specify Resource Manager tags to help organize your Azure resources.

Vishal_Kugaji_4-1730177934770.png

 

Review + create tab

When you navigate to the Review + create tab, Azure runs validation on the storage task settings that you have chosen. If validation passes, you can proceed to create the storage task.

 

If validation fails, then the portal indicates which settings need to be modified.

Vishal_Kugaji_5-1730177950277.png

 

Once you have created the storage task then please go to the respective storage account to enable the storage task assignment.

 

Enable the task assignment

Storage task assignments are disabled by default. Enable assignments from the Assignments page.

Vishal_Kugaji_6-1730178304967.png

 

Periodically select Refresh to view an updated status.

Until the task runs and then completes, the string in progress appears beneath the Last run status column. When the task completes, the string Completed appears in that column.

 

Vishal_Kugaji_8-1730178369676.png

 

After successfully completing the task, we observed that both the page blobs and append blobs were deleted from the container.

 

View results of the task run

After the task completes running, you can view the results of the run.

Select the View report link to download a report.

Vishal_Kugaji_9-1730178392375.png

 

 

Useful links:

Create a storage task - Azure Storage Actions Preview | Microsoft Learn

https://learn.microsoft.com/en-us/azure/storage-actions/overview

Define storage task conditions & operations - Azure Storage Actions Preview | Microsoft Learn

Published on:

Learn more
Need help with this product?

We can help you with Efficient Management of Append and Page Blobs Using Azure Storage Actions

If you want help implementing, troubleshooting, or improving this product, contact us and we’ll point you in the right direction.

Azure PaaS Blog articles
Azure PaaS Blog articles

Azure PaaS Blog articles

Share post:

Related posts

Azure Storage - TLS 1.0 and 1.1 retirement

Overview TLS 1.0 and 1.1 retirement on Azure Storage was previously announced for Nov 1st, 2024, and it was postponed recently to 1 year later...

1 year ago

[Azure AI Search] Internal Server Error when creating CMK encrypted objects

Scenario Customers follow the Microsoft doc to create CMK encrypted objects (data source, index etc.), but get the 500 Internal Serv...

1 year ago

Optimizing Azure Table Storage: Automated Data Cleanup using a PowerShell script with Azure Automate

Scenario This blog’s aim is to manage Table Storage data efficiently. Imagine you have a large Azure Table Storage that accumulates logs from ...

1 year ago

Optimizing Azure Table Storage: Automated Data Clean-up using a PowerShell script with Azure Automat

Scenario This blog’s aim is to manage Table Storage data efficiently. Imagine you have a large Azure Table Storage that accumulates logs from ...

1 year ago

Restoring Soft-Deleted Blobs with multithreading in Azure Storage Using C#

Blob soft delete is an essential feature that safeguards your data against accidental deletions or overwrites. By retaining deleted data for a...

1 year ago

Performing simple Azure Table Storage REST API operations using curl command.

The blog provides guidance to perform simple Table Storage REST API operations such as Create table, Delete Table, Insert entity, Delete entit...

1 year ago

Bulk delete all the old jobs from the batch account

Deleting a Job also deletes all Tasks that are part of that Job, and all Job statistics. This also overrides the retention period for Task dat...

2 years ago

Utilizing Azure Storage and Runbooks for scheduled automated backups of Azure SQL Databases

In this article, we are going to provide detailed steps to create a scheduled Azure SQL Database backup to storage account using automation. T...

2 years ago

[Azure Service Bus] JMS messages getting dead-lettered

The article discusses a problem where numerous messages end up in the dead letter queue (DLQ) when the JMS service bus consumer connects to th...

2 years ago

Subscribe to Azure Storage Blob Lifecycle Policy Events

The LifecyclePolicyCompleted event is generated when the actions defined by a lifecycle management policy are performed. Refer - Opt...

2 years ago

Newsletter

Get the latest Dynamics 365 and Power Platform content in your inbox

A curated digest of community blogs, product news, videos, and podcasts — delivered without the noise.

Weekly updates Unsubscribe anytime Fresh community picks
We use your email only for the newsletter and you can unsubscribe at any time.
By subscribing, you agree to the privacy policy.