Azure HPC Cache Updates: New Caching Option, Discounted Pricing, and More!
New Releases
Azure HPC Cache Premium Read-Write
We’re excited to announce the preview of Azure HPC Cache Premium Read-Write. This next generation of premium caching for high-performance computing workloads is designed to provide high-bandwidth and low-latency access to files. Azure compute clients are provided with read and write performance like what they would experience from a local NVMe drive.
Premium HPC Cache provides lower latency than the Standard HPC Cache for your compute-intensive enterprise workloads. You can provision up to 84 TB of capacity in a single cache and point thousands of compute clients at the cache to get up to 20 GB/s of read throughput. Premium HPC Cache’s highlights include:
- Increased Read Throughput: up to 20 GB/sec against an 80+ TiB dataset
- Reduced Latency: 150 µsec for reads, 1 msec for writes
- Increased Write Throughput: 24.5% increase in write operations
- IOPS Scalability: 170,000 random 4 KiB writes; 450,000 random 4 KiB reads
With our lowest-latency cache, Premium HPC Cache provides our best file-based performance to meet your time-sensitive workloads like media rendering, simulations for genomics and financial models, as well as chip design.
Getting Started with Premium Read-Write
Azure HPC Cache Premium Read-Write is currently available as a Public Preview in select regions. If you are interested in participating in the preview, you can create a new cache and choose the Premium (Preview) option.
Overview of Current and New Offerings
|
Attribute |
Read-Write Standard Caching |
Read-Only Caching |
Read-Write Premium Caching |
|
Throughput SKU |
2, 4, or 8 GB/sec |
4.5, 9, or 16 GB/sec |
5, 10, or 20 GB/sec |
|
Write Throughput |
1.1, 2.2, 4.4 GB/sec |
N/A GB/sec (write-through) |
2.3, 4.6, 9.2 GB/sec |
|
Read IOPS |
62.5K, 125K, 250K ops/sec |
160K, 320K, 480K ops/sec |
500K, 1M, 2M ops/sec |
|
Write IOPS |
16.75K, 33.5K, 67K ops/sec |
N/A ops/sec (write-through) |
135K, 270K, 540K ops/sec |
|
Cache sizes |
3, 6, or 12 TB for 2 GB/sec 6, 12, or 24 TB for 4 GB/sec 12, 24, or 48 TB for 8 GB/sec |
21 TB for 4.5 GB/sec 42 TB for 9 GB/sec 84 TB for 16 GB/sec |
21 TB for 5 GB/sec 42 TB for 10 GB/sec 84 TB for 20 GB/sec |
|
Maximum number of storage targets |
20 |
20 |
20 |
|
Compatible storage target types |
Azure Blob, NFS (on-premises), ADLS-NFS (NFSv3-enabled Azure Blob) |
NFS (on-premises), ADLS-NFS (NFSv3-enabled Azure Blob) |
Azure Blob, NFS (on-premises), ADLS-NFS (NFSv3-enabled Azure Blob) |
|
Caching styles |
Read caching or read-write caching |
Read caching only |
Read-write caching |
|
Cache can be stopped to save cost when not needed |
Yes |
No |
No |
*Results were without use of the priming feature. Additional details on priming will be included in our next blog post.
Lower Pricing for Azure HPC Cache - Standard
While it seems like the cost of everything is going up, we’re happy to report a price drop. As part of our commitment to provide the most cost-effective performance cache, we’re excited to share that we have dropped Azure HPC Cache – Standard prices by up to 33% percent in some regions. The new pricing is effective immediately.
This enables cost-conscious verticals like media and entertainment to meet strict rendering deadlines while spending less on caching. Life sciences customers who rely on grants to fund their genomics research can now stretch their funds further. And chip designers can run their EDA workloads at a lower cost and still maintain the high performance for their tools repositories that they’ve come to expect.
Terraform
Terraform, an open-source software tool created by HashiCorp, provides an orchestration layer to deploy Azure resources. Using Terraform, you can deploy your own vdbench test system with all the required resources to run a performance benchmark. To try this yourself, the HPC Cache team has created a vdbench NFS-backed storage cache Terraform recipe to deploy a Premium 5G cluster and 30 clients. You can additionally run your own benchmarks against a 5G storage cache. Instructions and examples can be found on HPC Cache GitHub.
Published on:
Learn moreRelated posts
Update on classic storage account retirement and upcoming changes for classic storage customers
We previously announced that support would end for retired Azure classic storage accounts on 31 August 2024. Now that we are past the retireme...
Azure Elastic SAN for Azure VMware Solution: now Generally Available
Have you been looking to expand your storage on Azure VMware Solution (AVS), but do not need the extra compute performance and the associated ...
Accelerate metadata heavy workloads with Metadata Caching preview for Azure Premium Files SMB & REST
Azure Files previously announced the limited preview of Metadata caching highlighting improvements on the metadata latency (up to 55...
Announcing UNLIMITED Public Preview of Metadata Caching for Azure Premium SMB/REST File Shares
Azure Files is excited to announce the Unlimited public preview of Metadata Caching for the premium SMB/REST file share tier. Unlimited ...
Azure Backup-SAP HANA DB Backup Delivers More Value at Lower TCO with Reduced Protected Instance Fee
Azure Backup for SAP HANA Database Delivers More Value at Lower TCO with Reduced Protected Instance Fees starting 1st Sept’2024 At Azur...
Switch to Azure Business Continuity Center for your at scale BCDR management needs
In response to the evolving customer requirements and environments since COVID-19, including the shift towards hybrid work models and the incr...
The Azure Storage product group is heading to the SNIA Developer Conference 2024
The Azure Storage product group is heading to the SNIA Developer Conference (SDC) 2024 in Santa Clara, California, USA from September 16th thr...
Latest advancements in Premium SSD v2 and Ultra Azure Managed Disks
We are excited to share the latest advancements in Premium SSD v2 (Pv2) and Ultra disks, the next generation of Azure disk stor...
Unlocking the Potential of Unstructured Data with Microsoft Copilot and Azure Native Qumulo
It has been a true pleasure to see our friends at Qumulo constantly innovating and delivering a service that adds more value with every releas...
Public Preview: Customer Managed Planned Failover for Azure Storage
We are excited to announce customer managed Planned Failover for Azure Storage is now available in public preview. Over the past few ye...