Upgrade to Azure Synapse runtimes for Apache Spark 3.4 & previous runtimes deprecation
It is important to stay ahead of the curve and keep services up to date. That's why we encourage all Azure Synapse customers with Apache Spark workloads to migrate to the newest GA version, Azure Synapse Runtime for Apache Spark 3.4. The update brings Apache Spark to version 3.4 and Delta Lake to version 2.4, introduces Mariner as the new operating system, and updates Java from version 8 to 11.
Within a few days/weeks, we are disabling Apache Spark 2.4, 3.1, 3.2 job execution. If you are affected you have already been notified. Using the runtime after EOS date is at one's own risk, and with the agreement and acceptance of the risks that jobs will eventually stop executing. All support tickets will be auto-resolved. Learn more about the Microsoft Lifecycle Policy.
Migrate to the latest GA version of Azure Synapse runtimes for Apache Spark 3.4 before the deprecation and disablement of previous versions.
Please refer to the following article for more information on the lifecycle and supportability of our runtimes: Azure Synapse runtimes.
Go to Synapse runtime for Apache Spark lifecycle and supportability - Azure Synapse Analytics | Microsoft Learn and Migration Guide: Spark Core - Spark 3.4.1 Documentation (apache.org) for more details on how to migrate and how to change Apache Spark-based runtime in Azure Synapse Analytics.
Published on:
Learn moreRelated posts
Shrinking Azure Pipeline task extensions using esbuild
TL;DR We bundled an internal Azure Pipelines task extension into a single bundled JavaScript file using esbuild. The task package dropped from...
Building on Vercel’s eve + Azure Cosmos DB: An Agent That Remembers
Most “AI agent” demos forget everything the moment the process exits. That’s fine for a toy project, but useless for anythin...
Copilot Studio – Environment-level agent telemetry export to Azure Application Insights (Preview)
We are announcing the ability for administrators to export Copilot Studio agent telemetry at the environment level to Azure Application Insigh...
See our new Azure Cosmos DB Design Patterns
Design patterns are where good data modeling lives or dies. In a NoSQL database like Azure Cosmos DB, the difference between a schema that sca...
Need a different partition key in Azure Cosmos DB? Pick the right approach
Once you create a container, its partition key is fixed at creation, and you can’t change it in place. However, if your original key starts ca...
Azure SDK Release (June 2026)
Azure SDK releases every month. In this post, you'll find this month's highlights and release notes. The post Azure SDK Release (June 2026) ap...
Fundamentals of Azure DevOps with SQL projects
Building automated pipelines with your SQL database projects enables you to build a rich CI/CD ecosystem to ensure that your application is be...