Upgrade to Azure Synapse runtimes for Apache Spark 3.4 & previous runtimes deprecation
It is important to stay ahead of the curve and keep services up to date. That's why we encourage all Azure Synapse customers with Apache Spark workloads to migrate to the newest GA version, Azure Synapse Runtime for Apache Spark 3.4. The update brings Apache Spark to version 3.4 and Delta Lake to version 2.4, introduces Mariner as the new operating system, and updates Java from version 8 to 11.
Within a few days/weeks, we are disabling Apache Spark 2.4, 3.1, 3.2 job execution. If you are affected you have already been notified. Using the runtime after EOS date is at one's own risk, and with the agreement and acceptance of the risks that jobs will eventually stop executing. All support tickets will be auto-resolved. Learn more about the Microsoft Lifecycle Policy.
Migrate to the latest GA version of Azure Synapse runtimes for Apache Spark 3.4 before the deprecation and disablement of previous versions.
Please refer to the following article for more information on the lifecycle and supportability of our runtimes: Azure Synapse runtimes.
Go to Synapse runtime for Apache Spark lifecycle and supportability - Azure Synapse Analytics | Microsoft Learn and Migration Guide: Spark Core - Spark 3.4.1 Documentation (apache.org) for more details on how to migrate and how to change Apache Spark-based runtime in Azure Synapse Analytics.
Published on:
Learn moreRelated posts
Transforming Field Operations with AI, Azure Maps & Dynamics 365
Efficient field operations are the backbone of successful, data-driven organizations. Yet, many businesses continue to struggle with scattered...
Failures Happen in Cloud, but how Azure Cosmos DB keeps your Applications Online
The only thing that’s constant in distributed systems is failures. No cloud platform is immune to failures — from regional outages and transie...
The `azd` extension to configure GitHub Copilot coding agent integration with Azure
This post shares how to set up the GitHub Copilot coding agent integration with Azure resources and services by using the Azure Developer CLI ...
Announcing Azure MCP Server 1.0.0 Stable Release – A New Era for Agentic Workflows
Today marks a major milestone for agentic development on Azure: the stable release of the Azure MCP Server 1.0! The post Announcing Azure MCP ...
From Backup to Discovery: Veeam’s Search Engine Powered by Azure Cosmos DB
This article was co-authored by Zack Rossman, Staff Software Engineer, Veeam; Ashlie Martinez, Staff Software Engineer, Veeam; and James Nguye...
Azure SDK Release (October 2025)
Azure SDK releases every month. In this post, you'll find this month's highlights and release notes. The post Azure SDK Release (October 2025)...
Microsoft Copilot (Microsoft 365): [Copilot Extensibility] No-Code Publishing for Azure AI Foundry Agents to Microsoft 365 Copilot Agent Store
Developers can now publish Azure AI Foundry Agents directly to the Microsoft 365 Copilot Agent Store with a simplified, no-code experience. Pr...
Azure Marketplace and AppSource: A Unified AI Apps and Agents Marketplace
The Microsoft AI Apps and Agents Marketplace is set to transform how businesses discover, purchase, and deploy AI-powered solutions. This new ...
Episode 413 – Simplifying Azure Files with a new file share-centric management model
Welcome to Episode 413 of the Microsoft Cloud IT Pro Podcast. Microsoft has introduced a new file share-centric management model for Azure Fil...