Microsoft and Databricks deepen partnership for modern, cloud-native analytics
In May, we introduced the Microsoft Intelligent Data platform which deeply integrates our databases, analytics, BI and data governance products into a unified platform. This platform, which is also integrated with the Microsoft Cloud, enables seamless experience and intuitive collaboration for Developers, DBAs, Data Engineers, Data Scientists, Business Analysts and Data Officers. The platform enables customers to “do more with less”, by helping them add layers of intelligence to their applications, unlock predictive insights and drive relevant action, and govern their entire data estate.
Microsoft Intelligent Data Platform
Databricks has been a key partner for us in delivering a cloud native platform for Analytics in the Microsoft Intelligent Data Platform. Today, I am pleased to share that we have further strengthened our partnership with Databricks to evolve our Analytics platform to an Open and Governed Data Lakehouse foundation. This foundation will enable our customers to unify their most demanding Business Intelligence, Machine Learning, and Artificial Intelligence investments on a single data foundation for analytics viz. an open and governed data lakehouse. The foundation will also enable customers to responsibly democratize their analytics data products to accelerate digital transformation applications across their organizations.
“Databricks is a key partner for Microsoft, and together, we are delivering a modern, cloud-native data foundation in the Microsoft Intelligent Data Platform for the most demanding analytics and machine learning applications,” - Scott Guthrie, EVP, Cloud + AI, Microsoft.
Microsoft and Databricks have partnered to build this foundation in the Microsoft Intelligent Data Platform by integrating their hallmark capabilities to deliver an integrated solution for our customers.
Core to the foundation is the Open and Governed Data Lakehouse, a unified and cloud native data fabric capable of serving business intelligence, machine learning and artificial intelligence workloads at enterprise and cloud scales, without requiring organizations to invest in building, integrating, and operating point data fabrics for each.
Analytics in Microsoft Intelligent Data Platform
This foundation is built by integrating the hallmark analytics capabilities in Microsoft’s Azure Synapse Analytics and Databricks, as well by integrating the governance foundations in Microsoft Purview and Databricks Unity Catalog to enable a single pane experience for Data and Analytics Governance in Microsoft Purview. The components of the integrated analytics foundation include:
- Azure Data Factory in Azure Synapse Analytics for orchestrating data integration pipelines to integrate data from across hybrid, multi-cloud, SaaS, and legacy enterprise data source systems
- Azure Data Explorer in Azure Synapse Analytics for real-time streaming analytics
- Azure Databricks for building an open standard data lakehouse using the Delta format
- Azure Synapse Analytics and Azure Databricks for machine learning
- Azure AI and Databricks MLFlow for MLOps
- Azure Synapse SQL and Databricks SQL for serverless SQL analytics
- Azure Synapse SQL for a Data Warehouse modality for data serving
- Power BI for Business Intelligence
- Microsoft Purview and Databricks Unity Catalog Federation for Unified Data Governance in Purview spanning Operational, Analytics, and ML/AI data assets on the Microsoft Intelligent Data Platform
“This announcement between Databricks and Microsoft is a significant step forward in helping customers adopt an open, well governed data lakehouse on Azure with the entirety of the Microsoft Intelligent Data Platform capabilities. More than ever, customers are able to quickly and easily unify their data, analytics, and AI with a simple and open approach.” - Ali Ghodsi, Co-founder and CEO of Databricks
We, Microsoft and Databricks, are thrilled to be able to partner in deeply integrating our complementary strengths and capabilities, to deliver an open and governed analytics foundation in the Microsoft Intelligent Platform, to serve the most demanding analytics investments of our customers with unparalleled productivity, performance, and cost efficiencies that will enable our customers to do and achieve more with less. In a recent benchmark study, implementing an end-to-end analytics solution on Azure was up to 49% more cost efficient than on a top competitor cloud.
Learn more:
Microsoft and Databricks Partnership
Innovate faster and achieve greater agility with the Microsoft Intelligent Data Platform
Published on:
Learn moreWe can help you with Microsoft and Databricks deepen partnership for modern, cloud-native analytics
If you want help implementing, troubleshooting, or improving this product, contact us and we’ll point you in the right direction.
Related posts
Data for now and next: Powering a new era of AI apps
The era of AI has arrived and the organizations that are primed for learning, adapting, and scaling quickly hold the power to transform human ...
Announcing the General Availability of AMD-based Confidential VMs on Azure Databricks
We are excited to announce the general availability of AMD-based confidential virtual machines (VMs) for cluster nodes on Azure Databricks. Co...
A Data Professional's Guide to Build 2023
ChatGPT and Microsoft Copilot are stealing headlines worldwide—but data is the force that drives them both. That’s why this year at Microsoft ...
Introducing the Microsoft Intelligent Data Platform Partner Ecosystem
Microsoft Intelligent Data Platform Partner Ecosystem In May, we introduced the Microsoft Intelligent Data platform which deeply integr...
SQL DB maintenance activity using Automation accounts for Azure SQL DBs(Different scenarios)
Infrastructure: Multiple Azure SQL DB instances Multiple databases in total Multiple instances consist of multiple databases Different subscr...
Zero to Hero: Your Guide to Getting Skilled on Azure Data and AI
We are excited to highlight the Zero to Hero guide, our very own journey to help developers and engineers get started on Azure. We have a larg...
A Data and AI guide to Build 2022
Microsoft Build will begin Tuesday, May 24 at 8:30 AM PDT with our annual keynote. Attendees can then participate in live segments, breakout ...
Azure Data Factory CI-CD using YAML template
Purpose of this Blog Defined the end to end Git integration and Deployment flow using YAML template from a project implementation...
Azure Data Components Network Architecture with secure configurations
Use Case : •When there is a need for the Data Components – ADF,ADB and SQL-Pool code to be promoted to higher environment se...
Data bricks Notebook Deployment using YAML code
Purpose of this Blog: We have defined end-end workflow for code check-in using two methods Notebook Revision History (standard check-in proc...