Loading...

Microsoft Fabric - Lakehouse and Medallion Architecture

Microsoft Fabric - Lakehouse and Medallion Architecture

In this informative video, Ed Freeman delves into the concept of Lakehouse and Medallion Architecture, and how they interconnect with Microsoft Fabric. Lakehouses form a foundational design pattern for modern data platforms that have gained immense popularity in recent times. With tools like #Databricks and MicrosoftFabric adopting this design, it has become all the more relevant. The Medallion Architecture is a three-tiered architectural structure where data passes through different stages of state, serving different objectives.

The video comprises several chapters, beginning with an introduction and moving onto explain the basic concept of a Lakehouse and how it is implemented in Microsoft Fabric. Other sections explore the table and file structure in OneLake, the justification for integrating the Medallion architecture, and a detailed overview of the Bronze, Silver and Gold layers. Also emphasized is replayability and idempotency - concepts that underscore the importance of structuring data in a way that can handle failure and recover gracefully. The video concludes by exploring alternative structures that represent feasible solutions to data management challenges.

Through this video, data professionals can gain a deeper understanding of these essential concepts and apply them in their own work processes. To learn more, check out the video at the link provided.

Published on:

Learn more
endjin.com
endjin.com

We help small teams achieve big things.

Share post:

Related posts

Organize Fabric Lakehouse with Medallion Architecture | Learn Together Series

This video is part of a series on organizing a Fabric lakehouse using medallion architecture design. You can find more information on the seri...

6 months ago

Organize Fabric Lakehouse with Medallion Architecture Design | Learn Together

If you're interested in organizing a Fabric lakehouse and want to learn about medallion architecture design, this informative video is for you...

6 months ago

Delta Sharing Integration with Data Mesh for Efficient Data Management

This guide explores the integration of Delta Sharing with Data Mesh on the Databricks Lakehouse, offering comprehensive insights into how it e...

6 months ago

Unlock Data Governance: Revolutionary Table-Level Access in Modern Platforms

In this blog, we delve into data governance challenges and solutions in enterprises, focusing on Microsoft Fabric and Databricks for managing ...

9 months ago

Microsoft Fabric - Role of the Silver Layer in the Medallion Architecture

The Silver layer is where we apply standardization to our source datasets. This standardization aligns field names across sources, applies com...

11 months ago

Microsoft Fabric - Processing Bronze to Silver using Fabric Notebooks

Notebooks in Fabric are a lot like notebook experiences in other tools you're probably already familiar with. They allow us to write code in a...

11 months ago

Augmenting Gold Layer with Semantic Link and SparkSQL in Microsoft Fabric

If you've ever wished to query data from a Power BI semantic model using SQL, the Semantic Link feature makes that dream a reality! In this po...

1 year ago

Data Modeling for Mere Mortals – Part 4: Medallion Architecture Essentials

If you're a mere mortal trying to grasp the nuances of data modeling, you've come to the right place. In this fourth and final part of the ser...

1 year ago

What is Databricks Lakehouse and why you should care

Databricks has been making waves in the industry, and it's important to understand its impact on the world of data. At its core, Databricks pr...

1 year ago
Stay up to date with latest Microsoft Dynamics 365 and Power Platform news!
* Yes, I agree to the privacy policy