Loading...

Introduction to the Medallion Architecture

Introduction to the Medallion Architecture

In this video, Carmel Eve provides a comprehensive introduction to the Medallion Architecture, a widely-adopted data design pattern for modern data platforms.

What You'll Learn

This video covers the three-tier architecture pattern that helps organizations structure their data lakes and lakehouses effectively:

  • Bronze Tier: Raw data ingestion and historical archiving
  • Silver Tier: Data transformation, validation, and cleaning
  • Gold Tier: Business-ready data optimized for specific use cases

Key Topics Covered

  • The difference between ETL and ELT approaches
  • How to transform various data formats (JSON, XML, CSV) into tabular structures
  • Schema validation and data quality considerations
  • When to combine data sources vs. keeping them separate
  • Creating multiple data projections for different reporting needs
  • Best practices for organizing data by domain and use case

Who This Video Is For

This video is ideal for:

  • Data engineers building modern data platforms
  • Data architects designing lakehouse architectures
  • IT professionals working with Azure, Databricks, or similar platforms
  • Anyone interested in understanding data design patterns

Chapters

  • 00:00 Introduction to Medallion Architecture
  • 00:50 Understanding the Bronze Tier
  • 01:46 Transforming Data in the Silver Tier
  • 04:51 Creating the Gold Layer
  • 06:43 Conclusion and Next Steps

Published on:

Learn more
Need help with this product?

We can help you with Introduction to the Medallion Architecture

If you want help implementing, troubleshooting, or improving this product, contact us and we’ll point you in the right direction.

endjin.com
endjin.com

We help small teams achieve big things.

Share post:

Related posts

How to trust your AI-assisted data analysis

AI tools can produce data analysis that looks authoritative without being verifiable. Whether you're the analyst or the decision-maker relying...

1 day ago

Providing comparative context with DAX Calculated Tables under Row Level Security

Row Level Security in Power BI solves one problem (who sees what) but introduces another - comparisons across the full dataset become impossib...

2 days ago

How to Implement Generation in RAG

Understand the generation step of RAG: how LLMs use augmented context to produce grounded responses, how to enforce structured outputs with Py...

3 days ago

How to Implement Augmentation in RAG

Understand the augmentation step of RAG: how retrieved documents are structured into prompts, how metadata and citations improve response qual...

4 days ago

How to Implement Retrieval in RAG

Understand the retrieval step of RAG: Learn how database queries, keyword search, vector search, and hybrid approaches find the right informat...

5 days ago

TypeDeclaration: An Abstraction for Understanding JSON Schema

The Corvus.Json.CodeGeneration library analyses JSON Schema and builds a TypeDeclaration tree that maps schema patterns to code patterns. The ...

8 days ago

Optimising DAX: Practical Examples

The final post in the Optimising DAX series: the CALCULATE trap, variables and IF.EAGER, slicer costs, and a practical approach to isolating s...

9 days ago

Optimising DAX: Data Materialisation

Data materialisation is when the storage engine gives up on efficient processing and rebuilds the entire table. This post explains what trigge...

10 days ago

Building API Reference Documentation From Code, Part 2: Under the Hood

A deep dive into the cross-assembly linking, PDB-based source links, TFM scanning, enrichment merging, and search indexing that power our API ...

11 days ago

Building API Reference Documentation From Code, Part 1: The Pipeline

We generate about 8,800 API reference pages from 16 libraries across two engine versions, with source links, TFM availability badges, and hand...

12 days ago

Newsletter

Get the latest Dynamics 365 and Power Platform content in your inbox

A curated digest of community blogs, product news, videos, and podcasts — delivered without the noise.

Weekly updates Unsubscribe anytime Fresh community picks
We use your email only for the newsletter and you can unsubscribe at any time.
By subscribing, you agree to the privacy policy.