Introduction to the Medallion Architecture
In this video, Carmel Eve provides a comprehensive introduction to the Medallion Architecture, a widely-adopted data design pattern for modern data platforms.
What You'll Learn
This video covers the three-tier architecture pattern that helps organizations structure their data lakes and lakehouses effectively:
- Bronze Tier: Raw data ingestion and historical archiving
- Silver Tier: Data transformation, validation, and cleaning
- Gold Tier: Business-ready data optimized for specific use cases
Key Topics Covered
- The difference between ETL and ELT approaches
- How to transform various data formats (JSON, XML, CSV) into tabular structures
- Schema validation and data quality considerations
- When to combine data sources vs. keeping them separate
- Creating multiple data projections for different reporting needs
- Best practices for organizing data by domain and use case
Who This Video Is For
This video is ideal for:
- Data engineers building modern data platforms
- Data architects designing lakehouse architectures
- IT professionals working with Azure, Databricks, or similar platforms
- Anyone interested in understanding data design patterns
Chapters
Published on:
Learn moreWe can help you with Introduction to the Medallion Architecture
If you want help implementing, troubleshooting, or improving this product, contact us and we’ll point you in the right direction.
Related posts
How to trust your AI-assisted data analysis
AI tools can produce data analysis that looks authoritative without being verifiable. Whether you're the analyst or the decision-maker relying...
Providing comparative context with DAX Calculated Tables under Row Level Security
Row Level Security in Power BI solves one problem (who sees what) but introduces another - comparisons across the full dataset become impossib...
How to Implement Generation in RAG
Understand the generation step of RAG: how LLMs use augmented context to produce grounded responses, how to enforce structured outputs with Py...
How to Implement Augmentation in RAG
Understand the augmentation step of RAG: how retrieved documents are structured into prompts, how metadata and citations improve response qual...
How to Implement Retrieval in RAG
Understand the retrieval step of RAG: Learn how database queries, keyword search, vector search, and hybrid approaches find the right informat...
TypeDeclaration: An Abstraction for Understanding JSON Schema
The Corvus.Json.CodeGeneration library analyses JSON Schema and builds a TypeDeclaration tree that maps schema patterns to code patterns. The ...
Optimising DAX: Practical Examples
The final post in the Optimising DAX series: the CALCULATE trap, variables and IF.EAGER, slicer costs, and a practical approach to isolating s...
Optimising DAX: Data Materialisation
Data materialisation is when the storage engine gives up on efficient processing and rebuilds the entire table. This post explains what trigge...
Building API Reference Documentation From Code, Part 2: Under the Hood
A deep dive into the cross-assembly linking, PDB-based source links, TFM scanning, enrichment merging, and search indexing that power our API ...
Building API Reference Documentation From Code, Part 1: The Pipeline
We generate about 8,800 API reference pages from 16 libraries across two engine versions, with source links, TFM availability badges, and hand...