What is a Data Lakehouse?
Ever wondered what exactly a Data Lakehouse is and why it's revolutionising how we interact with data?
After returning from a career break in 2021, Carmel Eve discovered the data landscape had transformed beyond recognition. In this video, Carmel will guide you through the evolution of data architecture and explain why Lakehouses might be the solution you've been looking for.
🎯 What You'll Learn:
- The fundamental differences between Data Warehouses, Data Lakes, and Data Lakehouses
- Why ACID compliance matters for your data architecture
- How Microsoft Fabric leverages Delta Lake for optimised querying
- The real-world trade-offs between storage costs and performance
- Whether a Lakehouse architecture is right for your organisation
📚 In This Video:
- 00:00 Introduction to Data Lakehouse
- 01:06 Evolution of Data Storage: From Warehouses to Lakes
- 03:10 Challenges with Data Warehouses
- 04:11 Rise of Data Lakes
- 05:43 Limitations of Data Lakes
- 08:00 Introduction to Data Lakehouse Architecture
- 09:11 Microsoft Fabric and Future Prospects
- 10:58 Conclusion and Contact Information
💡 Key Takeaways:
Data Lakehouses combine the best of both worlds - the low-cost, flexible storage of data lakes with the management features and performance of data warehouses. They support ACID transactions, schema enforcement, and direct BI querying whilst handling structured, unstructured, and semi-structured data.
Published on:
Learn moreWe can help you with What is a Data Lakehouse?
If you want help implementing, troubleshooting, or improving this product, contact us and we’ll point you in the right direction.
Related posts
Introducing Survive the Sprint: a pixel-art game built (almost) in one shot with Claude Opus 5.5
I gave Claude Opus 5.5 one prompt and the endjin 'Who we are' page, and got back most of a pixel-art browser game starring the endjineers. Her...
How to trust your AI-assisted data analysis
AI tools can produce data analysis that looks authoritative without being verifiable. Whether you're the analyst or the decision-maker relying...
Providing comparative context with DAX Calculated Tables under Row Level Security
Row Level Security in Power BI solves one problem (who sees what) but introduces another - comparisons across the full dataset become impossib...
How to Implement Generation in RAG
Understand the generation step of RAG: how LLMs use augmented context to produce grounded responses, how to enforce structured outputs with Py...
How to Implement Augmentation in RAG
Understand the augmentation step of RAG: how retrieved documents are structured into prompts, how metadata and citations improve response qual...
How to Implement Retrieval in RAG
Understand the retrieval step of RAG: Learn how database queries, keyword search, vector search, and hybrid approaches find the right informat...
TypeDeclaration: An Abstraction for Understanding JSON Schema
The Corvus.Json.CodeGeneration library analyses JSON Schema and builds a TypeDeclaration tree that maps schema patterns to code patterns. The ...
Optimising DAX: Practical Examples
The final post in the Optimising DAX series: the CALCULATE trap, variables and IF.EAGER, slicer costs, and a practical approach to isolating s...
Optimising DAX: Data Materialisation
Data materialisation is when the storage engine gives up on efficient processing and rebuilds the entire table. This post explains what trigge...
Building API Reference Documentation From Code, Part 2: Under the Hood
A deep dive into the cross-assembly linking, PDB-based source links, TFM scanning, enrichment merging, and search indexing that power our API ...