Microsoft Fabric - Inspecting 28 Million row dataset
This video is part of the Microsoft Fabric End-to-End demo series, where the host, Ed Freeman, takes us through the dataset used and the problem statement the series aims to solve. The dataset being used is provided by the UK government, and it contains data on ownership of land and property in England and Wales. The dataset is almost 5GB in size, with different files for complete or incremental processing, allowing for UPSERT-like functionality enabled by DeltaLake without having to load the data entirely with each new information.
The video provides insight into the data, where it comes from, and its format, framing up the insights they aim to achieve from the analysis in the series. There is also a walkthrough of a sample architecture diagram, highlighting the involved data platforms at a high level.
You can find the other parts of the series and other content related to Microsoft Fabric by checking out the useful links provided in the description.
Check out the video to learn more about the Microsoft Fabric End-to-End demo series.
Published on:
Learn moreRelated posts
Microsoft Fabric Machine Learning Tutorial - Part 1 - Overview of the Course
This video provides an overview of a new tutorial series that would take a deep dive into an end-to-end demo of Microsoft Fabric, with a focus...
Microsoft Fabric Machine Learning Tutorial - Part 2 - Data Validation with Great Expectations
This tutorial delves into the intricacies of data validation in the realm of Microsoft Fabric and Great Expectations. It demonstrates how a da...
Learn Together: Ingest Data with Dataflows Gen2 in Microsoft Fabric
Join this interactive tutorial to learn how to effectively ingest data with Dataflows Gen2 in Microsoft Fabric. Through a hands-on approach, y...
Microsoft Fabric - Role of the Silver Layer in the Medallion Architecture
The Silver layer is where we apply standardization to our source datasets. This standardization aligns field names across sources, applies com...
Data Engineering an End-to-End Solution with Microsoft Fabric @ Oxford Microsoft Data Platform Group
Ed Freeman is going to do a live end to end demo of building a data engineering solution on Microsoft Fabric.
Data Modeling for Mere Mortals – Part 4: Medallion Architecture Essentials
If you're a mere mortal trying to grasp the nuances of data modeling, you've come to the right place. In this fourth and final part of the ser...
Microsoft Fabric - Creating a OneLake Shortcut to ADLS Gen2
In this informative video, learn how to use Shortcuts in Microsoft Fabric to aid zero-copy referencing of data between OneLake and clouds whil...
Microsoft Fabric - Lakehouse and Medallion Architecture
In this informative video, Ed Freeman delves into the concept of Lakehouse and Medallion Architecture, and how they interconnect with Microsof...
Introduction to Lakehouses in Microsoft Fabric
If you want to learn about Lakehouses in Microsoft Fabric, you have come to the right place. In this post, you will be introduced to an end-to...