CLUSTER BY in Fabric Warehouse: when the magic shows up and when it doesn’t!
Microsoft's announcement post for data clustering in Fabric Warehouse promised 24x speedups. So I built a 100-million-row clickstream table and tested it myself. The result is more nuanced than the marketing - and more useful for anyone deciding whether to actually adopt this feature. Here's what 40% less CPU and 69% less I/O looks like - and why elapsed time barely moved.
The post CLUSTER BY in Fabric Warehouse: when the magic shows up and when it doesn’t! appeared first on Data Mozart.
Published on:
Learn moreRelated posts
How to check table sizes in a Microsoft Fabric warehouse
If you've tried to check how much storage your Fabric warehouse tables consume, you've probably discovered that the usual SQL Server approache...
(Don’t) Stop materializing your silver layer!
Why is your silver layer a set of tables? Challenging the fully materialized medallion pattern - with benchmark numbers and reproducible demo ...
Liar, liar! What to do when AI writes your pipelines confidently wrong?
Should we let AI write our pipelines? YES...But not the way you probably think. The post Liar, liar! What to do when AI writes your pipelines ...
One-minute trap! How new Fabric Warehouse CU metering affect your workloads
Microsoft is moving Fabric Warehouse CU metering from per-query CPU time to per-workspace virtual-node time. That brings Fabric closer to Snow...
Variable libraries in Microsoft Fabric: One value to rule them all!
Hardcoded values are the cockroaches of a data platform: you think you got them all, then Test starts reading from Prod and nobody notices for...
Hot, Cold, Gone: Caching and Retention in Microsoft Fabric Eventhouse
Two policies, three storage states, one rule connecting them. A newcomer's guide to caching, retention, and tiered storage in Microsoft Fabric...
Materialized Lake Views in Microsoft Fabric: When your medallion fits in a SELECT statement
Five surfaces collapsed into one declarative layer. Here's the full story of Materialized Lake Views in Microsoft Fabric - from syntax to the ...
A whirlwind tour on User-context-aware calculated columns in Power BI!
Bye, bye translation headaches! With the new User-context-aware calculated columns, we can tackle certain challenges more convenient than ever...
The Name Game – Naming Microsoft Fabric from tenant to table
A reference framework for naming everything in Microsoft Fabric - from capacities down to gold-layer fact tables. Patterns, examples, and stro...
What now for Power BI? The question I can’t escape
Everyone keeps asking me the same question: what now for Power BI? With Microsoft Fabric reshaping its identity and AI-generated dashboards ch...