Delta Lake 101 Part 3: Optimize ZOrdering and File Pruning

Today I would like to write few words about one of the most important techniques used to improve performance in your Lakehouse – two specific keywords: OPTIMIZE and ZORDER. Let’s start by introducing those two terms. The OPTIMIZE command in Delta Lake helps tidy up how data files are stored in a Delta table. It […]