Z-ordering and Liquid Clustering both aim to improve Databricks query performance through data skipping. But when your data is skewed, one of them quietly becomes useless. A visual explanation of why — and how the Hilbert curve changes everything.
Z-ordering and Liquid Clustering both aim to improve Databricks query performance through data skipping. But when your data is skewed, one of them quietly becomes useless. A visual explanation of why — and how the Hilbert curve changes everything.
A vendor-neutral look at the architectural trade-offs that actually matter I have spent over 20 years building and optimising enterprise data warehouses, mostly on Teradata, and increasingly on Snowflake and Databricks. What I have observed repeatedl...
When Microsoft launched Fabric, it promised to unify analytics under one roof. Databricks, meanwhile, has been building its lakehouse platform for years. Both aim to be your central data platform — but they make fundamentally different bets on how mu...
If you have spent any amount of time working with Teradata, you know that the Primary Index is one of the most important design decisions you make. It determines how data is distributed across AMPs and whether your joins are fast or slow. Choosing th...
There was a time when a single team could build an entire data warehouse. Not a team of forty. Not a team of sixty distributed across three continents and coordinated by a project management office that had never seen an execution plan. A team of fiv...
Somewhere around 2020, the data world quietly arrived at a conclusion that Teradata engineers could have told you in 1984: SQL on a massively parallel architecture is a pretty good way to process large volumes of data. The path to get there was anyth...
Migration success stories are everywhere. A quick search reveals case studies of companies that moved from Teradata to Snowflake and achieved faster queries, lower total cost of ownership, and happier analysts. Vendors publish them. Consultants refer...
Why data warehouse professionals have been doing “bronze, silver, gold” for over 20 years. If you have been working in data warehousing for any length of time, the first time you heard about the “medallion architecture” you probably had one reaction:...
Most organizations approach a Teradata-to-Snowflake migration as a translation exercise: convert the SQL, move the data, and validate the results. The technical migration succeeds. Then the first quarterly bill arrives at double the projected budget,...
Introducing DWHPro Query Master: A Modern Web-Based Alternative to Teradata Studio As Teradata professionals, we’ve all been there: waiting for Teradata Studio to launch, dealing with Java updates, or struggling with its dated interface when all we w...