Every ADF run balanced while the source and target drifted apart. The missing rule was not uniqueness: a watermark value must be complete before the pipeline moves past it.
Why boring tools, clear responsibilities, and the right abstractions give me back my weekends.
Most Medallion explainers say what each layer does, never why it exists. The answer: Silver is the modern Operational Data Store.
Is the 40-year-old Kimball dimensional model compatible with modern Materialized Lake Views? One Fabric engineer’s deep dive into late-arriving dimension corrections, incremental refresh limits, and why the real optimisation isn’t faster refreshes — it’s smaller ones.
Most web scraping problems aren’t really scraping problems. They’re rendering problems. Here’s what I learned when Power Query returned an empty div and Web Browser Content saved the day.
OneLake security just hit GA in May 2026 — and it’s a game-changer for Microsoft Fabric governance. Here’s how the new unified data plane security model closes the gaps between Power BI, Spark, and SQL analytics endpoints, with real code and gotchas I’ve learned the hard way.
We’ve all been there: it starts as a simple proof-of-concept. You open up a new Notebook in Microsoft Fabric, write...
A few years ago, I was testing an Azure Function that pulled secrets from Key Vault. It worked flawlessly on...
A few months ago, I was minding my own business—tuning data pipelines, optimizing our queries, and doing the usual data...
The Permission Paradox Picture this: I’m sitting in yet another emergency meeting because someone can’t access the resources they need...