I was giving a presentation about Microsoft Fabric Python notebooks and someone asked if they scale. The short answer is yes. You can download the notebook and try it for yourself. For the long ans…| Small Data And self service
TL;DR: Shared a notebook showing the results of Iceberg metadata conversion to Delta in Onelake. I’ve been following the evolution of Iceberg shortcuts to OneLake and I’m genuinely impressed with how the engineering team has invested so much energy into making it more robust, it is a good idea to read the documentation. Essentially, XTable … Continue reading "Stress Testing Iceberg shortcut in Onelake"| Small Data And self service
Note: The blog and especially the code were written with the assistance of an LLM. TL;DR I built a simple Fabric Python notebook to orchestrate sequential SQL transformation tasks in OneLake using …| Small Data And self service
This is more or less the industry consensus on how a Lakehouse architecture should look in 2025. By now, it’s become clear that Parquet is the de facto standard for storing data, and using an object store to separate storage from compute makes a lot of sense. Another interesting development is how vendors want to … Continue reading "An Excel User’s Perspective on Lakehouse Architecture"| Small Data And self service