Are you part of an under-resourced team where adding time-saving dbt (data build tool) features take a back seat to delivering new datasets? Do you want to incorporate time (& money) saving dbt processes but need more time? While focussing on delivery may help in the short term, the delivery speed will suffer without proper workflow! A good workflow will save time, prevent bad data, and ensure high development speed! Imagine the time (& mental pressure) savings if you didn't have to validate ...| www.startdataengineering.com
Published: Wed 11 January 2017| www.pgcli.com
Published: Tue 28 June 2016| www.pgcli.com
Published: Sun 08 November 2015| www.pgcli.com
Published: Sat 31 October 2015| www.pgcli.com
Published: Tue 04 August 2015| www.pgcli.com
Published: Mon 03 August 2015| www.pgcli.com
Published: Tue 26 May 2015| www.pgcli.com
Published: Thu 02 April 2015| www.pgcli.com
Published: Sun 22 March 2015| www.pgcli.com
Published: Tue 03 March 2015| www.pgcli.com
Published: Sun 01 March 2015| www.pgcli.com
With the advent of powerful data warehouses like snowflake, bigquery, redshift spectrum, etc that allow separation of storage and execution, it has become very economical to store data in the data warehouse and then transform them as required. This post goes over how to design such a ELT system using stitch and DBT. The main objective is to keep the code complexity and server management low, while automating as much as possible| www.startdataengineering.com
Tutorial on what happens when you create an index in a database. Trade offs to be aware of while creating an index and how to use it efficiently.| www.startdataengineering.com
DBT (data build tool) tutorial. Build a project simulating a real life ELT project using the data build tool.| www.startdataengineering.com