Analytics-Adjacent Ideas & Musings| DataDuel.co
I’ve been spending time doing some work with AI – and this blog is just a “check-in” journal on what has been working for me. This blog will begin with “Idea Honing” (mini PRD) and then move to an iterative development workflow, followed by an example project. Idea Honing You need to spend some time … Continue reading My exploratory AI workflow| DataDuel.co
The article discusses the evolution of business intelligence (BI) tools, questioning their longevity compared to the enduring nature of spreadsheets. It highlights how spreadsheets facilitated decision-making in the past but have become inadequate as data complexity increased. The author envisions a future "Spreadsheets 2.0," integrating advanced features, better orchestration, and AI support to revitalize the role of spreadsheets in data workflows.| DataDuel.co
AI tools like Codium's Windsurf IDE are reshaping coding practices through projects like updating a theme for Evidence.dev and developing a Terraform provider for MotherDuck. These experiences highlighted the strengths and limitations of AI in development, showcasing its potential as a collaborative partner despite issues with project understanding and syntax handling.| DataDuel.co
Executive Summary Firmographic data, like industry classification, employee count, and location, is notoriously messy and challenging to analyze. Modern databases offer a unique opportunity to clean and maintain this data: by leveraging an LLM, you can synthesize industry information for your accounts directly within a SQL query. I recently took on exactly this challenge, so … Continue reading LLMs in SQL? A real-world application to clean up your CRM data The post LLMs in SQL? A real-world...| DataDuel.co
No one knows what it means, but it’s provocative. It gets the people going! Chazz Michael Michaels Context: This is the first of a series of posts looking at Analytics Engineering as I’ve lived and breathed it since 2014, largely in the SaaS industry. This is not meant to provide universal truths, but rather give … Continue reading Defining Analytics Engineering| DataDuel.co
use these simple snippets to run 'uv pip install' inside your dev containers and github actions. for dev containers, use the root user.| DataDuel.co
Analysis & Narrative Written by Jacob Matson & Matt Levine, February 2024. [pdf] Executive Summary Our Methodology Findings & Results Raw Frequencies Sample Size: n = 8,162 games Losing Digit Winning Digit Frequency 7 0 3.99% 0 3 3.97% 4 7 3.47% 0 7 3.32% 0 4 3.11% Top 5 most frequent winning squares Weighted … Continue reading Analysis of Super Bowl Squares The post Analysis of Super Bowl Squares appeared first on DataDuel.co.| DataDuel.co
This post was co-written by Alex Noonan, Dani Mermelstein & Jacob Matson. Introduction In light of the recent price increases observed in products like dbt Cloud, coupled with the general pressure to maintain cost efficiency, we wanted to build a project template for running dbt in a production environment using GitHub Actions & AWS S3. … Continue reading Simple dbt runner| DataDuel.co
quick note: the justification for doing this is worth like a 17 page manifesto. I’m focusing on the how, and maybe I’ll eventually write the manifesto. General Approach This specific problem is loading Point-of-Sale data for a vertical specific system into a database for analysis on a daily basis, but could be generalized to most … Continue reading The ‘e’ in Hex is for ELT| DataDuel.co
I didn’t really set out to learn Docker when I started the MDS-in-a-box project, but as it turns out, Docker is quite a good fit. Part of this is because I desired to run the project in a Github Action, which is a very similar paradigm, and also because I have the notion (TBD) of … Continue reading| DataDuel.co