Reflections from a Data Scientist| ddanieltan.com
Today, our theme is dinosaurs, which made me think about the Datasaurus Dozen! This wild set of datasets is an extension of the famous Anscombe’s Quartet. Despite having completely different-looking distributions when plotted, every single one of the Datasaurus Dozen datasets has the exact same summary statistics. The Datasaurus Dozen is a great reminder for all us data folks to always look beyond summary statistics like the mean and standard deviation to truly understand what’s going on ...| ddanieltan.com
Today’s theme is a data day, so I went over to browse the interesting datasets available from the Asian Development Bank. I found this dataset that shows the inflation levels for Asian countries from 2019 to 2023, with forecasted numbers for 2024 and 2025. As always, I enjoy analysing data from my home region as it’s less widely covered on a global news. So I thought to focus my chart on Southeast asia, in particular, I wanted to highlight the volatile inflation levels experienced by coun...| ddanieltan.com
Weather Today’s theme is Weather and I while searching for inspiration I came across these beautiful wind rose charts from the Lets-Plot gallery.opted for a simple interpretation of showing the changing monthly temperature distribution over a year. Data is taken from a Python version of Forecasting: Principles and Practise. As always, I like to adapt the examples to my home country of Singapore and data for Singapore’s wind readings was provided by Iowa State University’s Iowa Environme...| ddanieltan.com
Today’s theme is Historical and I opted for a simple interpretation of showing the changing monthly temperature distribution over a year. Data is taken from a Python version going through what I consider the best time series textbook, Forecasting: Principles and Practise. Codeimport polars as plfrom lets_plot import*LetsPlot.setup_html()bikes = pl.read_csv('https://raw.githubusercontent.com/nshahpazov/fpp-in-python/master/data/bikes/day.csv')daily_temp = (bikes .filter(pl.col("yr") ==1) # 2...| ddanieltan.com
Family For today’s #30DayChartChallenge, the theme is “Family.” I must admit, my mind initially wandered to the Kardashians – but let’s move on from that little embarrassment! I’ve been eager to experiment with Sunburst charts during this challenge. In my opinion, these visually striking charts have a unique ability to convey hierarchical relationships in a captivating way. Fortunately for me, the Python Plotly library comes equipped with a pre-built sunburst module, making my tas...| ddanieltan.com
Today’s theme is Waffle and I would like to create a waffle chart. Waffle charts are excellent for displaying and comparing proportions or part-to-whole relationships within a dataset. They are particularly useful when you want to show how a whole is divided among different categories or segments. However, my visualisation library of choice lets-plot does not have a pre-made “geom” or layer specifically for waffle charts. This means that I have got to get a bit more hands-on to make one...| ddanieltan.com
Note This post is my contribution to this year’s #30DayChartChallenge. Check out my Day 1 post to learn more. Makeover Makeover day has arrived, folks! Time to dust off those old relics from the ancient data catacombs and give them a fresh coat of paint. Today’s lucky candidate? A vintage scatter matrix plot taken from an introductory Data Science course I took many years ago. The original scatter matrix plot, seen in the “Before” image, uses both histograms and scatter plots in a 4 p...| ddanieltan.com
Note This post is my contribution to this year’s #30DayChartChallenge. Check out my Day 1 post to learn more. Neo Today’s theme is Neo, and since I couldn’t immediately think of an associated chart, I decided to go with my first instinct: create something related to the groundbreaking 1999 movie, The Matrix. I remember watching The Matrix as a kid and being amazed by its mind-bending plot, cool 90s fashion, and fluid action scenes. Codeimport numpy as npimport polars as plfrom PIL impor...| ddanieltan.com
What is Exercism Exercism is a website where you can learn how to code in a variety of programming languages. I do enjoy learning new programming languages and this site is one of my favourite places to find both instructional as well as practical content and exercises. When it comes to learning a new programming language, I’ve found that online courses can sometimes provide too much instruction without enough hands-on practice. On the other hand, project-based learning can go too far in th...| ddanieltan.com
Summary 2023 was a busy year where I undertook more activities and projects than I initially planned for. Reflecting on the last day of the year, I am grateful and happy to have had a good year with my friends and family. For posterity, here are my notes of this year’s highs and lows. Highlights Building Organisation Habits The number 1 thing I wanted to do going from 2022 to 2023 was to be more organized about everything. I am really proud of the fact that I have built personalised process...| ddanieltan.com
Google IDX IDX is a project from Google that aims to provide an entirely cloud based app development experience. From development to deployment and everything in between can be done from the comfort of your web browser and seamlessly integrated through Google’s cloud ecosystem. While hardly the first in this space, the project piqued my interest and I signed up for beta access to give it a spin. Creating a new app The onboarding experience was very smooth, my google account was required to ...| ddanieltan.com
Learning Theme It’s the start of the new year, which means I’m committing to a new learning theme for the year! I’ve found that having a single learning theme for the whole year helps keep me focused and prevents me from getting too excited about exploring new topics. It also helps me make both short- and long-term plans without stressing myself out too much, since I’m juggling my independent learning with time for my family, work, and school. As I mentioned in my post about my learni...| ddanieltan.com
ddanieltan.com is your first and best source for all of the information you’re looking for. From general topics to more of what you would expect to find here, ddanieltan.com has it all. We hope you find what you are searching for!| www.ddanieltan.com
A tool that helps me manage pretty much everything| www.ddanieltan.com