I am happy to report that life after Roblox does indeed exist. When I quit, people told me I should take some time off, relax, unwind, recharge, travel…| zeux.io
In the process of working on calm, a minimal from-scratch fast CUDA implementation of transformer-based language model inference, a critical consideration was establishing the speed of light for the inference process, and measuring the progress relative to that speed of light. In this post we’ll cover this theoretical limit and its implications.| zeux.io
A data structure that comes up fairly often when working with graphs or graph-like structure is a jagged array, or array-of-arrays. It’s very simple to build it out of standard containers but that’s often a poor choice for performance; in this post we’ll talk about a simple representation/construction code that I found useful across multiple different projects and domains. Crucially, we will focus on immutable structures - ones that you can build in one go from source data and then cont...| zeux.io