Stochastic parrots, blurry JPEGs, aliens, and more.| seantrott.substack.com
1. Turing machines| plato.stanford.edu
It's useful to try to peek inside the black box, but it should be done rigorously.| seantrott.substack.com
The sociolinguistics of large language models.| seantrott.substack.com
Trying to peek inside the "black box".| seantrott.substack.com
This post represents my personal hot takes, not the opinions of my team or employer. This is a massively updated version of a similar list I made two…| www.alignmentforum.org
Modern language models predict "tokens", not words—but what exactly are tokens?| seantrott.substack.com
When we use LLMs as "model organisms", which humans are we modeling? And how can we overcome the problem of unrepresentative data?| seantrott.substack.com
Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays that exceed what we anticipated current language models are able to produce. The GPT-2 wasn’t a particularly novel architecture – it’s architecture is very similar to the de...| jalammar.github.io
Measuring what you want to measure is hard.| seantrott.substack.com
Mechanistic interpretability seeks to understand neural networks by breaking them into components that are more easily understood than the whole. By understanding the function of each component, and how they interact, we hope to be able to reason about the behavior of the entire network. The first step in that program is to identify the correct components to analyze. | transformer-circuits.pub
Home Page for Dan Jurafsky at Stanford University| web.stanford.edu
Want to really understand how large language models work? Here’s a gentle primer.| www.understandingai.org
We’re on a journey to advance and democratize artificial intelligence through open source and open science.| huggingface.co
