Some privacy related extensions may cause issues on x.com. Please disable them and try again.| X (formerly Twitter)
Some privacy related extensions may cause issues on x.com. Please disable them and try again.| X (formerly Twitter)
Hey! I semi-frequently link to essays that are still being written, and track when these links get clicked. I haven’t finished this essay yet, but it’s in progress (: By clicking the link, you’ve let me know what to prioritise in my writing.| boydkane.com
Reproducibility is a bedrock of scientific progress. However, it’s remarkably difficult to get reproducible results out of large language models. For example, you might observe that asking ChatGPT the same question multiple times provides different results. This by itself is not surprising, since getting a result from a language model involves “sampling”, a process that converts the language model’s output into a probability distribution and probabilistically selects a token. What mig...| Thinking Machines Lab
Something that’s painfully understudied is how experts are more efficient than novices while achieving better results. I say understudied and not unstudied, because it’s common knowledge that charging people for their time results in experts being paid less since they work faster, which is why experts charge more for their time.| boydkane.com
We investigate the internal mechanisms used by Claude 3.5 Haiku — Anthropic's lightweight production model — in a variety of contexts, using our circuit tracing methodology.| Transformer Circuits
