Epistemic status: Mostly re-litigating old debates, I believe. Hopefully still somewhat interesting. This is just a short post for a short note which took me a worrying length of time to realize. For a while people were claiming that the pretraining next token prediction objective could directly lead to superintelligence...
