The world isn't a giant chess game.| www.understandingai.org
In this article, we provide a high level overview of a key trend in AI models; that AI models’ data requirements may be growing faster than the supply of suitable data. We then explore some implications.| futuretech.mit.edu
A new wave of startups are anticipating the existential crisis facing the AI industry: What happens when we run out of data?| Forbes
We estimate the stock of human-generated public text at around 300 trillion tokens. If trends continue, language models will fully utilize this stock between 2026 and 2032, or even earlier if intensely overtrained.| Epoch AI