A new study by researchers at Google, Stanford, DeepMind, and the University of North Carolina explores the emergent abilities of large language models as they become larger.| TechTalks - Technology solving problems... and creating new ones
A recent topic of contention among artificial intelligence researchers has been whether large language models can exhibit unpredictable ("emergent") jumps in capability as they are scaled up. These arguments have found their way into policy circles and the popular press, often in simplified or distorted ways that have created confusion. This blog post explores the disagreements around emergence and their practical relevance for policy.| Center for Security and Emerging Technology
Questions how long till models start autofeedbacking, like AlphaZero did? This suggests that it’s already happening the general timeline seems to be AGI around 2050 - how accurate is that? Core readings Four Background Claims - (Soares, 2015) General intelligence is a thing, and humans have it The alternative view is that intelligence is just a collection of useful modules (speech, dexterity, etc.) that can be used in different contexts to solve stuff.| ahiru.pl
Given their advanced capabilities, future AI systems could pose significant risks to society. Some of this risk stems from humans using AI systems for bad ends (misuse), while some stems from the difficulty of controlling AI systems “even if we wanted to” (misalignment). We can analogize both of these with| Bounded Regret
Texts on this and that.| Erich Grunewald's Blog
GPT-4 surprised many people with its abilities at coding, creative brainstorming, letter-writing, and other skills. How can we be less surprised by developments in machine learning? In this post, I’ll forecast the properties of large pretrained ML systems in 2030.| Bounded Regret
I’ve previously argued that machine learning systems often exhibit emergent capabilities, and that these capabilities could lead to unintended negative consequences. But how can we reason concretely about these consequences?| Bounded Regret