I’m writing a new guide to careers to help AGI go well. Here's a summary of the key messages as they stand.| benjamintodd.substack.com
Avert AI catastrophes with technology for safety and hardening without requiring centralizing control. Diffuse AI that differentially augments rather than automates humans and decentralizes power. Democratize institutions, bringing them closer to regular people as AI grows more powerful.| The Intelligence Curse
I'm writing a new guide to careers to help artificial general intelligence (AGI) go well. Here's a summary of the bottom lines that'll be in the guide as it stands. Stay tuned to hear our full reasoning and updates as our views evolve. In short: The chance of an AGI-driven technological explosion before 2030 — creating one of the most pivotal periods in history — is high enough to act on.| 80,000 Hours
In elaborating this critique, Todd is among the few European intellectuals to echo a diagnosis of technological stagnation similar to those of Americans such as Robert Gordon, Peter Thiel, and Tyler Cowen. The extraordinary development of information technology should have sparked a Promethean sense of agency across society and among elites. Instead, both leaders and people have, each in their own ways, lost faith in the future, with definite optimism giving way to debilitating passivism. Tod...| American Affairs Journal
As the race to AGI intensifies, the national security state will get involved. The USG will wake from its slumber, and by 27/28 we’ll get some form of government AGI project. No startup can handle superintelligence. Somewhere in a SCIF, the endgame will be on. "We must be curious to learn how such a set| SITUATIONAL AWARENESS
Superintelligence will give a decisive economic and military advantage. China isn’t at all out of the game yet. In the race to AGI, the free world’s very survival will be at stake. Can we maintain our preeminence over the authoritarian powers? And will we manage to avoid self-destruction along the way? The story of the| SITUATIONAL AWARENESS
Reliably controlling AI systems much smarter than we are is an unsolved technical problem. And while it is a solvable problem, things could very easily go off the rails during a rapid intelligence explosion. Managing this will be extremely tense; failure could easily be catastrophic. The old sorcererHas finally gone away!Now the spirits he controlsShall| SITUATIONAL AWARENESS
The AI regulator’s toolbox: A list of concrete AI governance practices| adamjones.me
AGI by 2027 is strikingly plausible. GPT-2 to GPT-4 took us from ~preschooler to ~smart high-schooler abilities in 4 years. Tracing trendlines in compute (~0.5 orders of magnitude or OOMs/year), algorithmic efficiencies (~0.5 OOMs/year), and “unhobbling” gains (from chatbot to agent), we should expect another preschooler-to-high-schooler-sized qualitative jump by 2027. Look. The models, they just| SITUATIONAL AWARENESS