The Machine Intelligence Research Institute’s 2015 winter fundraising drive begins today, December 1! Our current progress: Donate Now The drive will run for the month of December, and will help support MIRI’s research efforts aimed at ensuring that smarter-than-human AI systems have a positive impact. MIRI’s Research Focus The field of AI […]| intelligence.org
(Epistemic status: attempting to clear up a misunderstanding about points I have attempted to make in the past. This post is not intended as an argument for those points.) I have long said that the lion’s share of the AI alignment problem seems to me to be about pointing powerful cognition at anything at all, rather […]| Machine Intelligence Research Institute
If Anyone Builds It, Everyone Dies As we announced last month, Eliezer and Nate have a book coming out this September: If Anyone Builds It, Everyone Dies. This is MIRI’s major attempt to warn the policy world and the general public about AI. Preorders are live now, and are exceptionally helpful. Preorder Bonus: We’re hosting […] The post MIRI Newsletter #123 appeared first on Machine Intelligence Research Institute.| Machine Intelligence Research Institute
We’re currently in the process of locking in advertisements for the September launch of If Anyone Builds It, Everyone Dies, and we’re interested in your ideas! If you have graphic design chops, and would like to try your hand at creating promotional material for If Anyone Builds It, Everyone Dies, we’ll be accepting submissions in […] The post IABIED: Advertisement design competition appeared first on Machine Intelligence Research Institute.| Machine Intelligence Research Institute
I think more people should say what they actually believe about AI dangers, loudly and often. Even (and perhaps especially) if you work in AI policy. I’ve been beating this drum for a few years now. I have a whole spiel about how your conversation-partner will react very differently if you share your concerns while […] The post A case for courage, when speaking of AI danger appeared first on Machine Intelligence Research Institute.| Machine Intelligence Research Institute
Nate and Eliezer’s forthcoming book has been getting a remarkably strong reception. I was under the impression that there are many people who find the extinction threat from AI credible, but that far fewer of them would be willing to say so publicly, especially by endorsing a book with an unapologetically blunt title like If […]| Machine Intelligence Research Institute
This is part of the MIRI Single Author Series. Pieces in this series represent the beliefs and opinions of their named authors, and do not claim to speak for all of MIRI. Several promising software engineers have asked me: Should I work at a frontier AI lab? My answer is always “No.” This post explores the […]| Machine Intelligence Research Institute
Rob Bensinger A huge announcement today: Eliezer Yudkowsky and Nate Soares have written a book attempting to raise the alarm about superintelligent AI for the widest possible audience — If Anyone Builds It, Everyone Dies. The book comes out this September 16, and preorders start today. This is Nate and Eliezer’s first mass-market book, and […] The post Yudkowsky and Soares Announce Major New Book: “If Anyone Builds It, Everyone Dies” appeared first on Machine Intelligence Research I...| Machine Intelligence Research Institute
Risks from Learned Optimization in Advanced ML Systems Evan Hubinger, Chris van Merwijk, Vladimir Mikulik, Joar Skalse, and Scott Garrabrant This paper is available on arXiv, the AI Alignment Forum, and LessWrong. Abstract: We analyze the type of learned optimization that occurs when a learned model (such as a neural network) is itself an optimizer—a... Read more »| Machine Intelligence Research Institute
What is the function of a fire alarm? One might think that the function of a fire alarm is to provide you with important evidence about a fire existing, allowing you to change your policy accordingly and exit the building. In the classic experiment by Latane and Darley in 1968, eight groups of […]| Machine Intelligence Research Institute