Reliably controlling AI systems much smarter than we are is an unsolved technical problem. And while it is a solvable problem, things could very easily go off the rails during a rapid intelligence explosion. Managing this will be extremely tense; failure could easily be catastrophic. The old sorcererHas finally gone away!Now the spirits he controlsShall| SITUATIONAL AWARENESS
dedicated to Norman Skliar and Sidney Cahn In an earlier blog-essay, When 1+1 Equals 0, I explained how 1 + 1 = 0 makes sense in mod 2 arithmetic; today I’ll tell you how the equation 1 + 1 = 1 mak…| mathenchant.wordpress.com