Michael Nielsen offers an excellent essay on "artificial superintelligence (ASI)" and the question of its "alignment" with human values: [I]t is intrinsically desirable to build powerful truthseeking ASIs, because of the immense benefits helpful truths bring to humanity. The price is that such systems will inevitably uncover closely-adjacent dangerous truths. Deep understanding of reality is intrinsically dual use. ASIs which speed up science and technology will act as a supercharger, perhaps...
