Epistemic note: Very short point and I’m pretty uncertain on this myself. Trying to work out the arguments in blog format. In the alignment discourse I notice a lot of vaguely described but very real worry along the lines of “Even if we train an AI to be aligned and...