In an interview in 2019, OpenAI CEO Sam Altman explained how he had to come up with the “capped profit” structure to prevent investors from getting too much of the pie because the company could “maybe capture the light cone of all future value in the universe.” This sounds like a hyperbolic rhetorical flourish to induce investor excitement. Actually, it is the straightforward sincere belief of the AI alignment community that has become the center of discourse about what recursively se...