The leading AI companies are increasingly focused on building generalist AI agents -- systems that can autonomously plan, act, and pursue goals across almost all tasks that humans can perform. Despite how useful these systems might be, unchecked AI agency poses significant risks to public safety and security, ranging from misuse by malicious actors to a potentially irreversible loss of human control. We discuss how these risks arise from current AI training methods. Indeed, various scenarios ...| arXiv.org
Mila is a Montreal-based artificial intelligence research institute that brings together researchers from Université de Montréal, McGill University, Polytechnique Montréal and HEC Montréal.| mila.quebec