AI can improve medical care, legal services, education and scientific innovation. However, AI also poses substantial risks both from unintended consequences and from deliberate misuse by malicious actors. Addressing the social and political challenges posed by advanced AI is quickly becoming one of the world’s most urgent problems. These issues are in the news daily, but rigorous work to understand them remains sparse.