The co-founder of AI company Anthropic has stated that the development of artificial intelligence cannot be left solely to technology companies, calling for increased oversight from religious leaders, governments, and civil society. Chris Olah made these remarks earlier this week during the presentation of Pope Leo’s first encyclical, which addresses the challenges posed by artificial intelligence.
A Call for Moral Responsibility
During his speech, Olah highlighted the “real possibility” that AI could lead to large-scale displacement of human labour. He emphasised that if such a scenario were to unfold, supporting those affected would become a moral imperative of historic proportions. “If that happens, supporting those displaced will be a moral imperative of historic proportions,” the Canadian said, while seated next to the pope.
Conflicts of Interest in AI Development
Olah pointed out that companies like Anthropic face significant commercial, geopolitical, and personal pressures that may not align with the broader interests of society. “Every frontier AI lab … operates inside a set of incentives and constraints that can sometimes conflict with doing the right thing,” he remarked. This reality, he argued, underscores the necessity for external scrutiny in the field of AI.
Anthropic’s Unique Position at the Vatican
Anthropic, founded in 2021 by Olah and other former OpenAI employees, stands out as the sole representative from the technology sector at the Vatican event. The company is known for developing the Claude AI tools and has been vocal about implementing safeguards to restrict the military use of its models. The founders left OpenAI over concerns that the latter was advancing too quickly without adequate testing.
Engagement with Religious Communities
When questioned by Reuters about his exclusive invitation from the Vatican, Olah attributed it to his longstanding commitment to AI safety and his engagement with various religious communities. “Ultimately, it’s the Vatican’s decision who they invite,” he stated, noting his career focus on making AI systems safer and his discussions with representatives from over 15 religions regarding the ethical implications of AI technology.
Ethical Questions Surrounding AI
Olah welcomed the Catholic Church’s involvement in the discourse surrounding AI, pointing out that the ethical questions posed by the technology extend far beyond engineering challenges. He acknowledged the public’s growing unease regarding AI, particularly among younger generations, and described the current moment as “scary.”
The Speed of Technological Advancement
“Things are moving fast. It’s a really powerful technology,” he remarked, warning that the rapid pace of AI development could lead to adverse outcomes. He urged collective responsibility to ensure the technology advances in a positive direction.
Priorities for AI Development
During his address, Olah identified three key areas that require urgent attention: the risk of significant job losses, the need for equitable distribution of AI benefits, and the challenges posed by the increasingly complex and opaque behaviour of AI systems. He raised concerns about the concentration of AI development in wealthy nations, asking, “How can we ensure the gains of AI are shared globally?”
The Role of Global Collaboration
Olah’s statements reflect a growing realisation within the tech community that collaboration across sectors is essential to address the multifaceted challenges posed by AI. By fostering a dialogue that includes diverse perspectives, including those from religious and civil society leaders, the industry can work towards solutions that benefit society as a whole.
Looking Forward
The convergence of technology and morality, as illustrated by this event at the Vatican, may signal a shift in how AI companies approach their responsibilities in the coming years. As the dialogue evolves, the urgency for a regulatory framework that balances innovation with ethical considerations will continue to gain prominence, highlighting the importance of outside scrutiny in guiding AI development.
