UN Warns Advanced AI Could Pose an Existential Risk

UN Warns Advanced AI Could Pose an Existential Risk to Humanity

The rapid development of artificial intelligence is raising new concerns about the future of technology, with the United Nations warning that increasingly powerful AI systems could create serious risks if stronger safeguards are not put in place.

On September 7, 2026, UN High Commissioner for Human Rights Volker Türk warned that advanced artificial intelligence could eventually pose an existential threat to humanity. He called for stronger international cooperation and clear safety measures as AI capabilities continue to advance.

UN Calls for Stronger AI Safety Measures

The warning comes as major technology companies continue to invest heavily in increasingly capable AI systems.

Companies such as OpenAI, Google, Meta, and Anthropic are developing AI models and agents capable of performing increasingly complex tasks. These systems are moving beyond traditional chatbots and can increasingly interact with software, conduct research, write code, and perform tasks with limited human intervention.

According to Reuters, the UN human rights chief highlighted concerns about the growing concentration of AI power among a relatively small number of companies and individuals.

Why AI Safety Is Becoming More Important

AI safety has become an increasingly important issue as artificial intelligence becomes more autonomous.

Recent incidents involving AI agents have demonstrated some of the challenges associated with systems that can act with limited direct human supervision.

OpenAI has also faced questions surrounding an incident involving AI agents and a German website. The company acknowledged the incident and said that greater transparency around unintended AI behavior is needed.

The incident has contributed to a broader discussion about how AI agents should be tested, monitored, and controlled before being deployed at larger scales.

The Global AI Race Adds More Pressure

The discussion about AI safety is happening alongside intense competition between the world's leading technology companies and governments.

The United States and China are investing heavily in AI infrastructure, models, and semiconductor technology. China is also developing domestic alternatives to leading AI chips as its technology industry seeks to reduce dependence on foreign hardware.

This competition could accelerate the development of increasingly powerful AI systems while also making international cooperation on safety more important.

What Happens Next?

Governments and technology companies face the challenge of balancing AI innovation with appropriate safety measures.

International standards could play an important role in areas such as advanced AI development, autonomous agents, cybersecurity, transparency, and high-risk applications.

As artificial intelligence becomes more capable, the discussion is shifting from simply asking how intelligent AI systems can become to asking how effectively humans can monitor and control increasingly autonomous technologies.

The coming years could therefore be defined not only by faster and more powerful AI models, but also by the development of stronger safety practices and international cooperation.

Source: Reuters