Our First Year

Note to readers: we changed our name to the AI Security Institute on 14 February 2025. Read more here.

World leaders gathered for the world’s first AI Safety Summit and concluded that powerful AI could have the “potential for serious, even catastrophic, harm.”

The UK’s cyber agency warned that “AI will almost certainly increase the volume and heighten the impact of cyber-attacks over the next two years.”

These international efforts require contributions from the AI developers. It is these companies, after all, who are ultimately responsible for the safety of their models. At the summit in Seoul, we secured commitments from 16 AI companies to identify, assess and manage AI risks. We’re advancing these Frontier AI Safety Commitments at our upcoming conference , in which AI developers can compare their approaches to developing their safety policies.

Demis Hassabis, at this point yet to receive his Nobel Prize, called for government to treat “the risks of AI as seriously as other major global challenges, like climate change.”

And the UK Government responded by launching the world’s first AI Safety Institute.

A year later, we have built a world leading government organisation for understanding AI threats. We run state of the art evaluations to measure potentially dangerous AI capabilities. We use these insights to create an international approach to defining and measuring these risks. And we conduct world-leading research to understand how these harms will impact our society.