UK’s AI Security Institute Launches Alignment Project

As AI systems begin showing PhD-level reasoning in some areas, experts warn that current safety measures may not be enough.

Amazon Web Services (AWS) will support the project with free cloud credits for testing. Other partners include Anthropic, Canada’s AI Safety Institute, CIFAR, Schmidt Sciences, UKRI, ARIA, and several civil society groups.

Read Also - Sprout Social Acquires Dublin-Based NewsWhip

Geoffrey Irving, Chief Scientist at the AI Security Institute, emphasised: “AI alignment is one of the most urgent and under‑resourced challenges of our time. … Misaligned, highly capable systems could act in ways beyond our ability to control, with profound global implications.”

Secretary of State for Science, Innovation and Technology Peter Kyle added: “Advanced AI systems are already exceeding human performance in some areas, so it’s crucial we’re driving forward research to ensure this transformative technology is behaving in our interests.”

The launch comes as generative AI continues to transform industries like software, healthcare, and education. At the Seoul AI Summit in May 2024, the UK and countries like Canada, Japan and the EU agreed to build a global network of AI safety institutes to share research and standards.

In July 2025, the UK also signed a strategic deal with OpenAI to strengthen AI security, infrastructure, and public sector deployment.

The project is now inviting governments, philanthropists, and investors to support through funding, compute resources, or backing alignment-focused startups.