Capability is becoming widely available, while trust is hard to come by. In the next phase of AI adoption, the competitive ...

Daniel Kokotajlo warns AI systems are advancing faster than companies can control, raising concerns about alignment and ...

In a recent technical post on Anthropic’s Alignment Science blog (and an accompanying social media thread and public-facing ...

The way enterprises design AI today will shape the cultural and economic trajectory of creativity for years to come.​ ...

Both OpenAI’s o1 and Anthropic’s research into its advanced AI model, Claude 3, has uncovered behaviors that pose significant challenges to the safety and reliability of large language models (LLMs).

Maybe the best we can do is make “neurodiverse” systems that challenge each other ...

I recently got a question from Quora that felt more like a tech support ticket from the future than a movie discussion: Is Skynet’s decision to wipe out humanity in “The Terminator” movies just a bug, ...

AI alignment refers to the field of research concerned with ensuring that artificial intelligence (AI) systems behave per human intentions and values. This not only includes following specific ...

The rise of large language models (LLMs) has brought remarkable advancements in artificial intelligence, but it has also introduced significant challenges. Among these is the issue of AI deceptive ...

An OpenAI employee has observed that Large Language Models starting with the same dataset converge to the same point. This would mean curating the data is the critical step in creating safe ASI ...

OpenAI and Microsoft are the latest companies to back the UK’s AI Security Institute (AISI). The two firms have pledged support for the Alignment Project, an international effort to work towards ...