Blog

Introducing LawZero

I am launching a new non-profit AI safety research organization called LawZero, to prioritize safety over commercial imperatives.

Implications of Artificial General Intelligence on National and International Security

As highlighted in the International Scientific Report on the Safety of Advanced AI, the capabilities of general-purpose AI systems have been steadily increasing over the last decade, with a pronounced acceleration in the last few years.

October 30 2024

Bounding the probability of harm from an AI to create a guardrail

As we move towards more powerful AI, it becomes urgent to better understand the risks, ideally in a mathematically rigorous and quantifiable way, and use that knowledge to mitigate them.

Reasoning through arguments against taking AI safety seriously

About a year ago, a few months after I publicly took a stand with many other peers to warn the public of the dangers related to the unprecedented capabilities of powerful AI systems, I posted a blog post entitled FAQ on Catastrophic AI Risks as a follow-up to my earlier one about rogue AIs, where I started discussing why AI safety should be taken seriously.

The International Scientific Report on the Safety of Advanced AI

In November 2023, I’ve been given the responsibility to chair the International Scientific Report on the Safety of Advanced AI as part of an international mandate following up from a resolution taken by 30 countries, as well as representatives from the EU and the UN, at the UK AI Safety Summit in Bletchley Park.

Towards a Cautious Scientist AI with Convergent Safety Bounds

How can we design an AI that will be highly capable and will not harm humans? In my opinion, we need to figure out this question - of controlling AI so that it behaves in really safe ways - before we reach human-level AI, aka AGI; and to be successful, we need all hands on deck.

February 26 2024

Proposal for a Multilateral Network of Public Good AI Research Labs to Protect Democracy and Humanity

I have been thinking about this question for several months: what if AI continues to progress towards and beyond our abilities in areas where it could become dangerous, and what if our regulations won't be 100% fullproof, opening the door to seriously harmful misuse by bad actors, historically never seen concentration of power and existential threats to our collective future?

September 12 2023

Personal and Psychological Dimensions of AI Researchers Confronting AI Catastrophic Risks

On May 31st, 2023, a BBC web page headlined: "AI 'godfather' Yoshua Bengio feels 'lost' over life's work." However, this is a statement I never made, not to the BBC nor to any other media.