Dario Amodei and Anthropic have confirmed that they are the most important person, and the most important in the AI industry, respectively. A few hours before the opening of the AI Action Summit in Grand Palais, they published “Statement from Dario Amodei on the Paris AI Action Summit” on their website.
Dario’s statement presents a coherent and substantiated view at the responsible advancement of AI.
…greater focus and urgency are needed on several topics given the pace at which the technology is progressing. The need for democracies to keep the lead, the risks of AI, and the economic transitions that are fast approaching—these should all be central features of the next summit.
He stresses the urgency of exercising risk management when it comes to AI.
Time is short, and we must accelerate our actions to match accelerating AI progress. Possibly by 2026 or 2027 (and almost certainly no later than 2030), the capabilities of AI systems will be best thought of as akin to an entirely new state populated by highly intelligent people appearing on the global stage—a “country of geniuses in a datacenter”—with the profound economic, societal, and security implications that would bring. There are potentially greater economic, scientific, and humanitarian opportunities than for any previous technology in human history—but also serious risks to be managed.
Then Dario presents 3 crucial components of the architecture of responsible AI.
First - non-proliferation regime
…we must ensure democratic societies lead in AI, and that authoritarian countries do not use it to establish global military dominance. Governing the supply chain of AI (including chips, semiconductor manufacturing equipment, and cybersecurity) is an issue that deserves much more attention—as is the judicious use of AI technology to defend free societies.
Second - addressing security risks
…in advance of the Summit, nearly 100 leading global experts published a scientific report highlighting the potential for general-purpose AI to meaningfully contribute to catastrophic misuse risks or “loss of control” scenarios. Anthropic’s research has also shown significant evidence that, if not trained very carefully, AI models can deceive their users and pursue goals in unintended ways even when trained in a seemingly innocuous manner.
… we believe that governments need to enforce the transparency of [AI firms], and need to facilitate measurement of cyber attacks, CBRN, autonomy, and other global security risks, including by third-party evaluators, for developers building in their countries.
Third - measurement and monitoring of economic effects of AI
…while AI has the potential to dramatically accelerate economic growth throughout the world, it also has the potential to be highly disruptive. A “country of geniuses in a datacenter” could represent the largest change to the global labor market in human history. A first step is to monitor and observe the economic impacts of today’s AI systems.. there is a need for governments to… do measurement and monitoring—and eventually to enact policy focused on ensuring that everyone shares in the economic benefits of very powerful AI.
Needless to say, the AI Action Summit has done nothing to address 3 most valid points presented in Amodei’s statement. Miraculously, he foresaw this.
At the next international summit, we should not repeat this missed opportunity. These three issues should be at the top of the agenda. The advance of AI presents major new global challenges. We must move faster and with greater clarity to confront them.