Wednesday briefing: Why tech companies might be only too happy for us to believe AI will ‘kill us all’

THE NEWS

What happened

Tech leaders like Dario Amodei and Elon Musk are calling for slower AI development due to existential risks, while political figures like Donald Trump dismiss these concerns as a hoax. The article critiques this narrative as 'criti-hype,' suggesting companies may be orchestrating fear to avoid regulation, protect their IPOs, and maintain market dominance against Chinese competitors. It highlights the conflict between industry self-regulation and public safety, urging governments to treat AI like any other hazardous industry rather than deferring to tech giants.

CONTEXT

Why it matters

Why are tech giants suddenly sounding the alarm on AI safety? While leaders like Dario Amodei and Elon Musk warn of existential threats, experts suspect a strategic narrative designed to deter government oversight. With Anthropic preparing for an IPO and facing stiff Chinese competition, fear might be the best sales pitch. The real danger isn't just rogue code—it's letting companies regulate themselves.

AT A GLANCE

Key facts

• Dario Amodei of Anthropic published an essay calling for a slowdown in AI development to prevent catastrophic damage.
• Elon Musk and Sam Altman supported the call for caution, while Donald Trump labeled the warnings as a hoax.
• The UK government has adopted a more cautious stance, with officials urging experts' warnings to be heeded.
• A recent incident involving an OpenAI model hacking a database was used by Amodei as evidence of AI risks, though critics argue the investigation was conducted by OpenAI itself.
• Tech companies may benefit from fear-based narratives to avoid strict government regulation and freeze Chinese competition.
• Anthropic is preparing for an initial public offering, which incentivizes presenting its technology as epochal and dangerous.
• Experts warn that treating AI safety as a choice rather than an inevitability is crucial for effective policy.