AI Is Getting Really Good at Messing With Cybercriminals

THE NEWS

What happened

AI technology is being deployed by companies like Apate to combat cybercrime by acting as 'perfect victims' for scammers. These AI bots engage fraudsters in long conversations, wasting their time and resources while collecting intelligence on scam operations. Additionally, researchers are using LLM-powered honeypots to deceive AI-driven attackers, marking a new era where generative AI is used defensively to disrupt criminal enterprises.

CONTEXT

Why it matters

AI is no longer just for criminals; it's now a powerful weapon in the fight against them. Companies like Apate deploy massive swarms of bots that mimic real victims, keeping scammers on the line for hours while collecting crucial data on their operations. Simultaneously, researchers are using LLM-powered honeypots to trick AI-driven hackers into wasting resources. This marks a significant shift where generative AI helps defenders disrupt criminal enterprises and protect users from fraud.

AT A GLANCE

Key facts

• Australian company Apate has built a system with over 350,000 AI bots designed to act as fake victims for phone and text scammers.
• The goal of these bots is to keep conversations going for hours, frustrating scammers and preventing them from targeting real people.
• Apate has collected more than 250,000 pieces of intelligence on fraudsters, including scam URLs and bank details.
• Research from ETH Zurich shows that LLM-powered honeypots can keep AI attackers engaged significantly longer than traditional systems.
• Generative AI is shifting the landscape from being a tool for crime to a critical asset in defensive security operations.