Deepfake fraud: AI-generated voice and video attacks on business
Deepfake fraud uses AI-generated voice and video to impersonate executives and authorize payments. This is how the attacks work and how to defend your organization.
Written by
R
Raptoric AI Security
Share
LinkedInX / TwitterCopy link
Deepfake fraud is the use of AI-generated voice or video to impersonate a real person, usually to deceive an employee into transferring money, sharing data, or approving a request. It is social engineering supercharged by AI: where a fraudster once relied on a convincing email, they can now clone an executive's voice from public clips, or generate a video of a leader on a call, and use it to make a fraudulent request feel legitimate. Publicly reported cases have included finance staff transferring large sums after video calls with what appeared to be their own executives, but were entirely fabricated.
What makes deepfake fraud dangerous is that it attacks the human trust signals organizations rely on. We are trained to trust a familiar voice and face, and deepfakes turn that trust into a vulnerability. The defenses are not primarily technical detection, which is an arms race, but process: verification steps that do not depend on recognizing a voice or face. This article explains how deepfake fraud works and how to defend against it, connecting to our work on social engineering and AI security.
What is deepfake fraud?
A deepfake is synthetic media, audio, video, or both, generated by AI to convincingly imitate a real person. Deepfake fraud applies this to social engineering: the attacker impersonates someone the target trusts, typically an executive, a supplier, or a colleague, to authorize a fraudulent action. The most common targets are payments and sensitive data, the same goals as business email compromise, but with a far more convincing impersonation.
The technology has crossed a threshold. Voice cloning now needs only seconds of sample audio, which is readily available for any executive who has spoken publicly. Real-time video deepfakes, once a research curiosity, are increasingly practical. That means the convincing email of a few years ago can now be a convincing phone call or video meeting.
How deepfake attacks work
Deepfake fraud typically follows the same arc as other targeted social engineering, with AI raising the believability.
Reconnaissance, where the attacker gathers public audio, video, and organizational details about the target and the person to impersonate.
Synthesis, where AI generates a cloned voice or video of the trusted individual from that material.
Pretext and pressure, where the impersonator makes an urgent request, a confidential payment, a change to bank details, a sensitive data transfer.
Exploiting trust and urgency, where the familiar voice or face combined with time pressure short-circuits the target's caution.
Execution, where the deceived employee performs the action before any independent verification.
Deepfake fraud does not break your technology. It breaks the assumption that a familiar voice or face proves who you are talking to. The defense has to live in process, not perception.
Why deepfake fraud is hard to stop with detection alone
It is tempting to hope that deepfake-detection technology will solve the problem, but relying on it is risky. Generation and detection are locked in an arms race, and detection tends to lag. Worse, detection puts the burden on a human in the moment, expecting an employee on a live call to spot a fake under pressure. That is not a reliable control. The durable defenses do not depend on detecting the fake at all; they depend on verifying the request through a channel the attacker does not control.
How to defend against deepfake fraud
Because deepfake fraud targets process and trust, the strongest defenses are procedural and organizational.
Require out-of-band verification for sensitive actions, confirming any payment or data request through a separate, known channel such as a callback to a trusted number.
Establish strict procedures for payments and changes to bank details, so no single request, however convincing, can authorize them alone.
Use agreed verification methods for high-risk requests, such as a code word or a second approver, that a deepfake cannot supply.
Train employees specifically on deepfake fraud, so they expect convincing impersonation and know the verification steps are mandatory, not optional.
Limit unnecessary public exposure of executive voice and video where practical, reducing the raw material for cloning.
Foster a culture where verifying a request is never treated as an insult, removing the social pressure that fraud exploits.
These controls overlap with defenses against phishing and business email compromise, because deepfake fraud is the same class of attack with a more convincing impersonation. We test organizational resilience to phishing and social engineering through the social engineering work in our offensive security service.
Deepfake fraud takes the oldest attack, deception, and makes it far more convincing with AI. The defense is process that does not depend on trusting a voice or a face. If you want to test and strengthen your organization's resilience to social engineering and deepfake fraud, see our offensive security service and book a scoping call.
Frequently asked questions
What is deepfake fraud?+
Deepfake fraud is the use of AI-generated voice or video to impersonate a trusted person, usually an executive, supplier, or colleague, in order to deceive an employee into transferring money, sharing data, or approving a fraudulent request.
How do criminals make deepfakes of executives?+
Voice cloning needs only seconds of sample audio, which is readily available for anyone who has spoken publicly, and real-time video deepfakes are increasingly practical. Attackers gather public media and organizational details, then generate a convincing impersonation.
Can deepfake-detection technology stop this?+
Not reliably on its own. Generation and detection are in an arms race, and detection lags, while expecting an employee to spot a fake live under pressure is not a dependable control. The durable defense is out-of-band verification that does not rely on detecting the fake.
How do we protect against deepfake fraud?+
Require out-of-band verification for sensitive actions, set strict procedures for payments and bank-detail changes, use agreed verification methods such as code words or second approvers, train staff specifically on deepfakes, and build a culture where verifying a request is always acceptable.
Sources
1ENISA. ENISA Threat Landscape 2024. European Union Agency for Cybersecurity, 2024. Link
2NIST. Artificial Intelligence Risk Management Framework (AI RMF 1.0). National Institute of Standards and Technology, 2023. Link