Manhattan prosecutors have seized 12 websites accused of distributing and selling AI-generated deepfake pornography involving about 1,200 individuals.
The Manhattan District Attorney's Office announced the seizure on Monday, 14 September, stating that the sites used AI to transform existing photos and videos of real people into realistic sexual content without consent.
Most victims were women, including actors, politicians, athletes, musicians, activists, and social media influencers.
Non-Consensual Imagery Used For Profit
Authorities seized the websites by court order for unlawfully distributing, publishing, and selling non-consensual intimate imagery.
Manhattan District Attorney Alvin Bragg stated that victims' faces and bodies were used without their knowledge or permission.
'These horrific violations of privacy follow victims into their careers and personal lives and take an immense toll on emotional and mental well-being,' Bragg said.
'I want to be clear: We do not tolerate sexual exploitation in any form, including sharing or selling deepfake pornography.'
Inside the Investigation
The investigation began after a victim reported her images on one of the sites, enabling authorities to identify the websites and initiate seizures.
No arrests or charges have been announced. Prosecutors continue to investigate those responsible for these sites and related operations.
Bragg noted that the 12 seized domains represent only part of the broader problem of AI-generated sexual imagery.
Celebrities Affected
Major public figures have also been targeted. In January 2024, sexually explicit AI-generated images resembling Taylor Swift circulated widely online.
According to the Associated Press, the images spread primarily on X, with some appearing on Facebook and other platforms. Swift did not publicly comment.
NSFW deepfakes of Taylor Swift are reigniting the debate about AI and consent. Here’s what’s going on… pic.twitter.com/2Ejt0AYi8G
— Brut America (@brutamerica) January 25, 2024
The incident renewed attention among US lawmakers on legislation addressing non-consensual, AI-generated intimate images.
Scarlett Johansson has also addressed the broader risks of deepfake technology following a dispute involving an AI-generated voice resembling hers.
In an interview with The New York Times, Johansson described deepfake technology as a 'dark wormhole you can never climb your way out of'.
'Once you try to take something down in one area, it pops up somewhere else,' she said.
Johansson also discussed the potential impact of deepfake pornography, noting that if an ex-partner published such material as an act of revenge, 'your whole life can be completely ruined'.
New York's Deepfake Law
New York law covers certain AI-generated or digitally altered intimate images.
Under Penal Law § 245.15, it is a Class A misdemeanour to intentionally disseminate or publish an identifiable intimate image without consent. This includes an image created or altered through digitisation, where there is intent to cause harm.
This provision covers realistic alterations that use another person's likeness or computer-generated images when the individual is identifiable and has not given consent.
More Sites To Face Scrutiny
The seized domains now display notices indicating they were taken over under a seizure warrant issued by the New York State Supreme Court.
Prosecutors urge anyone who believes they have been targeted to contact the Manhattan DA's Cyber Crime Bureau. They are actively seeking to identify those responsible for creating, distributing, and profiting from this material.
The seizure highlights the increasing challenge of addressing non-consensual sexual imagery as AI makes such content easier to produce and share.
