Tech and Telecom

Apple and Google Ordered to Remove Apps Creating AI Deepfake Nudes

Apple and Google have received cease-and-desist letters demanding that they remove AI-powered “nudify” apps from their app stores.

San Francisco City Attorney David Chiu sent the letters after identifying 13 apps that can be used to create nonconsensual AI-generated intimate images. The letters accuse the companies of helping enable the spread of such content by continuing to host or process payments for the apps.

City Attorney Targets 13 Apps

According to Wired, Chiu’s office asked Apple and Google to remove the 13 apps and stop working with the developers behind them.

Ad Powered By Advergic
Loading ad . . .
Ad - Continue scrolling to read

The letters argue that the apps can be used to create explicit deepfake images without a person’s consent. Chiu also said Apple and Google may have earned millions of dollars through in-app payments linked to these services.

The San Francisco Chronicle reported that the city attorney also warned of possible legal action if the companies fail to act. Under California law, companies can face civil penalties of at least $25,000 per violation if they fail to respond after being alerted.

Not Chiu’s First Action Against Deepfake Platforms

This is not the first time Chiu has targeted AI tools used to create nonconsensual intimate images.

He previously filed a lawsuit against 16 websites that allegedly allowed users to turn images of real women and girls into pornography using AI. The latest action expands that pressure to Apple and Google, which control the two largest mobile app stores.

Report Says Apps Passed Store Reviews

The letters follow reporting from the Tech Transparency Project, which found that “nudify” apps were still appearing in Apple’s App Store and Google Play despite both companies’ policies against sexual and pornographic content.

The report said some apps were rated “E” for Everyone, meaning children could download them. It also said users could find such apps by searching terms like “nudify” or “undress.”

The Tech Transparency Project also said Apple and Google’s search and advertising systems sometimes directed users toward these apps, instead of blocking access to them.

Google Says It Has Removed Hundreds of Apps

Google told Wired that it had removed hundreds of apps with nudification features.

The company said five of those apps had been flagged by Chiu’s office. Google also said its policies ban sexual content and that it takes quick action when an app violates its rules.

Wired reported that Apple did not provide a comment before publication.

Deepfake Pressure Is Growing Across Tech

Apple and Google are not the only companies facing pressure over AI-generated nonconsensual imagery.

Meta’s Oversight Board has urged the company to improve protections for ordinary users targeted by deepfakes, while Elon Musk’s xAI has also faced legal action and scrutiny over nonconsensual AI-generated images.

The issue has become more urgent as AI image tools make it easier to create realistic fake content from ordinary photos. Regulators, researchers, and child-safety advocates are now pushing platforms to enforce stronger moderation before harmful apps reach users.

For Apple and Google, the cease-and-desist letters raise a direct question: whether app stores should be held responsible when banned AI tools still make it through review and generate revenue.

Stay Connected with ProPakistani

Get the latest tech news, telecom insights, and product launches wherever you prefer.

Add ProPakistani to Preferred Sources and see more of our stories in Google Search and Top Stories.

Share
Published by
Afaq Wajdan Malik