Most Faceswap Apps in Apple and Google Stores Could Be Used to Make Deepfake Nudes

Key Takeaways

• 70% of face‑swap apps can produce nonconsensual deepfake nudes
• Researchers tested 155 apps; 109 allowed synthetic intimate imagery
• Over 60 million downloads from Google Play for unsafe apps
• Top Apple apps earned >$186 k in one month despite risks
• AI models lack built‑in safeguards; developers and platforms ignore them

Pulse Analysis

The recent Cornell‑Georgetown working paper shines a light on a hidden corner of the AI app ecosystem: face‑swap tools that can be weaponized to create synthetic nonconsensual intimate images, often called SYNCII. By systematically probing 155 applications, the researchers uncovered a disturbing prevalence—roughly seven out of ten apps permit the creation of deepfake nudes with minimal friction. This finding underscores a broader trend where generative AI, originally celebrated for creative expression, is repurposed for malicious intent without adequate technical barriers.

From a platform governance perspective, the numbers are stark. Google Play alone recorded almost 60 million downloads of apps capable of producing SYNCII, while the highest‑grossing face‑swap apps on Apple’s store generated more than $186,000 in a single month. These revenue streams are often fueled by ad placements on adult sites and social media, indicating a monetization model that tacitly benefits from illicit content creation. Neither Apple nor Google have demonstrated robust content‑moderation frameworks for this niche, leaving a regulatory vacuum that could invite lawsuits, stricter oversight, and erosion of user trust.

The episode raises urgent questions about AI safety and responsibility. Current generative models were not engineered with built‑in safeguards to detect or block the synthesis of intimate imagery, placing the onus on developers and platform owners to implement protective measures. Potential solutions include watermarking generated media, integrating consent‑verification APIs, and enforcing stricter app‑store policies that require explicit safety features before approval. As AI continues to democratize image manipulation, proactive governance will be essential to balance innovation with the protection of individual privacy and societal norms.