DeepHorus is an innovative tech media and intelligence platform focused on AI, blockchain, startups, and emerging technologies.
Published on

Meta Pulls Ads, Apple Removes App

Authors
  • avatar
    Name
    DeepHorus
    Twitter

According to WIRED, an app called Kromix has drawn attention for running controversial ads on Meta's platforms. The app claims to be an "AI image stylization" tool, but it can actually generate pornographic "face-swap" content of real people. Meta and Apple have respectively taken down the related ads and the app.

Kromix's ads were all targeted at male users, with a total of 32 ads on Meta's platforms. Its slogans included "AI for real men" and "no limits." One of the ads used an AI-generated image highly resembling a well-known female political figure in the U.S., showing her transitioning from an ordinary scene to a pornographic video.

After WIRED contacted Meta and Apple, both companies took action. Meta removed the related ad campaigns, and Apple pulled Kromix from the App Store. Apple stated that the app may have added violating content and features only after passing its initial review, and emphasized that the company has always banned apps that distribute pornographic content.

This incident has once again raised concerns about AI "nudification" apps and the advertising review mechanisms on social platforms. Such tools can generate highly realistic pornographic content without the consent of the individuals involved, and even directly use real public figures' images for promotion, posing serious social risks.

This is not the first time Apple has recently dealt with similar issues. Last month, San Francisco District Attorney David Chiu asked Apple to remove eight apps that use AI to "undress" people in photos, and Apple subsequently took measures. This shows that such problems are not isolated in app stores.

Currently, Kromix has been removed from the App Store, but this case demonstrates that the risk of AI technology misuse is becoming increasingly evident. Platforms need to further strengthen review mechanisms and improve regulation of AI-generated content to prevent similar incidents from happening again.