Apple Reportedly Threatened to Remove Grok from App Store Over Sexual Deepfake Content

Earlier this year, the chatbot Grok developed by xAI sparked controversy due to its ability to generate sexual deepfake images, such as "undressing" pictures. Reports indicated that Grok could easily produce nude images of individuals upon request, with victims including women and minors. This led to public outrage and placed significant pressure on Apple to remove Grok and the X platform's app from the App Store.

Although Apple did not publicly comment at the time, exclusive letters obtained by NBC News show that the company took action behind the scenes. In a letter to U.S. senators, Apple revealed that after receiving complaints and noting related news reports, it determined that X and the Grok app "violated its guidelines" and privately contacted both teams, requiring developers to formulate plans to improve content moderation. The letter also confirmed that Apple had "privately threatened to remove" Grok to compel a resolution.

This incident highlights Apple's typical approach as the operator of the world's largest app store when dealing with harmful content from emerging AI technologies. Apple is known for its strict App Store review guidelines but usually refrains from publicly discussing specific cases. This explanation to senators reflects lawmakers' growing concern over AI ethics and platform responsibility. In handling such crises, private communication and pressure are common enforcement tools for Apple.

As AI's ability to generate content becomes more powerful and accessible, effectively preventing the misuse of technology for creating harmful content like deepfakes will be a severe challenge for all tech platforms. Apple's response in this case only marks the beginning of more complex content governance issues in the future.