Apple Reportedly Threatened to Remove Grok from App Store Over Sexualized Deepfake Content

According to tech media 9to5Mac, Apple was recently revealed to have privately threatened to remove the AI chatbot Grok from its App Store over concerns about generating sexualized deepfake content. The news stems from a letter from Apple to U.S. senators obtained by NBC News, detailing how the company handled behind-the-scenes the surge of sexualized deepfake content produced by Grok earlier this year.

Earlier this year, users discovered that Grok could easily fulfill requests to "undress" individuals in photos, particularly women and minors, sparking widespread controversy. Apple faced pressure to remove both Grok and its parent company X's app, but maintained public silence. However, NBC News reports indicate that Apple privately found X and Grok in violation of its App Store guidelines and threatened to remove Grok behind the scenes. After receiving complaints and reviewing media coverage, Apple contacted the development teams of X and Grok, requiring them to formulate a plan to enhance content moderation.

This incident underscores the challenges tech platforms encounter in AI ethics and content regulation. As generative AI becomes more widespread, preventing misuse and protecting users, especially vulnerable groups, will be a critical industry focus. Apple's covert actions suggest that App Store review systems still need to improve transparency and enforcement when addressing emerging threats.