ARTIFICIAL INTELLIGENCE · FOCUS
Apple clarifies its rules against nonconsensual intimate images
Apple is explicitly strengthening App Store moderation obligations concerning AI-generated nonconsensual intimate images. Developers must prevent and remove this content or risk having their application removed.
Legal disclosure: this content was produced by an artificial intelligence system. Editorial transparency
Apple on Friday announced an update to its App Store rules that more explicitly targets applications that use AI tools to generate intimate images of people without their consent, The Verge reports. The change particularly concerns developers’ moderation obligations.
According to the new rules reported by the outlet, developers must proactively prevent the presence of these images and remove them. An application may be removed from the App Store if those responsible for it fail to implement sufficient safeguards or address violations after notification. Apple also clarifies the prohibition on adding such features after an application’s initial approval.
This clarification follows criticism over nonconsensual sexualized images produced with Grok by X users, including images of minors. The Verge notes that Apple had removed neither X nor Grok from its store, while having told senators that it had threatened to remove Grok.
The practical impact of this update will depend on its enforcement. The text describes obligations and potential penalties; it does not demonstrate that all affected applications are now being detected or removed. The development to watch will therefore be how Apple assesses developers’ safeguards and responds to reported violations.