xAI, led by Elon Musk, has relaxed the content guardrails for image generation in Grok. This has led to the mass generation of non-consensual sexual images on X, prompting investigations by regulatory authorities.
xAI's Grok App Remains on Play Store Despite Potential Google Policy Violation Regarding Non-Consensual Sexual Content Generation
This article is a translation. Read the Japanese original
Google maintains policies for the Play Store that prohibit apps containing "content related to sexually predatory behavior" and "non-consensual sexual content." Specifically, in 2023, Google explicitly stated that apps containing non-consensual sexual content created using technologies such as deepfakes would also be subject to removal.
The Grok app has received a Teen rating (T rating), making it available for download by children aged 13 to 17. Image editing is available in the Grok app even without a paid plan, and the first image edit can be performed before logging in.
While xAI has implemented some access restrictions on X, those restrictions are reportedly absent from the Grok app. It is reported that Google has taken no action regarding this situation at this time.
Source: Apps like Grok are banned under Google rules–why is it still in the Play Store?（HN 54pt・20コメント）（HN Search (backfill), 2026-01-13）