France to Tackle Grok Deepfakes of Women on X

French lawmakers are pushing for an official investigation into deepfake and AI-generated sexualized images of women that have been circulating on X (formerly Twitter) and generated using the AI chatbot Grok. The calls for action stem from concerns that current rules do not adequately protect individuals’ privacy or safety when online tools can produce manipulated images without consent.

The inquiry demand was outlined in a letter signed by members of France’s National Assembly and sent to the government’s digital regulator, ARCOM, and the justice and interior ministries. Lawmakers argue that deepfakes, explicit AI-generated imagery, and unregulated generative tools are being leveraged to harass women and may violate French laws on image rights and personal dignity.

The Grok Issue: What Triggered the Call for Investigation?

The politicians’ concerns follow a surge of content on X in December 2025, showing AI-altered images — including sexualized depictions of real individuals — that were created and shared widely. Some of these images were produced using prompts with Grok’s image-editing feature, which allows users to modify existing photos or generate new visuals based on text descriptions. Critics say the combination of platform features and lax oversight enables harmful content to spread rapidly.

One of the sharpest criticisms is that people whose photos were altered never consented to such use, raising alarm among privacy advocates and victims’ rights groups. Moreover, French lawmakers assert that existing legal frameworks for image rights (droit à l’image) are not adequately enforced in the age of generative AI, leaving individuals vulnerable to exploitation and reputational harm.

Lawmakers’ Demands on Grok and Legal Context

France’s petitioners are urging ARCOM and relevant ministries to:

• Investigate how AI tools like Grok’s editing functions are being used to create and disseminate manipulated images.
• Determine whether platforms like X and Grok are fulfilling their responsibilities under French and EU law to prevent the spread of harmful content.
• Recommend new regulations or enforcement actions to better protect privacy, particularly for minors and women affected by deepfake misuse.

Lawmakers highlighted that French law already recognises image rights and personal data protection, and that deepfake content may constitute unlawful defamation or violations of personal dignity. They further argued that generative AI companies should be held accountable for enabling tools that can be misused at scale — especially when safeguards are weak or unclear.

Broader Context: EU and Digital Regulation

France’s move aligns with broader European Union efforts to regulate emerging AI and protect individuals online. The Digital Services Act (DSA) and the proposed EU AI Act seek to impose obligations on platforms and AI developers to manage risk, prohibit harmful uses, and ensure transparency in automated content creation. Critics of deepfake proliferation say that these rules must be strengthened and enforced more rigorously.

Digital rights groups have echoed similar calls, saying generative AI tools must incorporate robust safety filters, consent mechanisms, and reporting avenues so that altered images — especially sexualized or defamatory ones — can’t be used to target individuals without recourse. Meanwhile, platforms like X have faced scrutiny over content moderation policies and the transparency of their AI features.

What Comes Next

France’s lawmakers have set a deadline for official responses from ARCOM and the ministries, and they intend to use any findings to inform legislative improvements. The outcome could influence how AI image generators and social media platforms are regulated not just in France but across the EU, especially as countries grapple with balancing technological innovation and personal rights.

You might also want to read: Grok Users Create Sexualized AI Image Edits Without Consent